2020-04-02T23:02:03.808 INFO:root:teuthology version: 1.0.0-8191bbb 2020-04-02T23:02:03.809 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.TGusE2.tmp -- --verbose --lock --description fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_ffsb.yaml} --name gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi --block --owner scheduled_gregf@teuthology --archive /home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919136 2020-04-02T23:02:03.850 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-02T23:02:03.906 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919136 branch: wip-greg-testing-42 description: fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_ffsb.yaml} email: gfarnum@redhat.com first_in_suite: false job_id: '4919136' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: centos os_version: '8.1' overrides: admin_socket: branch: wip-greg-testing-42 ceph: cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd_max_omap_entries_per_request: 10000 fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - SLOW_OPS - slow request sha1: cbb84f71d70460f911296715ab61ac09c6962b17 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: cbb84f71d70460f911296715ab61ac09c6962b17 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-greg-testing-42 sha1: cbb84f71d70460f911296715ab61ac09c6962b17 owner: scheduled_gregf@teuthology priority: 101 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 sha1: cbb84f71d70460f911296715ab61ac09c6962b17 suite: fs suite_branch: wip-greg-testing-42 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_wip-greg-testing-42/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: cbb84f71d70460f911296715ab61ac09c6962b17 tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - ceph: null - ceph-fuse: null - check-counter: counters: mds: - mds.dir_split - workunit: clients: all: - suites/ffsb.sh teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.14489 2020-04-02T23:02:03.907 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_wip-greg-testing-42/qa; will attempt to use it 2020-04-02T23:02:03.907 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_wip-greg-testing-42/qa/tasks 2020-04-02T23:02:03.907 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-04-02T23:02:03.909 INFO:teuthology.task.internal:Checking packages... 2020-04-02T23:02:03.922 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash 'cbb84f71d70460f911296715ab61ac09c6962b17' 2020-04-02T23:02:03.922 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-04-02T23:02:03.922 INFO:teuthology.packaging:ref: None 2020-04-02T23:02:03.922 INFO:teuthology.packaging:tag: None 2020-04-02T23:02:03.922 INFO:teuthology.packaging:branch: wip-greg-testing-42 2020-04-02T23:02:03.922 INFO:teuthology.packaging:sha1: cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:02:03.923 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-greg-testing-42 2020-04-02T23:02:04.157 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-316.gcbb84f7 2020-04-02T23:02:04.157 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-04-02T23:02:04.167 INFO:teuthology.task.internal:no buildpackages task found 2020-04-02T23:02:04.167 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-04-02T23:02:04.205 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-04-02T23:02:04.205 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-02T23:02:04.256 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:02:14.277 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:02:24.293 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:02:34.308 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:02:44.325 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:02:54.342 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:03:04.357 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:03:14.370 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:03:24.386 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:03:34.400 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:03:44.417 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:03:54.430 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:04:04.453 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:04:14.466 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:04:24.483 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:04:34.497 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:04:44.515 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:04:54.532 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:05:04.542 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:05:14.555 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:05:24.568 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:05:34.584 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:05:44.601 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:05:54.617 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:06:04.635 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:06:14.652 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:06:24.669 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:06:34.684 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:06:44.703 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:06:54.720 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:07:04.737 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:07:14.752 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:07:24.768 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:07:34.785 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:07:44.800 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:07:54.810 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:08:04.824 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:08:14.854 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:08:24.870 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:08:34.886 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:08:44.903 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:08:54.920 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:09:04.933 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:09:14.946 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:09:24.960 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:09:34.976 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:09:45.005 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:09:55.021 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:10:05.038 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:10:15.053 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:10:25.073 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:10:35.086 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-02T23:10:45.100 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:10:55.120 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:11:05.137 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:11:15.152 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:11:25.164 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-02T23:11:35.181 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_gregf@teuthology', 'description': '/home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919136', 'machine_type': 'smithi'} 2020-04-02T23:11:35.200 DEBUG:teuthology.lock.ops:locked ubuntu@smithi084.front.sepia.ceph.com, ubuntu@smithi042.front.sepia.ceph.com 2020-04-02T23:11:35.255 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-04-02T23:11:35.434 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of centos 8.1 2020-04-02T23:11:35.447 INFO:teuthology.provision.fog.smithi042:Scheduling deploy of centos 8.1 2020-04-02T23:11:35.781 INFO:teuthology.orchestra.console:Power off smithi042 2020-04-02T23:11:35.782 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-04-02T23:11:35.795 INFO:teuthology.orchestra.console:Power off smithi084 2020-04-02T23:11:35.795 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-04-02T23:11:35.802 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:11:35.818 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:11:39.829 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:11:39.839 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:11:43.941 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:11:43.949 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:11:44.150 INFO:teuthology.orchestra.console:Power off for smithi042 completed 2020-04-02T23:11:44.157 INFO:teuthology.orchestra.console:Power off for smithi084 completed 2020-04-02T23:11:44.252 INFO:teuthology.orchestra.console:Power on smithi042 2020-04-02T23:11:44.252 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-04-02T23:11:44.261 INFO:teuthology.orchestra.console:Power on smithi084 2020-04-02T23:11:44.261 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-04-02T23:11:44.273 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:11:44.281 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:11:48.294 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:11:48.305 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:11:52.409 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:11:52.418 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-02T23:11:52.619 INFO:teuthology.orchestra.console:Power on for smithi042 completed 2020-04-02T23:11:52.720 INFO:teuthology.provision.fog.smithi042:Waiting for deploy to finish 2020-04-02T23:11:52.732 INFO:teuthology.orchestra.console:Power on for smithi084 completed 2020-04-02T23:11:52.833 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2020-04-02T23:14:23.849 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:14:32.906 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:14:39.002 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:14:41.958 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:14:48.075 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:14:51.018 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:14:57.127 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:15:00.074 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:15:06.183 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:15:09.126 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:15:15.238 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:15:18.185 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:15:24.297 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:15:33.357 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:15:42.440 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:15:51.501 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:16:24.210 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:16:24.513 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:16:24.817 INFO:teuthology.orchestra.run.smithi042:> hostname 2020-04-02T23:16:24.832 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042.front.sepia.ceph.com 2020-04-02T23:16:24.832 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:16:24.888 INFO:teuthology.orchestra.run.smithi042:> grep smithi042.front.sepia.ceph.com /etc/hosts 2020-04-02T23:16:24.943 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42 smithi042.front.sepia.ceph.com smithi042 2020-04-02T23:16:24.943 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:16:24.998 INFO:teuthology.orchestra.run.smithi042:> sudo hostname smithi042 2020-04-02T23:16:25.113 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:16:25.127 INFO:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hosts 2020-04-02T23:16:25.199 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:16:25.253 INFO:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/172.21.15.42/172.21.15.42/g' /etc/hosts 2020-04-02T23:16:25.325 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:16:25.379 INFO:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hostname 2020-04-02T23:16:25.451 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:16:25.505 INFO:teuthology.orchestra.run.smithi042:> sudo hostname smithi042 2020-04-02T23:16:25.575 INFO:teuthology.provision.fog.smithi042:Deploy complete! 2020-04-02T23:16:25.577 DEBUG:teuthology.parallel:result is None 2020-04-02T23:16:57.526 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:16:57.846 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:16:58.140 INFO:teuthology.orchestra.run.smithi084:> hostname 2020-04-02T23:16:58.154 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2020-04-02T23:16:58.154 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:16:58.208 INFO:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts 2020-04-02T23:16:58.273 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2020-04-02T23:16:58.274 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:16:58.327 INFO:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2020-04-02T23:16:58.456 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:16:58.469 INFO:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts 2020-04-02T23:16:58.538 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:16:58.591 INFO:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2020-04-02T23:16:58.658 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:16:58.711 INFO:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname 2020-04-02T23:16:58.778 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:16:58.831 INFO:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2020-04-02T23:16:58.896 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2020-04-02T23:16:58.898 DEBUG:teuthology.parallel:result is None 2020-04-02T23:16:59.022 INFO:teuthology.lock.ops:Checking smithi042.front.sepia.ceph.com 2020-04-02T23:16:59.023 INFO:teuthology.lock.ops:New key found. Updating... 2020-04-02T23:16:59.043 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2020-04-02T23:16:59.043 INFO:teuthology.lock.ops:New key found. Updating... 2020-04-02T23:16:59.057 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: set os type and version on server 2020-04-02T23:16:59.058 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:16:59.134 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:16:59.320 INFO:teuthology.orchestra.run.smithi042:> uname -m 2020-04-02T23:16:59.375 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2020-04-02T23:16:59.375 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:16:59.428 INFO:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2020-04-02T23:16:59.484 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Linux" 2020-04-02T23:16:59.485 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="8 (Core)" 2020-04-02T23:16:59.486 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2020-04-02T23:16:59.486 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2020-04-02T23:16:59.486 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="8" 2020-04-02T23:16:59.486 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el8" 2020-04-02T23:16:59.486 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-02T23:16:59.486 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2020-04-02T23:16:59.487 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-02T23:16:59.487 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://www.centos.org/" 2020-04-02T23:16:59.487 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-02T23:16:59.487 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:16:59.487 INFO:teuthology.orchestra.run.smithi042.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-02T23:16:59.487 INFO:teuthology.orchestra.run.smithi042.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-02T23:16:59.488 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-02T23:16:59.488 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-02T23:16:59.488 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:16:59.489 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2020-04-02T23:16:59.504 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2020-04-02T23:16:59.505 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:16:59.576 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:16:59.738 INFO:teuthology.orchestra.run.smithi084:> uname -m 2020-04-02T23:16:59.792 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2020-04-02T23:16:59.792 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:16:59.845 INFO:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2020-04-02T23:16:59.898 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Linux" 2020-04-02T23:16:59.898 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8 (Core)" 2020-04-02T23:16:59.898 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2020-04-02T23:16:59.899 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2020-04-02T23:16:59.899 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8" 2020-04-02T23:16:59.899 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2020-04-02T23:16:59.899 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-02T23:16:59.899 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2020-04-02T23:16:59.899 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-02T23:16:59.900 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.centos.org/" 2020-04-02T23:16:59.900 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-02T23:16:59.900 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:16:59.900 INFO:teuthology.orchestra.run.smithi084.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-02T23:16:59.900 INFO:teuthology.orchestra.run.smithi084.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-02T23:16:59.901 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-02T23:16:59.901 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-02T23:16:59.901 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:16:59.902 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2020-04-02T23:16:59.915 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-04-02T23:16:59.944 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi042.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHmc1pxguZHSR1ysZN/cg637hB68wv4QOG8P54/6P1AyoLyI4YTdfbzT7wzv1J99+g3IwtTTkEpDs1l0WGWihkhP+bubw2Yn5WI0HON0cZs7O9/LNBdbipdh8GhFHfAEyH2GumLfcFaGgSBvg+6QZTkSQ3x744y/f6jD9em9w3UeLSfFw+FkAMcI+CDVWBmJk+T1Q+GaUNhhQfDZyHysNQWI8VIZ7pr2s5MXrHYvxtgynJG4uSHXaagur70Wb19ZZsW0i8cem3d3izpcC9ELjo4WJss4Mw+Ri3Zk9OXdtHKSS2JuBKr0E1uxoLFbF8FCArdZl2wVEvYq/FZ7ofZlvm7Z3g607hHhgieBO/wk/4Gjq9j8ROVlXz5AtyTouUflErpnhoXHC3owyzIOqCxrOMNn8dkjYOXyx0cdBaxIgcE7c94UHKPQCQYMIp+h4GJS2+S1HJyvrQ2c07rMXcXP4QvAyi5aPQf1bK4vW+JQdZWuwoe0TAWI/ePYq59pqU0Lk= smithi084.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDa8OwPz1tE8KM9I5IoXBzqM0VN6ZZwwDimHNMmjMhGwTVSoUoxmw3Uv1VUlFzi3LqvMB+p6MYgeWQ2Xbq9rh0Zv5etTThJT3bwqpANyi8vKVKCJoR+Hkxn20pP5vJtxUzucLdrTcWH5ij9uPg5u5bTBEECfhghErMN7c+atmD6/TWWW2aX/AEW9JmII6zpoHQSGC2lgbnTe1YdwcGu69CjaxGZhG+8CX8/iFQEYm7hoFW1oOvcFMBoUB1XlmNqQt6cQojJhVuEk/ojtbG8JH+lMSPhdv+KRhC9MeJAu2vJWAIgBbVcxbUL0NU/guCuZjEkLr0jAAZ6Z4+LFj5q5sHlStGjVRalzKqThEHyDvLj226MKR50+RqNQWN2MnI8QgqxxXrp2zK3Y3+n381DCZx/4Z8847BtQCaFcLQCVYHPtmjeQHrj6Xnt9afZu45tFEQoZQlQHjoMC+cJO3E/fpaGfpy30+ZRS66/vVujCVGwY7/MHPd1BzXcbqjPSyBcgo0= 2020-04-02T23:16:59.944 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-02T23:16:59.987 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-04-02T23:16:59.996 INFO:teuthology.task.internal:Saving configuration 2020-04-02T23:17:00.018 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-04-02T23:17:00.042 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-04-02T23:17:00.058 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-04-02 23:11:35.188767', u'locked_by': u'scheduled_gregf@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi042.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI/VJuMRJyC6ecQj0OA7lQd3J30RUf9DnIoJUmw8RvBOcChJGiUPqiIG4l5r40W/0pFUgoZt7PkxYCmBooXIYdA=', u'description': u'/home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919136'} 2020-04-02T23:17:00.075 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-04-02 23:11:35.188786', u'locked_by': u'scheduled_gregf@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi084.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLL3Q4n5mWKDAb+u//qzrwPZ8ffhm4CWmzyUhAtmGkHYXCHg59jEm76lPw1+4ElWciBLTIE7XfL7MDixXzfGh/M=', u'description': u'/home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919136'} 2020-04-02T23:17:00.075 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-04-02T23:17:00.085 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2020-04-02T23:17:00.085 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2020-04-02T23:17:00.085 INFO:teuthology.run_tasks:Running task console_log... 2020-04-02T23:17:00.150 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-04-02T23:17:00.151 INFO:teuthology.run_tasks:Running task internal.connect... 2020-04-02T23:17:00.164 INFO:teuthology.task.internal:Opening connections... 2020-04-02T23:17:00.164 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2020-04-02T23:17:00.165 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:17:00.235 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi042.front.sepia.ceph.com 2020-04-02T23:17:00.236 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:17:00.313 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-04-02T23:17:00.341 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:17:00.356 INFO:teuthology.orchestra.run.smithi084:> uname -m 2020-04-02T23:17:00.410 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2020-04-02T23:17:00.410 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:17:00.465 INFO:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2020-04-02T23:17:00.517 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Linux" 2020-04-02T23:17:00.517 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8 (Core)" 2020-04-02T23:17:00.518 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2020-04-02T23:17:00.518 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2020-04-02T23:17:00.518 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8" 2020-04-02T23:17:00.518 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2020-04-02T23:17:00.518 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-02T23:17:00.518 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2020-04-02T23:17:00.519 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-02T23:17:00.519 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.centos.org/" 2020-04-02T23:17:00.519 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-02T23:17:00.519 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:17:00.519 INFO:teuthology.orchestra.run.smithi084.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-02T23:17:00.519 INFO:teuthology.orchestra.run.smithi084.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-02T23:17:00.519 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-02T23:17:00.520 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-02T23:17:00.520 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:17:00.520 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2020-04-02T23:17:00.538 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:17:00.553 INFO:teuthology.orchestra.run.smithi042:> uname -m 2020-04-02T23:17:00.606 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2020-04-02T23:17:00.607 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:17:00.660 INFO:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2020-04-02T23:17:00.714 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Linux" 2020-04-02T23:17:00.715 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="8 (Core)" 2020-04-02T23:17:00.715 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2020-04-02T23:17:00.715 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2020-04-02T23:17:00.715 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="8" 2020-04-02T23:17:00.715 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el8" 2020-04-02T23:17:00.715 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-02T23:17:00.716 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2020-04-02T23:17:00.716 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-02T23:17:00.716 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://www.centos.org/" 2020-04-02T23:17:00.716 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-02T23:17:00.716 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:17:00.716 INFO:teuthology.orchestra.run.smithi042.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-02T23:17:00.717 INFO:teuthology.orchestra.run.smithi042.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-02T23:17:00.717 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-02T23:17:00.717 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-02T23:17:00.717 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:17:00.717 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2020-04-02T23:17:00.733 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-04-02T23:17:00.756 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-04-02T23:17:00.798 INFO:teuthology.task.internal:Checking for old test directory... 2020-04-02T23:17:00.798 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:17:00.813 INFO:teuthology.orchestra.run.smithi042:> test '!' -e /home/ubuntu/cephtest 2020-04-02T23:17:00.855 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:17:00.868 INFO:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2020-04-02T23:17:00.921 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-04-02T23:17:00.929 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-04-02T23:17:00.930 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:17:00.943 INFO:teuthology.orchestra.run.smithi042:> test -z $(ls -A /var/lib/ceph) 2020-04-02T23:17:00.986 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:17:00.999 INFO:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2020-04-02T23:17:01.068 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-04-02T23:17:01.105 INFO:teuthology.run_tasks:Running task kernel... 2020-04-02T23:17:01.132 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mds.a': {'sha1': 'distro', 'kdb': True}, 'mds.b': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}} 2020-04-02T23:17:01.132 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2020-04-02T23:17:01.132 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:17:01.149 INFO:teuthology.orchestra.run.smithi042:> uname -r 2020-04-02T23:17:01.203 INFO:teuthology.orchestra.run.smithi042.stdout:4.18.0-147.5.1.el8_1.x86_64 2020-04-02T23:17:01.203 INFO:teuthology.task.kernel:Running kernel on smithi042: 4.18.0-147.5.1.el8_1.x86_64 2020-04-02T23:17:01.204 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:17:01.257 INFO:teuthology.orchestra.run.smithi042:> sudo yum install -y kernel 2020-04-02T23:17:03.717 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS-8 - AppStream 41 MB/s | 6.6 MB 00:00 2020-04-02T23:17:04.938 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS-8 - Base 41 MB/s | 5.0 MB 00:00 2020-04-02T23:17:05.755 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS-8 - Extras 69 kB/s | 4.4 kB 00:00 2020-04-02T23:17:05.992 INFO:teuthology.orchestra.run.smithi042.stdout:Copr repo for ceph-el8 owned by ktdreyer 249 kB/s | 47 kB 00:00 2020-04-02T23:17:06.357 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 20 MB/s | 6.2 MB 00:00 2020-04-02T23:17:07.667 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 5.6 MB/s | 30 kB 00:00 2020-04-02T23:17:08.616 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-04-02T23:17:08.616 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-4.18.0-147.5.1.el8_1.x86_64 is already installed. 2020-04-02T23:17:08.781 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2020-04-02T23:17:08.782 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2020-04-02T23:17:08.782 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2020-04-02T23:17:08.906 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:17:08.919 INFO:teuthology.orchestra.run.smithi042:> echo no | sudo yum reinstall kernel || true 2020-04-02T23:17:09.380 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:02 ago on Thu 02 Apr 2020 11:17:07 PM UTC. 2020-04-02T23:17:09.775 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2020-04-02T23:17:09.776 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2020-04-02T23:17:09.776 INFO:teuthology.orchestra.run.smithi042.stdout: Package Architecture Version Repository Size 2020-04-02T23:17:09.776 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2020-04-02T23:17:09.776 INFO:teuthology.orchestra.run.smithi042.stdout:Reinstalling: 2020-04-02T23:17:09.776 INFO:teuthology.orchestra.run.smithi042.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 CentOS-Base 1.5 M 2020-04-02T23:17:09.776 INFO:teuthology.orchestra.run.smithi042.stdout: kernel x86_64 4.18.0-147.el8 CentOS-Base 1.5 M 2020-04-02T23:17:09.777 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:17:09.777 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2020-04-02T23:17:09.777 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2020-04-02T23:17:09.777 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:17:09.778 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 3.1 M 2020-04-02T23:17:09.778 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 0 2020-04-02T23:17:09.778 INFO:teuthology.orchestra.run.smithi042.stderr:Operation aborted. 2020-04-02T23:17:09.852 INFO:teuthology.orchestra.run.smithi042.stdout:Is this ok [y/N]: 2020-04-02T23:17:09.853 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:17:09.867 INFO:teuthology.orchestra.run.smithi042:> sudo yum reinstall -y kernel || true 2020-04-02T23:17:10.327 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:03 ago on Thu 02 Apr 2020 11:17:07 PM UTC. 2020-04-02T23:17:10.689 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2020-04-02T23:17:10.690 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2020-04-02T23:17:10.690 INFO:teuthology.orchestra.run.smithi042.stdout: Package Architecture Version Repository Size 2020-04-02T23:17:10.690 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2020-04-02T23:17:10.690 INFO:teuthology.orchestra.run.smithi042.stdout:Reinstalling: 2020-04-02T23:17:10.690 INFO:teuthology.orchestra.run.smithi042.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 CentOS-Base 1.5 M 2020-04-02T23:17:10.690 INFO:teuthology.orchestra.run.smithi042.stdout: kernel x86_64 4.18.0-147.el8 CentOS-Base 1.5 M 2020-04-02T23:17:10.691 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:17:10.691 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2020-04-02T23:17:10.691 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2020-04-02T23:17:10.691 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:17:10.692 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 3.1 M 2020-04-02T23:17:10.692 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 0 2020-04-02T23:17:10.692 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2020-04-02T23:17:10.751 INFO:teuthology.orchestra.run.smithi042.stdout:(1/2): kernel-4.18.0-147.5.1.el8_1.x86_64.rpm 26 MB/s | 1.5 MB 00:00 2020-04-02T23:17:10.760 INFO:teuthology.orchestra.run.smithi042.stdout:(2/2): kernel-4.18.0-147.el8.x86_64.rpm 22 MB/s | 1.5 MB 00:00 2020-04-02T23:17:10.761 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2020-04-02T23:17:10.761 INFO:teuthology.orchestra.run.smithi042.stdout:Total 43 MB/s | 3.1 MB 00:00 2020-04-02T23:17:10.786 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2020-04-02T23:17:10.991 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2020-04-02T23:17:10.992 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2020-04-02T23:17:11.058 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2020-04-02T23:17:11.058 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2020-04-02T23:17:11.216 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2020-04-02T23:17:11.351 INFO:teuthology.orchestra.run.smithi042.stdout: Reinstalling : kernel-4.18.0-147.el8.x86_64 1/4 2020-04-02T23:17:11.512 INFO:teuthology.orchestra.run.smithi042.stdout: Reinstalling : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-04-02T23:17:11.512 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:17:11.611 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:17:11.612 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-04-02T23:17:11.854 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-04-02T23:17:11.854 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 1/4 2020-04-02T23:17:11.854 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-04-02T23:17:11.855 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:17:12.259 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 4/4 2020-04-02T23:17:12.259 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:17:12.260 INFO:teuthology.orchestra.run.smithi042.stdout:Reinstalled: 2020-04-02T23:17:12.260 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-4.18.0-147.5.1.el8_1.x86_64 kernel-4.18.0-147.el8.x86_64 2020-04-02T23:17:12.260 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:17:12.260 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2020-04-02T23:17:12.343 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:17:12.357 INFO:teuthology.orchestra.run.smithi042:> rpm -q kernel --last | head -n 1 2020-04-02T23:17:12.452 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-4.18.0-147.el8.x86_64 Thu 02 Apr 2020 11:17:11 PM UTC 2020-04-02T23:17:12.454 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-04-02T23:17:12.454 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-147.5.1.el8_1.x86_64 Expected: 4.18.0-147.el8.x86_64 2020-04-02T23:17:12.454 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:17:12.471 INFO:teuthology.orchestra.run.smithi084:> uname -r 2020-04-02T23:17:12.526 INFO:teuthology.orchestra.run.smithi084.stdout:4.18.0-147.5.1.el8_1.x86_64 2020-04-02T23:17:12.527 INFO:teuthology.task.kernel:Running kernel on smithi084: 4.18.0-147.5.1.el8_1.x86_64 2020-04-02T23:17:12.527 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:17:12.582 INFO:teuthology.orchestra.run.smithi084:> sudo yum install -y kernel 2020-04-02T23:17:15.061 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-8 - AppStream 38 MB/s | 6.6 MB 00:00 2020-04-02T23:17:16.217 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-8 - Base 41 MB/s | 5.0 MB 00:00 2020-04-02T23:17:16.993 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-8 - Extras 69 kB/s | 4.4 kB 00:00 2020-04-02T23:17:17.134 INFO:teuthology.orchestra.run.smithi084.stdout:Copr repo for ceph-el8 owned by ktdreyer 487 kB/s | 47 kB 00:00 2020-04-02T23:17:17.482 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 21 MB/s | 6.2 MB 00:00 2020-04-02T23:17:18.762 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 6.0 MB/s | 30 kB 00:00 2020-04-02T23:17:19.645 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-04-02T23:17:19.645 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-4.18.0-147.5.1.el8_1.x86_64 is already installed. 2020-04-02T23:17:19.801 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-02T23:17:19.802 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2020-04-02T23:17:19.802 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-02T23:17:19.920 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:17:19.974 INFO:teuthology.orchestra.run.smithi084:> echo no | sudo yum reinstall kernel || true 2020-04-02T23:17:20.409 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:02 ago on Thu 02 Apr 2020 11:17:18 PM UTC. 2020-04-02T23:17:20.815 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-02T23:17:20.816 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-02T23:17:20.816 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2020-04-02T23:17:20.816 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-02T23:17:20.816 INFO:teuthology.orchestra.run.smithi084.stdout:Reinstalling: 2020-04-02T23:17:20.816 INFO:teuthology.orchestra.run.smithi084.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 CentOS-Base 1.5 M 2020-04-02T23:17:20.816 INFO:teuthology.orchestra.run.smithi084.stdout: kernel x86_64 4.18.0-147.el8 CentOS-Base 1.5 M 2020-04-02T23:17:20.816 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:17:20.817 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2020-04-02T23:17:20.817 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-02T23:17:20.817 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:17:20.818 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 3.1 M 2020-04-02T23:17:20.818 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 0 2020-04-02T23:17:20.818 INFO:teuthology.orchestra.run.smithi084.stderr:Operation aborted. 2020-04-02T23:17:20.901 INFO:teuthology.orchestra.run.smithi084.stdout:Is this ok [y/N]: 2020-04-02T23:17:20.901 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:17:20.915 INFO:teuthology.orchestra.run.smithi084:> sudo yum reinstall -y kernel || true 2020-04-02T23:17:21.341 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:03 ago on Thu 02 Apr 2020 11:17:18 PM UTC. 2020-04-02T23:17:21.689 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-02T23:17:21.689 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-02T23:17:21.689 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2020-04-02T23:17:21.690 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-02T23:17:21.690 INFO:teuthology.orchestra.run.smithi084.stdout:Reinstalling: 2020-04-02T23:17:21.690 INFO:teuthology.orchestra.run.smithi084.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 CentOS-Base 1.5 M 2020-04-02T23:17:21.690 INFO:teuthology.orchestra.run.smithi084.stdout: kernel x86_64 4.18.0-147.el8 CentOS-Base 1.5 M 2020-04-02T23:17:21.690 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:17:21.690 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2020-04-02T23:17:21.690 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-02T23:17:21.690 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:17:21.691 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 3.1 M 2020-04-02T23:17:21.691 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 0 2020-04-02T23:17:21.691 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2020-04-02T23:17:21.746 INFO:teuthology.orchestra.run.smithi084.stdout:(1/2): kernel-4.18.0-147.5.1.el8_1.x86_64.rpm 28 MB/s | 1.5 MB 00:00 2020-04-02T23:17:21.756 INFO:teuthology.orchestra.run.smithi084.stdout:(2/2): kernel-4.18.0-147.el8.x86_64.rpm 23 MB/s | 1.5 MB 00:00 2020-04-02T23:17:21.757 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2020-04-02T23:17:21.758 INFO:teuthology.orchestra.run.smithi084.stdout:Total 45 MB/s | 3.1 MB 00:00 2020-04-02T23:17:21.781 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2020-04-02T23:17:21.970 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2020-04-02T23:17:21.970 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2020-04-02T23:17:22.037 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2020-04-02T23:17:22.037 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2020-04-02T23:17:22.194 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2020-04-02T23:17:22.341 INFO:teuthology.orchestra.run.smithi084.stdout: Reinstalling : kernel-4.18.0-147.el8.x86_64 1/4 2020-04-02T23:17:22.475 INFO:teuthology.orchestra.run.smithi084.stdout: Reinstalling : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-04-02T23:17:22.475 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:17:22.592 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:17:22.593 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-04-02T23:17:22.818 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-04-02T23:17:22.819 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 1/4 2020-04-02T23:17:22.819 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-04-02T23:17:22.819 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 3/4 2020-04-02T23:17:23.179 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 4/4 2020-04-02T23:17:23.179 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:17:23.179 INFO:teuthology.orchestra.run.smithi084.stdout:Reinstalled: 2020-04-02T23:17:23.179 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-4.18.0-147.5.1.el8_1.x86_64 kernel-4.18.0-147.el8.x86_64 2020-04-02T23:17:23.179 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:17:23.180 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-02T23:17:23.270 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:17:23.324 INFO:teuthology.orchestra.run.smithi084:> rpm -q kernel --last | head -n 1 2020-04-02T23:17:23.423 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-4.18.0-147.el8.x86_64 Thu 02 Apr 2020 11:17:22 PM UTC 2020-04-02T23:17:23.424 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-04-02T23:17:23.424 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-147.5.1.el8_1.x86_64 Expected: 4.18.0-147.el8.x86_64 2020-04-02T23:17:23.424 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2020-04-02T23:17:23.424 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-04-02T23:17:23.425 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-04-02T23:17:23.425 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2020-04-02T23:17:23.425 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi042.front.sepia.ceph.com, path=None, version=distro) 2020-04-02T23:17:23.425 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:17:23.442 INFO:teuthology.orchestra.run.smithi042:> rpm -q kernel --last | head -n 1 2020-04-02T23:17:23.531 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-4.18.0-147.el8.x86_64 Thu 02 Apr 2020 11:17:11 PM UTC 2020-04-02T23:17:23.532 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-04-02T23:17:23.533 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:17:23.548 INFO:teuthology.orchestra.run.smithi042:> sudo rpm -qi grub2-tools 2020-04-02T23:17:23.627 INFO:teuthology.orchestra.run.smithi042.stdout:Name : grub2-tools 2020-04-02T23:17:23.627 INFO:teuthology.orchestra.run.smithi042.stdout:Epoch : 1 2020-04-02T23:17:23.627 INFO:teuthology.orchestra.run.smithi042.stdout:Version : 2.02 2020-04-02T23:17:23.627 INFO:teuthology.orchestra.run.smithi042.stdout:Release : 78.el8 2020-04-02T23:17:23.628 INFO:teuthology.orchestra.run.smithi042.stdout:Architecture: x86_64 2020-04-02T23:17:23.628 INFO:teuthology.orchestra.run.smithi042.stdout:Install Date: Mon 30 Mar 2020 07:18:38 PM UTC 2020-04-02T23:17:23.628 INFO:teuthology.orchestra.run.smithi042.stdout:Group : System Environment/Base 2020-04-02T23:17:23.628 INFO:teuthology.orchestra.run.smithi042.stdout:Size : 9192691 2020-04-02T23:17:23.628 INFO:teuthology.orchestra.run.smithi042.stdout:License : GPLv3+ 2020-04-02T23:17:23.628 INFO:teuthology.orchestra.run.smithi042.stdout:Signature : RSA/SHA256, Wed 04 Dec 2019 11:50:58 PM UTC, Key ID 05b555b38483c65d 2020-04-02T23:17:23.628 INFO:teuthology.orchestra.run.smithi042.stdout:Source RPM : grub2-2.02-78.el8.src.rpm 2020-04-02T23:17:23.628 INFO:teuthology.orchestra.run.smithi042.stdout:Build Date : Mon 25 Nov 2019 04:08:30 PM UTC 2020-04-02T23:17:23.629 INFO:teuthology.orchestra.run.smithi042.stdout:Build Host : kbuilder.bsys.centos.org 2020-04-02T23:17:23.629 INFO:teuthology.orchestra.run.smithi042.stdout:Relocations : (not relocatable) 2020-04-02T23:17:23.629 INFO:teuthology.orchestra.run.smithi042.stdout:Packager : CentOS BuildSystem 2020-04-02T23:17:23.629 INFO:teuthology.orchestra.run.smithi042.stdout:Vendor : CentOS 2020-04-02T23:17:23.629 INFO:teuthology.orchestra.run.smithi042.stdout:URL : http://www.gnu.org/software/grub/ 2020-04-02T23:17:23.629 INFO:teuthology.orchestra.run.smithi042.stdout:Summary : Support tools for GRUB. 2020-04-02T23:17:23.629 INFO:teuthology.orchestra.run.smithi042.stdout:Description : 2020-04-02T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-04-02T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stdout:customizable bootloader with modular architecture. It supports a rich 2020-04-02T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stdout:variety of kernel formats, file systems, computer architectures and 2020-04-02T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stdout:hardware devices. 2020-04-02T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:17:23.630 INFO:teuthology.orchestra.run.smithi042.stdout:This subpackage provides tools for support of all platforms. 2020-04-02T23:17:23.631 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-04-02T23:17:23.631 INFO:teuthology.task.kernel:Updating grub on smithi042 to boot 4.18.0-147.el8.x86_64 2020-04-02T23:17:23.631 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:17:23.687 INFO:teuthology.orchestra.run.smithi042:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-04-02T23:17:25.064 INFO:teuthology.orchestra.run.smithi042.stderr:Generating grub configuration file ... 2020-04-02T23:17:27.139 INFO:teuthology.orchestra.run.smithi042.stderr:done 2020-04-02T23:17:27.141 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:17:27.155 INFO:teuthology.orchestra.run.smithi042:> mktemp 2020-04-02T23:17:27.209 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.fy4QfG5H2X 2020-04-02T23:17:27.210 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:17:27.264 INFO:teuthology.orchestra.run.smithi042:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.fy4QfG5H2X 2020-04-02T23:17:27.349 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:17:27.362 INFO:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.fy4QfG5H2X 2020-04-02T23:17:27.509 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.fy4QfG5H2X is 4KB 2020-04-02T23:17:27.560 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:17:27.574 INFO:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.fy4QfG5H2X 2020-04-02T23:17:27.627 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:17:27.681 INFO:teuthology.orchestra.run.smithi042:> sudo /bin/ls /boot/loader/entries || true 2020-04-02T23:17:27.762 INFO:teuthology.orchestra.run.smithi042.stdout:ac76e1f739a34903a61708b8315bf038-0-rescue.conf 2020-04-02T23:17:27.762 INFO:teuthology.orchestra.run.smithi042.stdout:ac76e1f739a34903a61708b8315bf038-4.18.0-147.5.1.el8_1.x86_64.conf 2020-04-02T23:17:27.762 INFO:teuthology.orchestra.run.smithi042.stdout:ac76e1f739a34903a61708b8315bf038-4.18.0-147.el8.x86_64.conf 2020-04-02T23:17:27.764 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:17:27.817 INFO:teuthology.orchestra.run.smithi042:> sudo grub2-set-default ac76e1f739a34903a61708b8315bf038-4.18.0-147.el8.x86_64 2020-04-02T23:17:27.979 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:17:27.993 INFO:teuthology.orchestra.run.smithi042:> sudo shutdown -r now 2020-04-02T23:17:28.036 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2020-04-02T23:17:28.036 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi084.front.sepia.ceph.com, path=None, version=distro) 2020-04-02T23:17:28.036 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:17:28.054 INFO:teuthology.orchestra.run.smithi084:> rpm -q kernel --last | head -n 1 2020-04-02T23:17:28.139 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-4.18.0-147.el8.x86_64 Thu 02 Apr 2020 11:17:22 PM UTC 2020-04-02T23:17:28.141 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-04-02T23:17:28.141 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:17:28.155 INFO:teuthology.orchestra.run.smithi084:> sudo rpm -qi grub2-tools 2020-04-02T23:17:28.228 INFO:teuthology.orchestra.run.smithi084.stdout:Name : grub2-tools 2020-04-02T23:17:28.228 INFO:teuthology.orchestra.run.smithi084.stdout:Epoch : 1 2020-04-02T23:17:28.229 INFO:teuthology.orchestra.run.smithi084.stdout:Version : 2.02 2020-04-02T23:17:28.229 INFO:teuthology.orchestra.run.smithi084.stdout:Release : 78.el8 2020-04-02T23:17:28.229 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: x86_64 2020-04-02T23:17:28.229 INFO:teuthology.orchestra.run.smithi084.stdout:Install Date: Mon 30 Mar 2020 07:18:38 PM UTC 2020-04-02T23:17:28.229 INFO:teuthology.orchestra.run.smithi084.stdout:Group : System Environment/Base 2020-04-02T23:17:28.229 INFO:teuthology.orchestra.run.smithi084.stdout:Size : 9192691 2020-04-02T23:17:28.229 INFO:teuthology.orchestra.run.smithi084.stdout:License : GPLv3+ 2020-04-02T23:17:28.230 INFO:teuthology.orchestra.run.smithi084.stdout:Signature : RSA/SHA256, Wed 04 Dec 2019 11:50:58 PM UTC, Key ID 05b555b38483c65d 2020-04-02T23:17:28.230 INFO:teuthology.orchestra.run.smithi084.stdout:Source RPM : grub2-2.02-78.el8.src.rpm 2020-04-02T23:17:28.230 INFO:teuthology.orchestra.run.smithi084.stdout:Build Date : Mon 25 Nov 2019 04:08:30 PM UTC 2020-04-02T23:17:28.230 INFO:teuthology.orchestra.run.smithi084.stdout:Build Host : kbuilder.bsys.centos.org 2020-04-02T23:17:28.230 INFO:teuthology.orchestra.run.smithi084.stdout:Relocations : (not relocatable) 2020-04-02T23:17:28.230 INFO:teuthology.orchestra.run.smithi084.stdout:Packager : CentOS BuildSystem 2020-04-02T23:17:28.231 INFO:teuthology.orchestra.run.smithi084.stdout:Vendor : CentOS 2020-04-02T23:17:28.231 INFO:teuthology.orchestra.run.smithi084.stdout:URL : http://www.gnu.org/software/grub/ 2020-04-02T23:17:28.231 INFO:teuthology.orchestra.run.smithi084.stdout:Summary : Support tools for GRUB. 2020-04-02T23:17:28.231 INFO:teuthology.orchestra.run.smithi084.stdout:Description : 2020-04-02T23:17:28.231 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:17:28.231 INFO:teuthology.orchestra.run.smithi084.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-04-02T23:17:28.232 INFO:teuthology.orchestra.run.smithi084.stdout:customizable bootloader with modular architecture. It supports a rich 2020-04-02T23:17:28.232 INFO:teuthology.orchestra.run.smithi084.stdout:variety of kernel formats, file systems, computer architectures and 2020-04-02T23:17:28.232 INFO:teuthology.orchestra.run.smithi084.stdout:hardware devices. 2020-04-02T23:17:28.232 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:17:28.232 INFO:teuthology.orchestra.run.smithi084.stdout:This subpackage provides tools for support of all platforms. 2020-04-02T23:17:28.233 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-04-02T23:17:28.233 INFO:teuthology.task.kernel:Updating grub on smithi084 to boot 4.18.0-147.el8.x86_64 2020-04-02T23:17:28.233 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:17:28.288 INFO:teuthology.orchestra.run.smithi084:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-04-02T23:17:29.563 INFO:teuthology.orchestra.run.smithi084.stderr:Generating grub configuration file ... 2020-04-02T23:17:31.885 INFO:teuthology.orchestra.run.smithi084.stderr:done 2020-04-02T23:17:31.887 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:17:31.900 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-02T23:17:31.954 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.qhHdwrEPZH 2020-04-02T23:17:31.954 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:17:32.007 INFO:teuthology.orchestra.run.smithi084:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qhHdwrEPZH 2020-04-02T23:17:32.082 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:17:32.135 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.qhHdwrEPZH 2020-04-02T23:17:32.270 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.qhHdwrEPZH is 4KB 2020-04-02T23:17:32.320 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:17:32.333 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.qhHdwrEPZH 2020-04-02T23:17:32.385 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:17:32.438 INFO:teuthology.orchestra.run.smithi084:> sudo /bin/ls /boot/loader/entries || true 2020-04-02T23:17:32.524 INFO:teuthology.orchestra.run.smithi084.stdout:ac76e1f739a34903a61708b8315bf038-0-rescue.conf 2020-04-02T23:17:32.524 INFO:teuthology.orchestra.run.smithi084.stdout:ac76e1f739a34903a61708b8315bf038-4.18.0-147.5.1.el8_1.x86_64.conf 2020-04-02T23:17:32.524 INFO:teuthology.orchestra.run.smithi084.stdout:ac76e1f739a34903a61708b8315bf038-4.18.0-147.el8.x86_64.conf 2020-04-02T23:17:32.525 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:17:32.538 INFO:teuthology.orchestra.run.smithi084:> sudo grub2-set-default ac76e1f739a34903a61708b8315bf038-4.18.0-147.el8.x86_64 2020-04-02T23:17:32.690 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:17:32.703 INFO:teuthology.orchestra.run.smithi084:> sudo shutdown -r now 2020-04-02T23:18:02.783 INFO:teuthology.misc:Re-opening connections... 2020-04-02T23:18:02.783 INFO:teuthology.misc:trying to connect to ubuntu@smithi084.front.sepia.ceph.com 2020-04-02T23:18:02.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:18:02.783 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:18:21.141 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2020-04-02T23:18:21.141 INFO:teuthology.misc:trying to connect to ubuntu@smithi042.front.sepia.ceph.com 2020-04-02T23:18:21.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:18:21.142 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:18:55.701 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.42 2020-04-02T23:18:55.701 DEBUG:teuthology.misc:waited 52.9181771278 2020-04-02T23:18:56.702 INFO:teuthology.misc:trying to connect to ubuntu@smithi084.front.sepia.ceph.com 2020-04-02T23:18:56.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:18:56.703 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:19:28.545 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:19:28.887 DEBUG:teuthology.misc:waited 86.1041941643 2020-04-02T23:19:29.888 INFO:teuthology.misc:trying to connect to ubuntu@smithi042.front.sepia.ceph.com 2020-04-02T23:19:29.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:19:29.888 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:19:30.189 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:19:30.491 DEBUG:teuthology.misc:waited 87.7079892159 2020-04-02T23:19:31.492 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2020-04-02T23:19:31.492 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-147.el8.x86_64"... 2020-04-02T23:19:31.493 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:19:31.509 INFO:teuthology.orchestra.run.smithi042:> uname -r 2020-04-02T23:19:31.567 INFO:teuthology.orchestra.run.smithi042.stdout:4.18.0-147.el8.x86_64 2020-04-02T23:19:31.567 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-147.el8.x86_64 vs 4.18.0-147.el8.x86_64 2020-04-02T23:19:31.567 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-04-02T23:19:31.568 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2020-04-02T23:19:31.568 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-147.el8.x86_64"... 2020-04-02T23:19:31.568 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:19:31.587 INFO:teuthology.orchestra.run.smithi084:> uname -r 2020-04-02T23:19:31.641 INFO:teuthology.orchestra.run.smithi084.stdout:4.18.0-147.el8.x86_64 2020-04-02T23:19:31.642 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-147.el8.x86_64 vs 4.18.0-147.el8.x86_64 2020-04-02T23:19:31.642 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-04-02T23:19:32.642 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-04-02T23:19:32.643 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:19:32.659 INFO:teuthology.orchestra.run.smithi042:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-04-02T23:19:32.785 INFO:teuthology.orchestra.run.smithi042.stdout:ttyS1 2020-04-02T23:19:32.797 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-04-02T23:19:32.798 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:19:33.050 INFO:teuthology.orchestra.run.smithi084:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-04-02T23:19:33.743 INFO:teuthology.orchestra.run.smithi084.stdout:ttyS1 2020-04-02T23:19:33.784 INFO:teuthology.run_tasks:Running task internal.base... 2020-04-02T23:19:33.795 INFO:teuthology.task.internal:Creating test directory... 2020-04-02T23:19:33.795 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:19:33.812 INFO:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-04-02T23:19:33.854 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:19:33.871 INFO:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-04-02T23:19:33.980 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-04-02T23:19:33.991 INFO:teuthology.run_tasks:Running task internal.archive... 2020-04-02T23:19:33.999 INFO:teuthology.task.internal:Creating archive directory... 2020-04-02T23:19:33.999 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:19:34.016 INFO:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-04-02T23:19:34.058 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:19:34.109 INFO:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-04-02T23:19:34.196 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-04-02T23:19:34.208 INFO:teuthology.task.internal:Enabling coredump saving... 2020-04-02T23:19:34.209 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:19:34.226 INFO:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-04-02T23:19:34.268 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:19:34.285 INFO:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-04-02T23:19:34.303 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-02T23:19:34.322 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-02T23:19:34.379 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-02T23:19:34.397 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-02T23:19:34.398 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-04-02T23:19:34.412 INFO:teuthology.task.internal:Configuring sudo... 2020-04-02T23:19:34.415 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:19:34.432 INFO:teuthology.orchestra.run.smithi042:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-04-02T23:19:34.474 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:19:34.487 INFO:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-04-02T23:19:34.555 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-04-02T23:19:34.566 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-04-02T23:19:34.567 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:19:34.583 INFO:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-04-02T23:19:34.625 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:19:34.642 INFO:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-04-02T23:19:34.696 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:19:34.749 INFO:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-02T23:19:34.821 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:19:34.858 INFO:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-02T23:19:35.012 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:19:35.025 INFO:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-02T23:19:35.099 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:19:35.134 INFO:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-02T23:19:35.201 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:19:35.254 INFO:teuthology.orchestra.run.smithi084:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-04-02T23:19:35.342 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:19:35.359 INFO:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-02T23:19:35.438 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:19:35.474 INFO:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-02T23:19:35.563 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:19:35.579 INFO:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-02T23:19:35.652 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:19:35.692 INFO:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-02T23:19:35.765 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:19:35.820 INFO:teuthology.orchestra.run.smithi042:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-04-02T23:19:35.907 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:19:35.966 INFO:teuthology.orchestra.run.smithi042:> sudo service rsyslog restart 2020-04-02T23:19:36.008 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:19:36.023 INFO:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2020-04-02T23:19:36.076 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-04-02T23:19:36.147 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-04-02T23:19:36.554 INFO:teuthology.run_tasks:Running task internal.timer... 2020-04-02T23:19:36.571 INFO:teuthology.task.internal:Starting timer... 2020-04-02T23:19:36.571 INFO:teuthology.run_tasks:Running task pcp... 2020-04-02T23:19:36.613 INFO:teuthology.run_tasks:Running task selinux... 2020-04-02T23:19:36.627 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-04-02T23:19:36.627 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:19:36.642 INFO:teuthology.orchestra.run.smithi042:> sudo service auditd rotate 2020-04-02T23:19:36.793 INFO:teuthology.orchestra.run.smithi042.stdout:Rotating logs: [ OK ] 2020-04-02T23:19:36.795 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:19:36.809 INFO:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2020-04-02T23:19:36.910 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: [ OK ] 2020-04-02T23:19:36.912 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-04-02T23:19:36.912 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:19:36.926 INFO:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2020-04-02T23:19:36.989 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2020-04-02T23:19:36.989 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:19:37.004 INFO:teuthology.orchestra.run.smithi042:> /usr/sbin/getenforce 2020-04-02T23:19:37.066 INFO:teuthology.orchestra.run.smithi042.stdout:Permissive 2020-04-02T23:19:37.067 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi084.front.sepia.ceph.com': u'permissive', 'ubuntu@smithi042.front.sepia.ceph.com': u'permissive'} 2020-04-02T23:19:37.067 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:19:37.081 INFO:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-04-02T23:19:37.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-02T23:19:37.152 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:19:37.172 INFO:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-04-02T23:19:37.243 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-02T23:19:37.244 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-04-02T23:19:37.244 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:19:37.260 INFO:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2020-04-02T23:19:37.328 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:19:37.342 INFO:teuthology.orchestra.run.smithi042:> sudo /usr/sbin/setenforce permissive 2020-04-02T23:19:37.414 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-04-02T23:19:37.424 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-04-02T23:19:37.424 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-04-02T23:19:37.441 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-04-02T23:19:37.443 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi084.front.sepia.ceph.com,smithi042.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-04-02T23:19:37.826 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-04-02T23:19:39.071 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-04-02T23:19:42.001 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-04-02T23:19:42.022 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:42 +0000 (0:00:00.059) 0:00:00.059 ******** 2020-04-02T23:19:42.034 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:42 +0000 (0:00:00.011) 0:00:00.071 ******** 2020-04-02T23:19:44.631 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-04-02T23:19:44.632 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] 2020-04-02T23:19:44.720 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:44 +0000 (0:00:02.686) 0:00:02.758 ******** 2020-04-02T23:19:45.057 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-04-02T23:19:45.059 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-02T23:19:45.093 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:45 +0000 (0:00:00.372) 0:00:03.131 ******** 2020-04-02T23:19:45.620 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi084.front.sepia.ceph.com] 2020-04-02T23:19:45.698 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:45 +0000 (0:00:00.604) 0:00:03.735 ******** 2020-04-02T23:19:45.716 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-04-02T23:19:45.717 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-04-02T23:19:45.756 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:45 +0000 (0:00:00.058) 0:00:03.793 ******** 2020-04-02T23:19:45.782 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-04-02T23:19:45.784 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:45.819 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:45 +0000 (0:00:00.062) 0:00:03.856 ******** 2020-04-02T23:19:45.899 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-04-02T23:19:45.900 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-02T23:19:45.936 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:45 +0000 (0:00:00.117) 0:00:03.974 ******** 2020-04-02T23:19:46.157 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-04-02T23:19:46.160 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:19:46.220 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:46 +0000 (0:00:00.283) 0:00:04.257 ******** 2020-04-02T23:19:46.226 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-04-02T23:19:46.227 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-04-02T23:19:46.267 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:46 +0000 (0:00:00.046) 0:00:04.304 ******** 2020-04-02T23:19:46.291 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-04-02T23:19:46.293 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:46.327 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:46 +0000 (0:00:00.060) 0:00:04.365 ******** 2020-04-02T23:19:46.523 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi084.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:19:46.550 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:46 +0000 (0:00:00.222) 0:00:04.587 ******** 2020-04-02T23:19:47.211 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-04-02T23:19:47.213 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1585869586.23-137246197559714/source", "state": "file", "uid": 0} changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1585869586.57-25325318708936/source", "state": "file", "uid": 0} 2020-04-02T23:19:47.251 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:47 +0000 (0:00:00.701) 0:00:05.288 ******** 2020-04-02T23:19:47.295 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:47 +0000 (0:00:00.044) 0:00:05.332 ******** 2020-04-02T23:19:47.813 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-04-02T23:19:47.814 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-04-02T23:19:47.815 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-04-02T23:19:47.853 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-04-02T23:19:47.855 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-04-02T23:19:47.973 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-04-02T23:19:47.978 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-04-02T23:19:48.162 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:48 +0000 (0:00:00.866) 0:00:06.199 ******** 2020-04-02T23:19:48.196 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:48 +0000 (0:00:00.034) 0:00:06.233 ******** 2020-04-02T23:19:48.831 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi042.front.sepia.ceph.com] 2020-04-02T23:19:48.897 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] 2020-04-02T23:19:48.943 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-04-02T23:19:48.944 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:48 +0000 (0:00:00.746) 0:00:06.980 ******** 2020-04-02T23:19:49.024 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:49 +0000 (0:00:00.080) 0:00:07.061 ******** 2020-04-02T23:19:49.595 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-04-02T23:19:49.597 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.242509", "end": "2020-04-02 23:19:49.568584", "rc": 0, "start": "2020-04-02 23:19:49.326075", "stderr": "", "stderr_lines": [], "stdout": "02eae6d5814ccf641ed00343442d83bf2a286582", "stdout_lines": ["02eae6d5814ccf641ed00343442d83bf2a286582"]} 2020-04-02T23:19:49.634 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:49 +0000 (0:00:00.609) 0:00:07.671 ******** 2020-04-02T23:19:49.640 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.223382", "end": "2020-04-02 23:19:49.597326", "rc": 0, "start": "2020-04-02 23:19:49.373944", "stderr": "", "stderr_lines": [], "stdout": "02eae6d5814ccf641ed00343442d83bf2a286582", "stdout_lines": ["02eae6d5814ccf641ed00343442d83bf2a286582"]} 2020-04-02T23:19:49.678 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:49 +0000 (0:00:00.044) 0:00:07.716 ******** 2020-04-02T23:19:49.882 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013928", "end": "2020-04-02 23:19:49.843472", "failed_when_result": false, "rc": 0, "start": "2020-04-02 23:19:49.829544", "stderr": "", "stderr_lines": [], "stdout": "02eae6d5814ccf641ed00343442d83bf2a286582", "stdout_lines": ["02eae6d5814ccf641ed00343442d83bf2a286582"]} 2020-04-02T23:19:49.916 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:49 +0000 (0:00:00.237) 0:00:07.953 ******** 2020-04-02T23:19:49.922 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013466", "end": "2020-04-02 23:19:49.875681", "failed_when_result": false, "rc": 0, "start": "2020-04-02 23:19:49.862215", "stderr": "", "stderr_lines": [], "stdout": "02eae6d5814ccf641ed00343442d83bf2a286582", "stdout_lines": ["02eae6d5814ccf641ed00343442d83bf2a286582"]} 2020-04-02T23:19:49.967 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:49 +0000 (0:00:00.045) 0:00:07.999 ******** 2020-04-02T23:19:49.968 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-04-02T23:19:49.969 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-04-02T23:19:50.010 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:50 +0000 (0:00:00.047) 0:00:08.047 ******** 2020-04-02T23:19:50.017 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-04-02T23:19:50.055 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:50 +0000 (0:00:00.045) 0:00:08.093 ******** 2020-04-02T23:19:50.060 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-04-02T23:19:50.061 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.100 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:50 +0000 (0:00:00.044) 0:00:08.137 ******** 2020-04-02T23:19:50.105 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.144 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:50 +0000 (0:00:00.043) 0:00:08.181 ******** 2020-04-02T23:19:50.149 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-04-02T23:19:50.149 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.188 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:50 +0000 (0:00:00.044) 0:00:08.226 ******** 2020-04-02T23:19:50.196 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.234 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:50 +0000 (0:00:00.045) 0:00:08.271 ******** 2020-04-02T23:19:50.239 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-04-02T23:19:50.240 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.279 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:50 +0000 (0:00:00.045) 0:00:08.317 ******** 2020-04-02T23:19:50.285 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.324 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:50 +0000 (0:00:00.044) 0:00:08.361 ******** 2020-04-02T23:19:50.329 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-04-02T23:19:50.329 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.367 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:50 +0000 (0:00:00.043) 0:00:08.404 ******** 2020-04-02T23:19:50.373 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.412 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:50 +0000 (0:00:00.044) 0:00:08.449 ******** 2020-04-02T23:19:50.418 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-04-02T23:19:50.420 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.455 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:50 +0000 (0:00:00.043) 0:00:08.493 ******** 2020-04-02T23:19:50.461 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.502 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:50 +0000 (0:00:00.046) 0:00:08.540 ******** 2020-04-02T23:19:50.508 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-02T23:19:50.508 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.511 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.521 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.522 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.533 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.545 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.546 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.547 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.568 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.580 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.590 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.594 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgR 2020-04-02T23:19:50.596 INFO:teuthology.task.ansible.out:HblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item" 2020-04-02T23:19:50.597 INFO:teuthology.task.ansible.out:, "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8 2020-04-02T23:19:50.598 INFO:teuthology.task.ansible.out:ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "cha 2020-04-02T23:19:50.600 INFO:teuthology.task.ansible.out:nged": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.607 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.608 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.609 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.619 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.620 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.621 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.621 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0 2020-04-02T23:19:50.623 INFO:teuthology.task.ansible.out:pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.633 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.644 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.644 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.646 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.647 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.649 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.658 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.659 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.660 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.672 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.672 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.674 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.674 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.685 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.686 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.687 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.688 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.699 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.700 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.701 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.723 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.724 INFO:teuthology.task.ansible.out: 2020-04-02T23:19:50.725 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.727 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.728 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.729 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.730 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.731 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.741 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.747 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.754 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.755 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.756 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.757 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.768 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.770 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.771 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.772 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.783 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.784 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.785 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.796 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.797 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.801 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.807 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.808 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.809 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.820 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.821 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.822 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.833 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.833 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.835 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.845 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.846 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.847 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.857 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.858 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.860 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.871 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.872 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.874 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.874 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.875 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.886 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.886 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.888 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.889 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.900 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.901 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.902 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.913 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.913 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.914 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.924 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.925 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.926 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.927 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.928 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.938 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.939 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.940 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.950 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.951 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.952 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.962 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.963 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.963 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.965 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.978 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.979 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.980 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.981 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.983 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.993 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:50.993 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.001 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.001 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.003 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.013 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.014 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.015 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.016 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.017 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.027 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.027 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.029 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.039 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.039 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.041 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.041 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.042 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.053 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.053 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.055 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.055 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.066 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.066 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.068 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.078 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.078 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.079 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.081 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.091 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.092 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.093 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.104 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.105 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.106 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.117 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.118 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.119 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.129 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.130 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.131 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.131 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.142 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.143 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.145 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.155 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.156 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.157 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.168 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.168 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.170 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.181 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.181 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.183 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.184 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.194 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.194 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.196 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.197 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.207 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.208 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.209 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.221 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.222 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.239 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.291 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:51 +0000 (0:00:00.788) 0:00:09.328 ******** 2020-04-02T23:19:51.326 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:51 +0000 (0:00:00.034) 0:00:09.363 ******** 2020-04-02T23:19:51.331 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-04-02T23:19:51.372 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:51 +0000 (0:00:00.046) 0:00:09.410 ******** 2020-04-02T23:19:51.416 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:51 +0000 (0:00:00.044) 0:00:09.454 ******** 2020-04-02T23:19:51.421 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-04-02T23:19:51.425 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.464 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:51 +0000 (0:00:00.047) 0:00:09.501 ******** 2020-04-02T23:19:51.470 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.512 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:51 +0000 (0:00:00.048) 0:00:09.549 ******** 2020-04-02T23:19:51.517 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-04-02T23:19:51.518 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.557 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:51 +0000 (0:00:00.045) 0:00:09.595 ******** 2020-04-02T23:19:51.563 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.601 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:51 +0000 (0:00:00.043) 0:00:09.639 ******** 2020-04-02T23:19:51.607 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-04-02T23:19:51.608 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.647 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:51 +0000 (0:00:00.045) 0:00:09.684 ******** 2020-04-02T23:19:51.655 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.693 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:51 +0000 (0:00:00.046) 0:00:09.731 ******** 2020-04-02T23:19:51.699 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-04-02T23:19:51.699 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.737 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:51 +0000 (0:00:00.043) 0:00:09.774 ******** 2020-04-02T23:19:51.745 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.782 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:51 +0000 (0:00:00.045) 0:00:09.819 ******** 2020-04-02T23:19:51.787 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-04-02T23:19:51.789 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.826 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:51 +0000 (0:00:00.044) 0:00:09.864 ******** 2020-04-02T23:19:51.832 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.876 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:51 +0000 (0:00:00.050) 0:00:09.914 ******** 2020-04-02T23:19:51.882 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-02T23:19:51.883 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.884 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.886 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.896 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.907 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.908 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.909 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.910 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.920 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.921 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.923 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.934 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.934 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.936 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.946 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.947 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.957 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.958 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.959 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.971 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.982 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.984 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.985 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.988 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.989 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.991 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:51.992 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.003 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.003 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.014 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.014 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.016 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.031 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.032 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.033 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.037 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.038 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.041 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.042 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.042 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.044 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.045 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.047 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.056 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.057 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.058 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.070 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.071 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.072 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.083 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.083 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.085 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.097 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.107 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.111 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.120 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.121 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.121 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.122 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.138 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.138 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.139 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.182 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:52 +0000 (0:00:00.305) 0:00:10.219 ******** 2020-04-02T23:19:52.189 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-04-02T23:19:52.235 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:52 +0000 (0:00:00.053) 0:00:10.273 ******** 2020-04-02T23:19:52.945 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-04-02T23:19:52.945 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "1292e3b894a02d49ff85362f40c4ffb36408b41f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-04-02T23:19:52.986 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:52 +0000 (0:00:00.747) 0:00:11.021 ******** 2020-04-02T23:19:52.991 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "1292e3b894a02d49ff85362f40c4ffb36408b41f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-04-02T23:19:53.030 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:53 +0000 (0:00:00.046) 0:00:11.067 ******** 2020-04-02T23:19:53.036 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-04-02T23:19:53.037 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => { "msg": "Host smithi084.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-04-02T23:19:53.085 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:53 +0000 (0:00:00.055) 0:00:11.123 ******** 2020-04-02T23:19:53.090 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => { "msg": "Host smithi042.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-04-02T23:19:53.142 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:53 +0000 (0:00:00.056) 0:00:11.180 ******** 2020-04-02T23:19:53.149 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-04-02T23:19:53.149 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-04-02T23:19:53.192 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:53 +0000 (0:00:00.049) 0:00:11.229 ******** 2020-04-02T23:19:53.199 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-04-02T23:19:53.246 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:53 +0000 (0:00:00.053) 0:00:11.283 ******** 2020-04-02T23:19:53.251 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-04-02T23:19:53.252 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:53.293 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:53 +0000 (0:00:00.047) 0:00:11.330 ******** 2020-04-02T23:19:53.299 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:53.337 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:53 +0000 (0:00:00.044) 0:00:11.375 ******** 2020-04-02T23:19:53.563 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-04-02T23:19:53.564 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.074403", "end": "2020-04-02 23:19:53.540676", "rc": 0, "start": "2020-04-02 23:19:53.466273", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-04-02T23:19:53.602 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:53 +0000 (0:00:00.263) 0:00:11.638 ******** 2020-04-02T23:19:53.633 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.075573", "end": "2020-04-02 23:19:53.604131", "rc": 0, "start": "2020-04-02 23:19:53.528558", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-04-02T23:19:53.634 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-04-02T23:19:53.634 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:53.673 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:53 +0000 (0:00:00.071) 0:00:11.710 ******** 2020-04-02T23:19:53.717 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:53 +0000 (0:00:00.039) 0:00:11.750 ******** 2020-04-02T23:19:53.720 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:53.784 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:53 +0000 (0:00:00.071) 0:00:11.821 ******** 2020-04-02T23:19:53.791 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:53.827 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:53 +0000 (0:00:00.043) 0:00:11.864 ******** 2020-04-02T23:19:53.834 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:53.871 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:53 +0000 (0:00:00.043) 0:00:11.908 ******** 2020-04-02T23:19:53.876 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-04-02T23:19:53.878 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:53.914 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:53 +0000 (0:00:00.043) 0:00:11.952 ******** 2020-04-02T23:19:53.919 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:53.960 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:53 +0000 (0:00:00.045) 0:00:11.998 ******** 2020-04-02T23:19:53.966 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-04-02T23:19:53.967 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:54.005 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.044) 0:00:12.043 ******** 2020-04-02T23:19:54.010 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:54.048 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.042) 0:00:12.085 ******** 2020-04-02T23:19:54.054 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-04-02T23:19:54.056 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:54.091 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.042) 0:00:12.128 ******** 2020-04-02T23:19:54.096 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:54.141 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.049) 0:00:12.178 ******** 2020-04-02T23:19:54.147 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-04-02T23:19:54.148 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:54.193 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.052) 0:00:12.231 ******** 2020-04-02T23:19:54.198 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:54.241 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.047) 0:00:12.278 ******** 2020-04-02T23:19:54.245 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-04-02T23:19:54.246 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:19:54.247 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:19:54.293 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.052) 0:00:12.330 ******** 2020-04-02T23:19:54.298 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:19:54.298 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:19:54.338 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.045) 0:00:12.376 ******** 2020-04-02T23:19:54.343 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-04-02T23:19:54.344 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:54.393 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.054) 0:00:12.430 ******** 2020-04-02T23:19:54.398 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:54.436 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.043) 0:00:12.473 ******** 2020-04-02T23:19:54.441 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-04-02T23:19:54.443 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:54.483 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.047) 0:00:12.521 ******** 2020-04-02T23:19:54.489 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:54.529 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.045) 0:00:12.566 ******** 2020-04-02T23:19:54.534 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi084.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:19:54.583 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.053) 0:00:12.620 ******** 2020-04-02T23:19:54.593 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:19:54.628 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.044) 0:00:12.665 ******** 2020-04-02T23:19:54.632 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-04-02T23:19:54.634 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:54.671 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.043) 0:00:12.708 ******** 2020-04-02T23:19:54.676 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:54.714 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.043) 0:00:12.752 ******** 2020-04-02T23:19:54.720 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-04-02T23:19:54.721 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:19:54.760 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.045) 0:00:12.797 ******** 2020-04-02T23:19:54.765 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:19:54.807 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.045) 0:00:12.842 ******** 2020-04-02T23:19:54.816 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:54.856 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.051) 0:00:12.893 ******** 2020-04-02T23:19:54.861 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:54.904 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.048) 0:00:12.942 ******** 2020-04-02T23:19:54.913 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-04-02T23:19:54.914 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:54.965 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.049) 0:00:12.991 ******** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:54.999 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:54 +0000 (0:00:00.045) 0:00:13.036 ******** 2020-04-02T23:19:55.005 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-04-02T23:19:55.006 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:55.048 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.049) 0:00:13.086 ******** 2020-04-02T23:19:55.053 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:55.093 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.044) 0:00:13.131 ******** 2020-04-02T23:19:55.098 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-04-02T23:19:55.100 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:55.141 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.047) 0:00:13.178 ******** 2020-04-02T23:19:55.146 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:55.193 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.052) 0:00:13.230 ******** 2020-04-02T23:19:55.199 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-04-02T23:19:55.200 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:19:55.238 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.044) 0:00:13.275 ******** 2020-04-02T23:19:55.243 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:19:55.283 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.045) 0:00:13.320 ******** 2020-04-02T23:19:55.288 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-02T23:19:55.289 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:55.328 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.044) 0:00:13.365 ******** 2020-04-02T23:19:55.335 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:55.375 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.046) 0:00:13.412 ******** 2020-04-02T23:19:55.380 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-04-02T23:19:55.382 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:55.428 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.053) 0:00:13.465 ******** 2020-04-02T23:19:55.433 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:55.474 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.046) 0:00:13.512 ******** 2020-04-02T23:19:55.479 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-04-02T23:19:55.481 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:55.520 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.045) 0:00:13.557 ******** 2020-04-02T23:19:55.526 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:55.564 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.044) 0:00:13.601 ******** 2020-04-02T23:19:55.577 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-04-02T23:19:55.579 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:55.615 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.051) 0:00:13.652 ******** 2020-04-02T23:19:55.620 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:55.659 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.044) 0:00:13.697 ******** 2020-04-02T23:19:55.665 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-04-02T23:19:55.666 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:55.704 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.045) 0:00:13.742 ******** 2020-04-02T23:19:55.710 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:55.754 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.049) 0:00:13.792 ******** 2020-04-02T23:19:55.761 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:55.804 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.049) 0:00:13.841 ******** 2020-04-02T23:19:55.812 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:55.849 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.044) 0:00:13.886 ******** 2020-04-02T23:19:55.855 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi084.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:19:55.893 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.044) 0:00:13.931 ******** 2020-04-02T23:19:55.899 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-02T23:19:55.938 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.045) 0:00:13.976 ******** 2020-04-02T23:19:55.945 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-04-02T23:19:55.984 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:55 +0000 (0:00:00.045) 0:00:14.021 ******** 2020-04-02T23:19:56.027 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:56 +0000 (0:00:00.043) 0:00:14.065 ******** 2020-04-02T23:19:56.034 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-04-02T23:19:56.037 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:56.074 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:56 +0000 (0:00:00.046) 0:00:14.111 ******** 2020-04-02T23:19:56.080 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:56.119 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:56 +0000 (0:00:00.045) 0:00:14.157 ******** 2020-04-02T23:19:56.315 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-04-02T23:19:56.317 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:19:56.372 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:56 +0000 (0:00:00.252) 0:00:14.409 ******** 2020-04-02T23:19:56.380 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:19:56.425 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:56 +0000 (0:00:00.049) 0:00:14.459 ******** 2020-04-02T23:19:56.868 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-04-02T23:19:56.869 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-04-02T23:19:56.943 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-04-02T23:19:57.331 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'enabled': 0, u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-04-02T23:19:57.381 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:57 +0000 (0:00:00.959) 0:00:15.418 ******** 2020-04-02T23:19:57.420 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'enabled': 0, u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-04-02T23:19:57.477 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:57 +0000 (0:00:00.084) 0:00:15.503 ******** 2020-04-02T23:19:57.921 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi084.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-04-02T23:19:58.003 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-04-02T23:19:58.385 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-04-02T23:19:58.432 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:58 +0000 (0:00:00.966) 0:00:16.470 ******** 2020-04-02T23:19:58.476 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:58.510 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:58 +0000 (0:00:00.077) 0:00:16.547 ******** 2020-04-02T23:19:58.516 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-04-02T23:19:58.518 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-04-02T23:19:58.561 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:58 +0000 (0:00:00.050) 0:00:16.598 ******** 2020-04-02T23:19:58.566 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-02T23:19:58.568 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:58.609 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:58 +0000 (0:00:00.047) 0:00:16.646 ******** 2020-04-02T23:19:58.618 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-02T23:19:58.619 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:58.677 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:58 +0000 (0:00:00.054) 0:00:16.700 ******** TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:58.717 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:58 +0000 (0:00:00.045) 0:00:16.746 ******** TASK [common : Get the current timezone] *************************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:58.752 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:58 +0000 (0:00:00.043) 0:00:16.789 ******** 2020-04-02T23:19:58.757 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-04-02T23:19:58.760 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:58.798 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:58 +0000 (0:00:00.045) 0:00:16.835 ******** 2020-04-02T23:19:58.803 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-04-02T23:19:58.805 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:58.851 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:58 +0000 (0:00:00.053) 0:00:16.888 ******** 2020-04-02T23:19:58.857 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:58.898 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:58 +0000 (0:00:00.046) 0:00:16.935 ******** 2020-04-02T23:19:58.906 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:58.946 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:58 +0000 (0:00:00.048) 0:00:16.984 ******** 2020-04-02T23:19:58.952 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-04-02T23:19:58.953 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:58.990 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:58 +0000 (0:00:00.043) 0:00:17.027 ******** 2020-04-02T23:19:59.002 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-02T23:19:59.004 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:59.054 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:59 +0000 (0:00:00.063) 0:00:17.091 ******** 2020-04-02T23:19:59.059 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-04-02T23:19:59.059 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:59.097 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:59 +0000 (0:00:00.043) 0:00:17.134 ******** 2020-04-02T23:19:59.102 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-04-02T23:19:59.104 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:59.239 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:59 +0000 (0:00:00.140) 0:00:17.275 ******** 2020-04-02T23:19:59.253 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-04-02T23:19:59.255 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:59.291 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:59 +0000 (0:00:00.053) 0:00:17.328 ******** 2020-04-02T23:19:59.296 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-04-02T23:19:59.296 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:59.336 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:59 +0000 (0:00:00.045) 0:00:17.374 ******** 2020-04-02T23:19:59.342 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-04-02T23:19:59.343 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:59.380 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:59 +0000 (0:00:00.043) 0:00:17.417 ******** 2020-04-02T23:19:59.385 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-04-02T23:19:59.385 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:59.423 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:59 +0000 (0:00:00.043) 0:00:17.461 ******** 2020-04-02T23:19:59.463 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-04-02T23:19:59.465 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:19:59.513 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:19:59 +0000 (0:00:00.090) 0:00:17.551 ******** 2020-04-02T23:20:00.525 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.927547", "end": "2020-04-02 23:20:00.500321", "rc": 0, "start": "2020-04-02 23:19:59.572774", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:20:00.528 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.797671", "end": "2020-04-02 23:20:00.500364", "rc": 0, "start": "2020-04-02 23:19:59.702693", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:20:00.579 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:00 +0000 (0:00:01.065) 0:00:18.616 ******** 2020-04-02T23:20:00.618 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:00 +0000 (0:00:00.039) 0:00:18.656 ******** 2020-04-02T23:20:03.721 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-04-02T23:20:03.724 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-04-02T23:20:03.764 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:03 +0000 (0:00:03.145) 0:00:21.801 ******** 2020-04-02T23:20:03.800 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:03 +0000 (0:00:00.035) 0:00:21.837 ******** 2020-04-02T23:20:03.805 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-04-02T23:20:03.807 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:20:03.845 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:03 +0000 (0:00:00.044) 0:00:21.882 ******** 2020-04-02T23:20:03.851 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:20:03.889 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:03 +0000 (0:00:00.044) 0:00:21.927 ******** 2020-04-02T23:20:03.895 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-04-02T23:20:03.895 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:20:03.932 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:03 +0000 (0:00:00.043) 0:00:21.970 ******** 2020-04-02T23:20:03.938 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:20:03.986 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:03 +0000 (0:00:00.053) 0:00:22.024 ******** 2020-04-02T23:20:03.991 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-04-02T23:20:03.992 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:20:04.030 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:04 +0000 (0:00:00.043) 0:00:22.067 ******** 2020-04-02T23:20:04.035 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:20:04.077 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:04 +0000 (0:00:00.047) 0:00:22.115 ******** 2020-04-02T23:20:04.082 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-04-02T23:20:04.083 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:20:04.121 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:04 +0000 (0:00:00.043) 0:00:22.158 ******** 2020-04-02T23:20:04.125 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:20:04.172 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:04 +0000 (0:00:00.051) 0:00:22.209 ******** 2020-04-02T23:20:04.620 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-04-02T23:20:04.622 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-04-02T23:20:04.663 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:04 +0000 (0:00:00.491) 0:00:22.701 ******** 2020-04-02T23:20:04.670 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-04-02T23:20:04.717 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:04 +0000 (0:00:00.052) 0:00:22.754 ******** 2020-04-02T23:20:05.610 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-04-02T23:20:05.651 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:05 +0000 (0:00:00.930) 0:00:23.685 ******** 2020-04-02T23:20:05.654 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-04-02T23:20:05.692 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:05 +0000 (0:00:00.044) 0:00:23.729 ******** 2020-04-02T23:20:06.137 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-04-02T23:20:06.138 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-04-02T23:20:06.208 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-04-02T23:20:06.602 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-04-02T23:20:06.703 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-04-02T23:20:07.037 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-04-02T23:20:07.077 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:07 +0000 (0:00:01.385) 0:00:25.114 ******** 2020-04-02T23:20:07.178 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-04-02T23:20:07.237 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:07 +0000 (0:00:00.160) 0:00:25.275 ******** 2020-04-02T23:20:07.274 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-04-02T23:20:07.275 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:20:07.313 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:07 +0000 (0:00:00.075) 0:00:25.350 ******** 2020-04-02T23:20:07.451 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:20:07.502 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:07 +0000 (0:00:00.189) 0:00:25.540 ******** 2020-04-02T23:20:07.821 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi084.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-04-02T23:20:07.990 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-04-02T23:20:08.275 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-04-02T23:20:08.463 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-04-02T23:20:08.710 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-04-02T23:20:08.758 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:08 +0000 (0:00:01.255) 0:00:26.795 ******** 2020-04-02T23:20:08.798 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-04-02T23:20:08.799 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:20:08.848 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:08 +0000 (0:00:00.090) 0:00:26.886 ******** 2020-04-02T23:20:08.893 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-04-02T23:20:08.894 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-04-02T23:20:08.952 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:08 +0000 (0:00:00.103) 0:00:26.989 ******** 2020-04-02T23:20:08.957 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-04-02T23:20:08.959 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-04-02T23:20:09.011 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:09 +0000 (0:00:00.059) 0:00:27.049 ******** 2020-04-02T23:20:09.047 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:20:09.086 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:09 +0000 (0:00:00.074) 0:00:27.123 ******** 2020-04-02T23:20:09.124 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-04-02T23:20:09.125 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-04-02T23:20:09.169 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:09 +0000 (0:00:00.083) 0:00:27.206 ******** 2020-04-02T23:20:09.178 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-04-02T23:20:09.179 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-02T23:20:09.236 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:09 +0000 (0:00:00.066) 0:00:27.273 ******** 2020-04-02T23:20:09.296 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:20:09.305 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:20:09.308 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:20:09.319 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:20:09.358 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:09 +0000 (0:00:00.121) 0:00:27.395 ******** 2020-04-02T23:20:09.385 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-04-02T23:20:09.385 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-02T23:20:09.422 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:09 +0000 (0:00:00.064) 0:00:27.460 ******** 2020-04-02T23:20:09.460 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-04-02T23:20:09.461 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:20:09.478 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:20:09.495 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-02T23:20:09.531 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:09 +0000 (0:00:00.109) 0:00:27.569 ******** 2020-04-02T23:20:10.253 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-04-02T23:20:10.292 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:10 +0000 (0:00:00.757) 0:00:28.326 ******** 2020-04-02T23:20:10.316 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-04-02T23:20:10.316 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:20:10.365 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:10 +0000 (0:00:00.073) 0:00:28.400 ******** 2020-04-02T23:20:10.514 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-04-02T23:20:10.515 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-04-02T23:20:10.580 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:10 +0000 (0:00:00.218) 0:00:28.618 ******** 2020-04-02T23:20:10.620 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:20:10.659 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:10 +0000 (0:00:00.078) 0:00:28.696 ******** 2020-04-02T23:20:10.832 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-04-02T23:20:10.871 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:10 +0000 (0:00:00.212) 0:00:28.909 ******** 2020-04-02T23:20:11.151 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-04-02T23:20:11.190 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:11 +0000 (0:00:00.318) 0:00:29.227 ******** 2020-04-02T23:20:11.358 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-04-02T23:20:11.359 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-04-02T23:20:11.395 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:11 +0000 (0:00:00.205) 0:00:29.432 ******** 2020-04-02T23:20:11.421 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-04-02T23:20:11.423 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:20:11.458 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:11 +0000 (0:00:00.063) 0:00:29.496 ******** 2020-04-02T23:20:11.675 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-04-02T23:20:11.677 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:20:11.714 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:11 +0000 (0:00:00.255) 0:00:29.751 ******** 2020-04-02T23:20:11.722 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-04-02T23:20:11.722 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-04-02T23:20:11.763 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:11 +0000 (0:00:00.048) 0:00:29.800 ******** 2020-04-02T23:20:11.799 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-04-02T23:20:11.800 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:20:11.837 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:11 +0000 (0:00:00.074) 0:00:29.874 ******** 2020-04-02T23:20:11.983 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-04-02T23:20:11.984 INFO:teuthology.task.ansible.out:fatal: [smithi084.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-04-02T23:20:12.022 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:12 +0000 (0:00:00.184) 0:00:30.059 ******** 2020-04-02T23:20:12.059 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-04-02T23:20:12.059 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:20:12.061 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi042.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:20:12.098 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:12 +0000 (0:00:00.076) 0:00:30.136 ******** 2020-04-02T23:20:12.132 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:12 +0000 (0:00:00.033) 0:00:30.169 ******** 2020-04-02T23:20:12.362 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-04-02T23:20:12.363 INFO:teuthology.task.ansible.out:fatal: [smithi042.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-04-02T23:20:12.400 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:12 +0000 (0:00:00.267) 0:00:30.437 ******** 2020-04-02T23:20:12.436 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-04-02T23:20:12.438 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:20:12.473 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:12 +0000 (0:00:00.073) 0:00:30.510 ******** 2020-04-02T23:20:12.636 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-04-02T23:20:12.639 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-04-02T23:20:12.675 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:12 +0000 (0:00:00.201) 0:00:30.712 ******** 2020-04-02T23:20:13.009 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-04-02T23:20:13.049 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:13 +0000 (0:00:00.373) 0:00:31.086 ******** 2020-04-02T23:20:13.453 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-04-02T23:20:13.455 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-04-02 23:19:19 UTC", "ActiveEnterTimestampMonotonic": "12565878", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount sysinit.target systemd-tmpfiles-setup.service system.slice basic.target nss-lookup.target tmp.mount local-fs.target var-run.mount network.target systemd-journald.socket time-sync.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-04-02 23:19:19 UTC", "AssertTimestampMonotonic": "12564823", "Before": "getty@tty1.service shutdown.target plymouth-quit.service xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-04-02 23:19:19 UTC", "ConditionTimestampMonotonic": "12564823", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-04-02T23:20:13.456 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2368", "ExecMainStartTimestamp": "Thu 2020-04-02 23:19:19 UTC", "ExecMainStartTimestampMonotonic": "12565852", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Thu 2020-04-02 23:19:19 UTC] ; stop_time=[n/a] ; pid=2368 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-04-02 23:19:19 UTC", "InactiveExitTimestampMonotonic": "12565878", "InvocationID": "adc9590a96af45179e9436371299767a", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-04-02T23:20:13.457 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127436", "LimitNPROCSoft": "127436", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127436", "LimitSIGPENDINGSoft": "127436", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2368", "MemoryAccounting": "yes", "MemoryCurrent": "1605632", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-04-02T23:20:13.459 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-04-02 23:19:19 UTC", "StateChangeTimestampMonotonic": "12565878", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-04-02 23:19:19 UTC", "WatchdogTimestampMonotonic": "12565877", "WatchdogUSec": "0"}} 2020-04-02T23:20:13.493 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:13 +0000 (0:00:00.443) 0:00:31.530 ******** 2020-04-02T23:20:13.502 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-04-02 23:19:00 UTC", "ActiveEnterTimestampMonotonic": "14631143", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount time-sync.target var-run.mount nss-lookup.target local-fs.target systemd-journald.socket sysinit.target system.slice systemd-tmpfiles-setup.service basic.target tmp.mount network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-04-02 23:19:00 UTC", "AssertTimestampMonotonic": "14630224", "Before": "shutdown.target getty@tty1.service plymouth-quit.service xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-04-02 23:19:00 UTC", "ConditionTimestampMonotonic": "14630224", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-04-02T23:20:13.504 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2381", "ExecMainStartTimestamp": "Thu 2020-04-02 23:19:00 UTC", "ExecMainStartTimestampMonotonic": "14631102", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Thu 2020-04-02 23:19:00 UTC] ; stop_time=[n/a] ; pid=2381 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-04-02 23:19:00 UTC", "InactiveExitTimestampMonotonic": "14631143", "InvocationID": "290501871412447c888bbf2c47c8aade", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-04-02T23:20:13.505 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127461", "LimitNPROCSoft": "127461", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127461", "LimitSIGPENDINGSoft": "127461", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2381", "MemoryAccounting": "yes", "MemoryCurrent": "1949696", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-04-02T23:20:13.506 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-04-02 23:19:00 UTC", "StateChangeTimestampMonotonic": "14631143", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-04-02 23:19:00 UTC", "WatchdogTimestampMonotonic": "14631142", "WatchdogUSec": "0"}} 2020-04-02T23:20:13.557 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:13 +0000 (0:00:00.064) 0:00:31.594 ******** 2020-04-02T23:20:13.689 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-04-02T23:20:13.689 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001758", "end": "2020-04-02 23:20:13.663099", "rc": 0, "start": "2020-04-02 23:20:13.661341", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-04-02T23:20:13.726 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:13 +0000 (0:00:00.169) 0:00:31.764 ******** 2020-04-02T23:20:13.795 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001715", "end": "2020-04-02 23:20:13.766723", "rc": 0, "start": "2020-04-02 23:20:13.765008", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-04-02T23:20:13.834 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:13 +0000 (0:00:00.107) 0:00:31.872 ******** 2020-04-02T23:20:14.634 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-04-02T23:20:14.635 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-04-02T23:20:14.672 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:14 +0000 (0:00:00.837) 0:00:32.709 ******** 2020-04-02T23:20:14.786 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-04-02T23:20:14.838 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:14 +0000 (0:00:00.166) 0:00:32.876 ******** 2020-04-02T23:20:15.583 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-04-02T23:20:15.629 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:15 +0000 (0:00:00.791) 0:00:33.667 ******** 2020-04-02T23:20:15.805 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-04-02T23:20:15.849 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:15 +0000 (0:00:00.216) 0:00:33.884 ******** 2020-04-02T23:20:16.901 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-04-02T23:20:16.903 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-04-02T23:20:16.947 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:16 +0000 (0:00:01.101) 0:00:34.985 ******** 2020-04-02T23:20:16.953 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-04-02T23:20:16.992 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:16 +0000 (0:00:00.044) 0:00:35.029 ******** 2020-04-02T23:20:33.483 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.269479", "end": "2020-04-02 23:20:33.455829", "failed_when_result": false, "rc": 0, "start": "2020-04-02 23:20:17.186350", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-04-02T23:20:33.520 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:33 +0000 (0:00:16.528) 0:00:51.558 ******** 2020-04-02T23:20:33.955 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.799505", "end": "2020-04-02 23:20:33.926902", "failed_when_result": false, "rc": 0, "start": "2020-04-02 23:20:17.127397", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-04-02T23:20:34.003 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:33 +0000 (0:00:00.482) 0:00:52.040 ******** 2020-04-02T23:20:34.042 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-04-02T23:20:34.043 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-04-02T23:20:34.091 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:34 +0000 (0:00:00.087) 0:00:52.129 ******** 2020-04-02T23:20:34.310 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.020528", "end": "2020-04-02 23:20:34.283892", "rc": 0, "start": "2020-04-02 23:20:34.263364", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:20:34.364 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:34 +0000 (0:00:00.272) 0:00:52.401 ******** 2020-04-02T23:20:34.508 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-04-02T23:20:34.509 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-04-02T23:20:34.589 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:34 +0000 (0:00:00.225) 0:00:52.627 ******** 2020-04-02T23:20:34.596 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-04-02T23:20:34.597 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002001", "end": "2020-04-02 23:20:34.538757", "rc": 0, "start": "2020-04-02 23:20:34.536756", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:20:34.638 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:34 +0000 (0:00:00.048) 0:00:52.676 ******** 2020-04-02T23:20:34.811 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-04-02T23:20:34.811 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.021059", "end": "2020-04-02 23:20:34.791984", "rc": 0, "start": "2020-04-02 23:20:34.770925", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:20:34.854 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:34 +0000 (0:00:00.215) 0:00:52.891 ******** 2020-04-02T23:20:35.058 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-04-02T23:20:35.058 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002095", "end": "2020-04-02 23:20:35.036836", "rc": 0, "start": "2020-04-02 23:20:35.034741", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:20:35.102 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:35 +0000 (0:00:00.248) 0:00:53.140 ******** 2020-04-02T23:20:50.940 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-04-02T23:20:50.942 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.096255", "end": "2020-04-02 23:20:50.916720", "rc": 0, "start": "2020-04-02 23:20:34.820465", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:20:50.978 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:50 +0000 (0:00:15.875) 0:01:09.015 ******** 2020-04-02T23:20:51.181 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-04-02T23:20:51.183 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-04-02T23:20:51.221 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:51 +0000 (0:00:00.242) 0:01:09.258 ******** 2020-04-02T23:20:51.247 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-04-02T23:20:51.247 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-04-02T23:20:51.290 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:51 +0000 (0:00:00.069) 0:01:09.328 ******** 2020-04-02T23:20:51.327 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-04-02T23:20:51.329 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-02T23:20:51.365 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:51 +0000 (0:00:00.074) 0:01:09.403 ******** 2020-04-02T23:20:51.415 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi084.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm- 2020-04-02T23:20:51.417 INFO:teuthology.task.ansible.out:ansible_master/roles/testnode/vars/centos_8.yml"} 2020-04-02T23:20:51.454 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:51 +0000 (0:00:00.089) 0:01:09.492 ******** 2020-04-02T23:20:51.501 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-04-02T23:20:51.502 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-02T23:20:51.551 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:51 +0000 (0:00:00.092) 0:01:09.585 ******** 2020-04-02T23:20:51.731 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-04-02T23:20:51.732 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-02T23:20:51.774 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:51 +0000 (0:00:00.226) 0:01:09.811 ******** 2020-04-02T23:20:51.935 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-04-02T23:20:51.936 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.629564", "end": "2020-04-02 23:20:51.915471", "rc": 0, "start": "2020-04-02 23:20:35.285907", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:20:51.981 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:51 +0000 (0:00:00.207) 0:01:10.018 ******** 2020-04-02T23:20:51.986 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-04-02T23:20:51.986 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 1212, "name": "ubuntu", "state": "present", "system": false} 2020-04-02T23:20:52.032 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:52 +0000 (0:00:00.049) 0:01:10.067 ******** 2020-04-02T23:20:52.058 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-04-02T23:20:52.060 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:20:52.096 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:52 +0000 (0:00:00.065) 0:01:10.133 ******** 2020-04-02T23:20:52.133 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:20:52.160 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:52 +0000 (0:00:00.064) 0:01:10.198 ******** 2020-04-02T23:20:52.209 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-04-02T23:20:52.210 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-04-02T23:20:52.257 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:52 +0000 (0:00:00.089) 0:01:10.287 ******** 2020-04-02T23:20:52.277 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-04-02T23:20:52.278 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-04-02T23:20:52.317 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:52 +0000 (0:00:00.066) 0:01:10.354 ******** 2020-04-02T23:20:52.354 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-04-02T23:20:52.367 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-02T23:20:52.411 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:52 +0000 (0:00:00.094) 0:01:10.449 ******** 2020-04-02T23:20:52.417 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-04-02T23:20:52.417 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-04-02T23:20:52.463 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:52 +0000 (0:00:00.051) 0:01:10.500 ******** 2020-04-02T23:20:52.468 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-04-02T23:20:52.469 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-04-02T23:20:52.510 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:52 +0000 (0:00:00.047) 0:01:10.547 ******** 2020-04-02T23:20:52.546 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-04-02T23:20:52.548 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-02T23:20:52.584 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:52 +0000 (0:00:00.074) 0:01:10.622 ******** 2020-04-02T23:20:52.796 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-04-02T23:20:52.797 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-02T23:20:52.841 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:52 +0000 (0:00:00.256) 0:01:10.879 ******** 2020-04-02T23:20:53.034 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-04-02T23:20:53.035 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-04-02T23:20:53.081 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:53 +0000 (0:00:00.240) 0:01:11.119 ******** 2020-04-02T23:20:53.087 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-04-02T23:20:53.093 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "gid": 1212, "name": "ubuntu", "state": "present", "system": false} 2020-04-02T23:20:53.134 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:53 +0000 (0:00:00.052) 0:01:11.171 ******** 2020-04-02T23:20:53.152 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi084"}, "changed": false} 2020-04-02T23:20:53.188 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:53 +0000 (0:00:00.054) 0:01:11.226 ******** 2020-04-02T23:20:53.196 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-04-02T23:20:53.198 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:20:53.234 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:53 +0000 (0:00:00.045) 0:01:11.271 ******** 2020-04-02T23:20:53.261 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-04-02T23:20:53.263 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:20:53.301 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:53 +0000 (0:00:00.064) 0:01:11.336 ******** 2020-04-02T23:20:53.529 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-04-02T23:20:53.530 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-04-02T23:20:53.570 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:53 +0000 (0:00:00.271) 0:01:11.608 ******** 2020-04-02T23:20:54.172 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-04-02T23:20:54.173 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-04-02T23:20:54.216 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:54 +0000 (0:00:00.645) 0:01:12.253 ******** 2020-04-02T23:20:54.223 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-04-02T23:20:54.224 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi084.front.sepia.ceph.com", "ansible_hostname": "smithi084", "ansible_nodename": "smithi084"}, "changed": true, "name": "smithi084"} 2020-04-02T23:20:54.280 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:54 +0000 (0:00:00.064) 0:01:12.317 ******** 2020-04-02T23:20:54.288 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-04-02T23:20:54.289 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi042"}, "changed": false} 2020-04-02T23:20:54.346 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:54 +0000 (0:00:00.066) 0:01:12.383 ******** 2020-04-02T23:20:54.761 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-04-02T23:20:54.802 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:54 +0000 (0:00:00.452) 0:01:12.836 ******** 2020-04-02T23:20:54.952 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-04-02T23:20:54.953 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi042.front.sepia.ceph.com", "ansible_hostname": "smithi042", "ansible_nodename": "smithi042"}, "changed": true, "name": "smithi042"} 2020-04-02T23:20:54.991 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:54 +0000 (0:00:00.192) 0:01:13.029 ******** 2020-04-02T23:20:55.279 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-04-02T23:20:55.279 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-04-02T23:20:55.333 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:55 +0000 (0:00:00.341) 0:01:13.370 ******** 2020-04-02T23:20:55.497 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-04-02T23:20:55.537 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:55 +0000 (0:00:00.204) 0:01:13.574 ******** 2020-04-02T23:20:55.948 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-04-02T23:20:55.950 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-04-02T23:20:55.995 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:55 +0000 (0:00:00.457) 0:01:14.032 ******** 2020-04-02T23:20:56.023 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-04-02T23:20:56.024 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-04-02T23:20:56.068 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:56 +0000 (0:00:00.073) 0:01:14.105 ******** 2020-04-02T23:20:56.503 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-04-02T23:20:56.542 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:56 +0000 (0:00:00.473) 0:01:14.579 ******** 2020-04-02T23:20:56.678 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-04-02T23:20:56.680 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-04-02T23:20:56.727 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:56 +0000 (0:00:00.184) 0:01:14.764 ******** 2020-04-02T23:20:56.765 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-02T23:20:56.766 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-02T23:20:56.815 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:56 +0000 (0:00:00.084) 0:01:14.849 ******** 2020-04-02T23:20:57.014 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-02T23:20:57.015 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-04-02T23:20:57.055 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:57 +0000 (0:00:00.243) 0:01:15.092 ******** 2020-04-02T23:20:57.239 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-04-02T23:20:57.240 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-04-02T23:20:57.283 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:57 +0000 (0:00:00.228) 0:01:15.321 ******** 2020-04-02T23:20:57.289 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-02T23:20:57.290 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1212, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-04-02T23:20:57.335 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:57 +0000 (0:00:00.051) 0:01:15.372 ******** 2020-04-02T23:20:57.489 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-02T23:20:57.490 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-02T23:20:57.538 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:57 +0000 (0:00:00.203) 0:01:15.575 ******** 2020-04-02T23:20:57.744 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-02T23:20:57.746 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-04-02T23:20:57.788 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:57 +0000 (0:00:00.249) 0:01:15.824 ******** 2020-04-02T23:20:57.851 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-04-02T23:20:57.891 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:57 +0000 (0:00:00.103) 0:01:15.928 ******** 2020-04-02T23:20:58.022 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-02T23:20:58.023 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1212, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-04-02T23:20:58.068 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:58 +0000 (0:00:00.177) 0:01:16.105 ******** 2020-04-02T23:20:58.390 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-04-02T23:20:58.458 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:58 +0000 (0:00:00.390) 0:01:16.496 ******** 2020-04-02T23:20:58.578 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-02T23:20:58.579 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-04-02T23:20:58.623 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:58 +0000 (0:00:00.164) 0:01:16.660 ******** 2020-04-02T23:20:59.126 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-02T23:20:59.127 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-04-02T23:20:59.172 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:20:59 +0000 (0:00:00.548) 0:01:17.209 ******** 2020-04-02T23:21:00.310 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-04-02T23:21:00.311 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.648731", "end": "2020-04-02 23:21:00.284783", "rc": 0, "start": "2020-04-02 23:20:58.636052", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:00.350 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:00 +0000 (0:00:01.178) 0:01:18.388 ******** 2020-04-02T23:21:00.880 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** ok: [smithi084.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "53b24162baf9c2fcf22da2b5c2c258a91997ffad", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 425, "state": "file", "uid": 0} 2020-04-02T23:21:01.033 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-02T23:21:01.033 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.648529", "end": "2020-04-02 23:21:01.008229", "rc": 0, "start": "2020-04-02 23:20:59.359700", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:01.073 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:01 +0000 (0:00:00.723) 0:01:19.111 ******** 2020-04-02T23:21:01.362 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-04-02T23:21:01.362 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3e4763db3d6c8e2d723452e76e0b9ed9030ed28d", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 408, "state": "file", "uid": 0} 2020-04-02T23:21:01.616 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "53b24162baf9c2fcf22da2b5c2c258a91997ffad", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 425, "state": "file", "uid": 0} 2020-04-02T23:21:01.851 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "6d4b75787c58f146a27a5ee2b688dd525283abf1", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 410, "state": "file", "uid": 0} 2020-04-02T23:21:01.894 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:01 +0000 (0:00:00.820) 0:01:19.931 ******** 2020-04-02T23:21:02.093 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3e4763db3d6c8e2d723452e76e0b9ed9030ed28d", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 408, "state": "file", "uid": 0} 2020-04-02T23:21:02.385 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-04-02T23:21:02.387 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-04-02T23:21:02.431 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:02 +0000 (0:00:00.537) 0:01:20.469 ******** 2020-04-02T23:21:02.563 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-04-02T23:21:02.563 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "6d4b75787c58f146a27a5ee2b688dd525283abf1", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 410, "state": "file", "uid": 0} 2020-04-02T23:21:02.625 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:02 +0000 (0:00:00.193) 0:01:20.662 ******** 2020-04-02T23:21:02.933 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-04-02T23:21:02.934 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', u'name': u'CentOS-$releasever - Base'}, 'key': u'CentOS-Base'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-04-02T23:21:03.149 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-04-02T23:21:03.150 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-04-02T23:21:03.196 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:03 +0000 (0:00:00.571) 0:01:21.233 ******** 2020-04-02T23:21:03.387 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-04-02T23:21:03.388 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', u'name': u'CentOS-$releasever - AppStream'}, 'key': u'CentOS-AppStream'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-04-02T23:21:03.715 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', u'name': u'CentOS-$releasever - Base'}, 'key': u'CentOS-Base'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-04-02T23:21:03.856 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', u'name': u'CentOS-$releasever - Extras'}, 'key': u'CentOS-Extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-04-02T23:21:03.896 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:03 +0000 (0:00:00.699) 0:01:21.933 ******** 2020-04-02T23:21:04.204 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', u'name': u'CentOS-$releasever - AppStream'}, 'key': u'CentOS-AppStream'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-04-02T23:21:04.445 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-04-02T23:21:04.447 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.345682", "end": "2020-04-02 23:21:04.424161", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-04-02 23:21:04.078479", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-04-02T23:21:04.507 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:04 +0000 (0:00:00.611) 0:01:22.545 ******** 2020-04-02T23:21:04.537 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:04.575 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:04 +0000 (0:00:00.067) 0:01:22.612 ******** 2020-04-02T23:21:04.612 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-04-02T23:21:04.613 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:04.614 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:04.657 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:04 +0000 (0:00:00.079) 0:01:22.692 ******** 2020-04-02T23:21:04.679 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-04-02T23:21:04.681 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:04.718 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:04 +0000 (0:00:00.063) 0:01:22.755 ******** 2020-04-02T23:21:04.724 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-04-02T23:21:04.725 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', u'name': u'CentOS-$releasever - Extras'}, 'key': u'CentOS-Extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-04-02T23:21:04.770 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:04 +0000 (0:00:00.052) 0:01:22.807 ******** 2020-04-02T23:21:04.776 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:21:04.778 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-04-02T23:21:04.825 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:04 +0000 (0:00:00.054) 0:01:22.862 ******** 2020-04-02T23:21:04.873 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-04-02T23:21:04.874 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:04.912 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:04 +0000 (0:00:00.087) 0:01:22.949 ******** 2020-04-02T23:21:04.960 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-04-02T23:21:04.961 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:04.998 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:04 +0000 (0:00:00.086) 0:01:23.036 ******** 2020-04-02T23:21:05.207 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-04-02T23:21:05.208 INFO:teuthology.task.ansible.out:fatal: [smithi084.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006373", "end": "2020-04-02 23:21:05.186868", "msg": "non-zero return code", "rc": 1, "start": "2020-04-02 23:21:05.180495", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-04-02T23:21:05.247 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:05 +0000 (0:00:00.248) 0:01:23.284 ******** 2020-04-02T23:21:05.275 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-04-02T23:21:05.277 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:05.323 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:05 +0000 (0:00:00.075) 0:01:23.360 ******** 2020-04-02T23:21:05.359 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-04-02T23:21:05.360 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.342625", "end": "2020-04-02 23:21:05.330633", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-04-02 23:21:04.988008", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-04-02T23:21:05.404 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:05 +0000 (0:00:00.081) 0:01:23.442 ******** 2020-04-02T23:21:05.440 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:05.473 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:05 +0000 (0:00:00.069) 0:01:23.511 ******** 2020-04-02T23:21:05.521 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-04-02T23:21:05.523 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:05.571 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:05 +0000 (0:00:00.097) 0:01:23.608 ******** 2020-04-02T23:21:05.610 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-04-02T23:21:05.612 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:05.657 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:05 +0000 (0:00:00.080) 0:01:23.689 ******** 2020-04-02T23:21:05.697 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi042.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-04-02T23:21:05.743 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:05 +0000 (0:00:00.088) 0:01:23.778 ******** 2020-04-02T23:21:05.781 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-04-02T23:21:05.783 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:05.818 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:05 +0000 (0:00:00.077) 0:01:23.855 ******** 2020-04-02T23:21:05.854 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-04-02T23:21:05.855 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:05.896 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:05 +0000 (0:00:00.078) 0:01:23.934 ******** 2020-04-02T23:21:06.121 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-04-02T23:21:06.122 INFO:teuthology.task.ansible.out:fatal: [smithi042.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007021", "end": "2020-04-02 23:21:06.100341", "msg": "non-zero return code", "rc": 1, "start": "2020-04-02 23:21:06.093320", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-04-02T23:21:06.174 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:06 +0000 (0:00:00.277) 0:01:24.211 ******** 2020-04-02T23:21:06.217 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:06.253 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:06 +0000 (0:00:00.074) 0:01:24.286 ******** 2020-04-02T23:21:07.765 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-04-02T23:21:07.808 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:07 +0000 (0:00:01.559) 0:01:25.845 ******** 2020-04-02T23:21:08.655 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-04-02T23:21:08.696 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:08 +0000 (0:00:00.887) 0:01:26.733 ******** 2020-04-02T23:21:10.726 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-04-02T23:21:10.726 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: hdparm-9.54-2.el8.x86_64", "Removed: tuned-2.12.0-3.el8_1.1.noarch"]} 2020-04-02T23:21:10.778 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:10 +0000 (0:00:02.081) 0:01:28.815 ******** 2020-04-02T23:21:11.641 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: hdparm-9.54-2.el8.x86_64", "Removed: tuned-2.12.0-3.el8_1.1.noarch"]} 2020-04-02T23:21:11.683 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:11 +0000 (0:00:00.905) 0:01:29.720 ******** 2020-04-02T23:21:16.357 INFO:teuthology.task.ansible.out: TASK [testnode : Base group workaround for BZ1782899] ************************** 2020-04-02T23:21:16.358 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:05.363176", "end": "2020-04-02 23:21:16.329525", "rc": 0, "start": "2020-04-02 23:21:10.966349", "stderr": "No match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"\nNo match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"", "stderr_lines": ["No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\"", "No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\""], "stdout": "CentOS-8 - AppStream 134 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 123 kB/s | 3.8 kB 00:00 \nCentOS-8 - Extras 52 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 44 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 148 kB/s | 4.7 kB 00:00 \nlab-extras 1.1 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:03 ago on Thu 02 Apr 2020 11:21:11 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n============================================================= 2020-04-02T23:21:16.359 INFO:teuthology.task.ansible.out:===================\nUpgrading Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 134 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 123 kB/s | 3.8 kB 00:00 ", "CentOS-8 - Extras 52 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 44 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 148 kB/s | 4.7 kB 00:00 ", "lab-extras 1.1 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:03 ago on Thu 02 Apr 2020 11:21:11 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-04-02T23:21:16.413 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:16 +0000 (0:00:04.730) 0:01:34.451 ******** 2020-04-02T23:21:17.143 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:05.219644", "end": "2020-04-02 23:21:17.114397", "rc": 0, "start": "2020-04-02 23:21:11.894753", "stderr": "No match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"\nNo match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"", "stderr_lines": ["No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\"", "No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\""], "stdout": "CentOS-8 - AppStream 140 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 128 kB/s | 3.8 kB 00:00 \nCentOS-8 - Extras 51 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 73 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 148 kB/s | 4.7 kB 00:00 \nlab-extras 1.4 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:03 ago on Thu 02 Apr 2020 11:21:12 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n============================================================= 2020-04-02T23:21:17.145 INFO:teuthology.task.ansible.out:===================\nUpgrading Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 140 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 128 kB/s | 3.8 kB 00:00 ", "CentOS-8 - Extras 51 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 73 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 148 kB/s | 4.7 kB 00:00 ", "lab-extras 1.4 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:03 ago on Thu 02 Apr 2020 11:21:12 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-04-02T23:21:17.193 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:17 +0000 (0:00:00.779) 0:01:35.230 ******** 2020-04-02T23:21:24.172 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-02T23:21:24.173 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: hdparm-9.54-2.el8.x86_64"]} 2020-04-02T23:21:24.213 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:24 +0000 (0:00:07.018) 0:01:42.249 ******** 2020-04-02T23:21:24.248 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-04-02T23:21:24.250 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:24.288 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:24 +0000 (0:00:00.074) 0:01:42.323 ******** 2020-04-02T23:21:24.702 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: hdparm-9.54-2.el8.x86_64"]} 2020-04-02T23:21:24.746 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:24 +0000 (0:00:00.460) 0:01:42.783 ******** 2020-04-02T23:21:24.776 INFO:teuthology.task.ansible.out: 2020-04-02T23:21:24.777 INFO:teuthology.task.ansible.out:TASK [testnode : Install epel packages] **************************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:24.823 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:24 +0000 (0:00:00.077) 0:01:42.861 ******** 2020-04-02T23:21:25.208 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-02T23:21:25.210 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-04-02T23:21:25.250 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:25 +0000 (0:00:00.426) 0:01:43.287 ******** 2020-04-02T23:21:25.277 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:21:25.279 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:25.325 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:25 +0000 (0:00:00.075) 0:01:43.363 ******** 2020-04-02T23:21:25.656 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.socket basic.target polkit.service sysinit.target system.slice dbus.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ebtables.service iptables.service ipset.service ip6tables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": " 2020-04-02T23:21:25.657 INFO:teuthology.task.ansible.out:/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127436", "LimitNPROCSoft": "127436", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Li 2020-04-02T23:21:25.659 INFO:teuthology.task.ansible.out:mitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127436", "LimitSIGPENDINGSoft": "127436", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWh 2020-04-02T23:21:25.660 INFO:teuthology.task.ansible.out:enUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-04-02T23:21:25.691 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:25 +0000 (0:00:00.365) 0:01:43.728 ******** 2020-04-02T23:21:25.779 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-02T23:21:25.781 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-04-02T23:21:25.839 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:25 +0000 (0:00:00.147) 0:01:43.876 ******** 2020-04-02T23:21:25.866 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:21:25.869 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:25.913 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:25 +0000 (0:00:00.073) 0:01:43.950 ******** 2020-04-02T23:21:26.006 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-04-02T23:21:26.008 INFO:teuthology.task.ansible.out:fatal: [smithi084.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-04-02T23:21:26.051 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:26 +0000 (0:00:00.138) 0:01:44.089 ******** 2020-04-02T23:21:26.241 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-04-02T23:21:26.242 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice sysinit.target polkit.service dbus.socket basic.target dbus.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "iptables.service shutdown.target ip6tables.service ipset.service ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-04-02T23:21:26.249 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127461", "LimitNPROCSoft": "127461", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127461", 2020-04-02T23:21:26.252 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127461", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target dbus.socket system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-04-02T23:21:26.254 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-04-02T23:21:26.284 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:26 +0000 (0:00:00.232) 0:01:44.321 ******** 2020-04-02T23:21:26.626 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-04-02T23:21:26.628 INFO:teuthology.task.ansible.out:fatal: [smithi042.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-04-02T23:21:26.664 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:26 +0000 (0:00:00.380) 0:01:44.702 ******** 2020-04-02T23:21:26.753 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-04-02T23:21:26.755 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-04-02T23:21:26.796 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:26 +0000 (0:00:00.131) 0:01:44.834 ******** 2020-04-02T23:21:26.828 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-04-02T23:21:26.828 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:26.872 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:26 +0000 (0:00:00.075) 0:01:44.909 ******** 2020-04-02T23:21:26.898 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-04-02T23:21:26.936 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:26 +0000 (0:00:00.064) 0:01:44.974 ******** 2020-04-02T23:21:26.963 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-04-02T23:21:26.965 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-04-02T23:21:27.008 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.071) 0:01:45.045 ******** 2020-04-02T23:21:27.018 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:27.060 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.051) 0:01:45.097 ******** 2020-04-02T23:21:27.066 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-04-02T23:21:27.068 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:27.107 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.046) 0:01:45.144 ******** 2020-04-02T23:21:27.113 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-04-02T23:21:27.115 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:27.152 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.045) 0:01:45.190 ******** 2020-04-02T23:21:27.158 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-04-02T23:21:27.200 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.047) 0:01:45.238 ******** 2020-04-02T23:21:27.206 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-04-02T23:21:27.207 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:27.208 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:27.248 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.048) 0:01:45.286 ******** 2020-04-02T23:21:27.254 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-04-02T23:21:27.255 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:27.291 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.042) 0:01:45.329 ******** 2020-04-02T23:21:27.298 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-04-02T23:21:27.300 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:27.336 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.044) 0:01:45.373 ******** 2020-04-02T23:21:27.341 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-04-02T23:21:27.342 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:27.379 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.043) 0:01:45.417 ******** 2020-04-02T23:21:27.387 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-04-02T23:21:27.426 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.046) 0:01:45.463 ******** 2020-04-02T23:21:27.433 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-04-02T23:21:27.433 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:27.435 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:27.472 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.046) 0:01:45.510 ******** 2020-04-02T23:21:27.478 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-04-02T23:21:27.479 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:27.515 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.042) 0:01:45.553 ******** 2020-04-02T23:21:27.521 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-04-02T23:21:27.523 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:27.559 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.044) 0:01:45.597 ******** 2020-04-02T23:21:27.565 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-04-02T23:21:27.566 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:27.603 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.043) 0:01:45.640 ******** 2020-04-02T23:21:27.610 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-04-02T23:21:27.657 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.046) 0:01:45.687 ******** TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:27.695 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.045) 0:01:45.732 ******** 2020-04-02T23:21:27.700 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:27.741 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.046) 0:01:45.779 ******** 2020-04-02T23:21:27.749 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:21:27.752 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:27.786 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.044) 0:01:45.824 ******** 2020-04-02T23:21:27.791 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-04-02T23:21:27.793 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:27.832 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.045) 0:01:45.869 ******** 2020-04-02T23:21:27.837 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-04-02T23:21:27.839 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:27.891 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.051) 0:01:45.920 ******** TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:27.927 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.044) 0:01:45.965 ******** 2020-04-02T23:21:27.933 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-02T23:21:27.935 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:27.972 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:27 +0000 (0:00:00.044) 0:01:46.010 ******** 2020-04-02T23:21:27.979 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:21:27.980 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.017 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.045) 0:01:46.055 ******** 2020-04-02T23:21:28.023 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-04-02T23:21:28.025 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.064 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.046) 0:01:46.101 ******** 2020-04-02T23:21:28.069 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-04-02T23:21:28.070 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.110 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.046) 0:01:46.147 ******** 2020-04-02T23:21:28.115 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-04-02T23:21:28.117 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.153 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.043) 0:01:46.191 ******** 2020-04-02T23:21:28.158 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-02T23:21:28.158 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.196 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.042) 0:01:46.233 ******** 2020-04-02T23:21:28.204 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.240 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.044) 0:01:46.278 ******** 2020-04-02T23:21:28.246 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-04-02T23:21:28.246 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.285 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.044) 0:01:46.322 ******** 2020-04-02T23:21:28.290 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-04-02T23:21:28.291 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.330 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.044) 0:01:46.367 ******** 2020-04-02T23:21:28.335 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-04-02T23:21:28.335 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.386 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.056) 0:01:46.423 ******** 2020-04-02T23:21:28.392 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-04-02T23:21:28.393 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.429 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.043) 0:01:46.467 ******** 2020-04-02T23:21:28.437 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.480 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.045) 0:01:46.513 ******** 2020-04-02T23:21:28.485 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.522 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.046) 0:01:46.559 ******** 2020-04-02T23:21:28.527 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-04-02T23:21:28.527 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.569 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.047) 0:01:46.606 ******** 2020-04-02T23:21:28.575 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-04-02T23:21:28.575 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.613 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.044) 0:01:46.651 ******** 2020-04-02T23:21:28.624 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.665 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.048) 0:01:46.700 ******** 2020-04-02T23:21:28.671 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-04-02T23:21:28.672 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.713 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.045) 0:01:46.745 ******** 2020-04-02T23:21:28.715 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.753 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.044) 0:01:46.790 ******** 2020-04-02T23:21:28.759 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-02T23:21:28.760 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.798 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.045) 0:01:46.836 ******** 2020-04-02T23:21:28.803 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-04-02T23:21:28.804 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.842 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.043) 0:01:46.879 ******** 2020-04-02T23:21:28.847 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-02T23:21:28.848 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.886 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.044) 0:01:46.924 ******** 2020-04-02T23:21:28.891 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-04-02T23:21:28.894 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.931 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.044) 0:01:46.968 ******** 2020-04-02T23:21:28.936 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-02T23:21:28.937 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:28.979 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:28 +0000 (0:00:00.043) 0:01:47.011 ******** TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.017 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.043) 0:01:47.055 ******** 2020-04-02T23:21:29.023 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-02T23:21:29.023 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.065 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.044) 0:01:47.099 ******** 2020-04-02T23:21:29.070 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-02T23:21:29.075 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.108 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.046) 0:01:47.146 ******** 2020-04-02T23:21:29.116 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-02T23:21:29.120 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.152 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.043) 0:01:47.190 ******** 2020-04-02T23:21:29.158 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-02T23:21:29.162 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.197 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.044) 0:01:47.234 ******** 2020-04-02T23:21:29.202 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-02T23:21:29.203 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.253 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.056) 0:01:47.291 ******** 2020-04-02T23:21:29.258 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-02T23:21:29.259 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.300 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.046) 0:01:47.337 ******** 2020-04-02T23:21:29.305 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-02T23:21:29.307 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.346 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.045) 0:01:47.383 ******** 2020-04-02T23:21:29.353 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-02T23:21:29.355 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.394 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.047) 0:01:47.431 ******** 2020-04-02T23:21:29.399 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-04-02T23:21:29.407 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.443 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.049) 0:01:47.480 ******** 2020-04-02T23:21:29.448 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-02T23:21:29.449 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.491 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.047) 0:01:47.528 ******** 2020-04-02T23:21:29.497 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:21:29.497 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.535 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.044) 0:01:47.573 ******** 2020-04-02T23:21:29.540 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-02T23:21:29.541 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.582 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.046) 0:01:47.620 ******** 2020-04-02T23:21:29.594 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.634 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.051) 0:01:47.671 ******** 2020-04-02T23:21:29.639 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-04-02T23:21:29.640 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.678 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.043) 0:01:47.714 ******** 2020-04-02T23:21:29.684 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-02T23:21:29.686 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.724 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.044) 0:01:47.759 ******** 2020-04-02T23:21:29.726 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:21:29.727 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.765 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.043) 0:01:47.802 ******** 2020-04-02T23:21:29.770 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:21:29.771 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.813 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.043) 0:01:47.845 ******** 2020-04-02T23:21:29.818 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.851 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.043) 0:01:47.888 ******** 2020-04-02T23:21:29.856 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-02T23:21:29.857 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.895 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.044) 0:01:47.933 ******** 2020-04-02T23:21:29.902 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-02T23:21:29.904 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:29.939 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:29 +0000 (0:00:00.043) 0:01:47.976 ******** 2020-04-02T23:21:29.965 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-02T23:21:29.967 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:30.004 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:30 +0000 (0:00:00.065) 0:01:48.042 ******** 2020-04-02T23:21:30.031 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-02T23:21:30.032 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:30.069 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:30 +0000 (0:00:00.064) 0:01:48.106 ******** 2020-04-02T23:21:30.106 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-02T23:21:30.106 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-04-02T23:21:30.144 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:30 +0000 (0:00:00.074) 0:01:48.181 ******** 2020-04-02T23:21:30.296 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-04-02T23:21:30.355 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:30 +0000 (0:00:00.211) 0:01:48.392 ******** 2020-04-02T23:21:30.361 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-02T23:21:30.361 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:21:30.399 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:30 +0000 (0:00:00.043) 0:01:48.436 ******** 2020-04-02T23:21:30.577 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:21:30.614 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:30 +0000 (0:00:00.215) 0:01:48.652 ******** 2020-04-02T23:21:30.620 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-02T23:21:30.622 INFO:teuthology.task.ansible.out: [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-04-02T23:21:30.659 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:30 +0000 (0:00:00.044) 0:01:48.697 ******** 2020-04-02T23:21:30.686 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:30.722 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:30 +0000 (0:00:00.062) 0:01:48.760 ******** 2020-04-02T23:21:30.748 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-02T23:21:30.750 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:30.785 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:30 +0000 (0:00:00.062) 0:01:48.822 ******** 2020-04-02T23:21:30.811 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-02T23:21:30.813 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:30.849 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:30 +0000 (0:00:00.063) 0:01:48.886 ******** 2020-04-02T23:21:30.857 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-04-02T23:21:30.896 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:30 +0000 (0:00:00.046) 0:01:48.933 ******** 2020-04-02T23:21:30.901 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-02T23:21:30.901 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:30.941 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:30 +0000 (0:00:00.045) 0:01:48.979 ******** 2020-04-02T23:21:30.955 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.001 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:30 +0000 (0:00:00.055) 0:01:49.035 ******** 2020-04-02T23:21:31.003 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.049 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.045) 0:01:49.080 ******** TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.089 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.046) 0:01:49.127 ******** 2020-04-02T23:21:31.096 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.141 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.046) 0:01:49.174 ******** 2020-04-02T23:21:31.142 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-02T23:21:31.142 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.181 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.044) 0:01:49.219 ******** 2020-04-02T23:21:31.190 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-02T23:21:31.191 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.227 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.045) 0:01:49.264 ******** 2020-04-02T23:21:31.232 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-02T23:21:31.234 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.273 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.045) 0:01:49.310 ******** 2020-04-02T23:21:31.278 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-02T23:21:31.279 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.328 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.052) 0:01:49.363 ******** 2020-04-02T23:21:31.331 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-02T23:21:31.332 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.376 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.046) 0:01:49.409 ******** 2020-04-02T23:21:31.382 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.422 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.050) 0:01:49.459 ******** 2020-04-02T23:21:31.427 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-02T23:21:31.429 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.468 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.046) 0:01:49.505 ******** 2020-04-02T23:21:31.477 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.519 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.050) 0:01:49.556 ******** 2020-04-02T23:21:31.528 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-02T23:21:31.531 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.568 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.049) 0:01:49.605 ******** 2020-04-02T23:21:31.574 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-04-02T23:21:31.575 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.621 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.048) 0:01:49.654 ******** 2020-04-02T23:21:31.623 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.664 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.047) 0:01:49.701 ******** 2020-04-02T23:21:31.669 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-02T23:21:31.670 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.714 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.050) 0:01:49.751 ******** 2020-04-02T23:21:31.720 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-02T23:21:31.721 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.762 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.048) 0:01:49.799 ******** 2020-04-02T23:21:31.770 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-02T23:21:31.771 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.808 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.045) 0:01:49.845 ******** 2020-04-02T23:21:31.813 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-04-02T23:21:31.814 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.856 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.047) 0:01:49.893 ******** 2020-04-02T23:21:31.861 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-04-02T23:21:31.863 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.905 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.046) 0:01:49.940 ******** 2020-04-02T23:21:31.907 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-04-02T23:21:31.910 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:31.949 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.046) 0:01:49.986 ******** 2020-04-02T23:21:31.955 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.000 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:31 +0000 (0:00:00.051) 0:01:50.038 ******** 2020-04-02T23:21:32.006 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-02T23:21:32.007 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.050 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:32 +0000 (0:00:00.049) 0:01:50.088 ******** 2020-04-02T23:21:32.056 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-04-02T23:21:32.057 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.096 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:32 +0000 (0:00:00.045) 0:01:50.133 ******** 2020-04-02T23:21:32.105 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.150 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:32 +0000 (0:00:00.053) 0:01:50.187 ******** 2020-04-02T23:21:32.161 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.199 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:32 +0000 (0:00:00.049) 0:01:50.236 ******** 2020-04-02T23:21:32.205 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.248 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:32 +0000 (0:00:00.048) 0:01:50.285 ******** 2020-04-02T23:21:32.255 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-04-02T23:21:32.257 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.295 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:32 +0000 (0:00:00.047) 0:01:50.332 ******** 2020-04-02T23:21:32.300 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-04-02T23:21:32.303 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.343 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:32 +0000 (0:00:00.048) 0:01:50.381 ******** 2020-04-02T23:21:32.358 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-04-02T23:21:32.359 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.396 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:32 +0000 (0:00:00.052) 0:01:50.433 ******** 2020-04-02T23:21:32.401 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-04-02T23:21:32.402 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.441 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:32 +0000 (0:00:00.044) 0:01:50.478 ******** 2020-04-02T23:21:32.447 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-04-02T23:21:32.451 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.486 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:32 +0000 (0:00:00.044) 0:01:50.523 ******** 2020-04-02T23:21:32.491 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-04-02T23:21:32.496 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.530 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:32 +0000 (0:00:00.044) 0:01:50.567 ******** 2020-04-02T23:21:32.535 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-04-02T23:21:32.538 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.581 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:32 +0000 (0:00:00.050) 0:01:50.618 ******** 2020-04-02T23:21:32.586 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-04-02T23:21:32.588 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.625 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:32 +0000 (0:00:00.044) 0:01:50.662 ******** 2020-04-02T23:21:32.631 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-04-02T23:21:32.633 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.670 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:32 +0000 (0:00:00.044) 0:01:50.707 ******** 2020-04-02T23:21:32.675 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-04-02T23:21:32.677 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.717 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:32 +0000 (0:00:00.046) 0:01:50.754 ******** 2020-04-02T23:21:32.723 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:21:32.726 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-04-02T23:21:32.763 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:32 +0000 (0:00:00.046) 0:01:50.800 ******** 2020-04-02T23:21:32.768 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-04-02T23:21:32.770 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.815 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:32 +0000 (0:00:00.046) 0:01:50.847 ******** 2020-04-02T23:21:32.816 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-04-02T23:21:32.816 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.828 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-04-02T23:21:32.829 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.844 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi084.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.879 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:32 +0000 (0:00:00.069) 0:01:50.916 ******** 2020-04-02T23:21:32.884 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.885 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.928 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:32 +0000 (0:00:00.049) 0:01:50.966 ******** 2020-04-02T23:21:32.933 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-04-02T23:21:32.935 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:32.974 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:32 +0000 (0:00:00.045) 0:01:51.011 ******** 2020-04-02T23:21:33.013 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi042.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-04-02T23:21:33.049 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:33 +0000 (0:00:00.075) 0:01:51.087 ******** 2020-04-02T23:21:33.066 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-04-02T23:21:33.068 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004710", "end": "2020-04-02 23:21:33.046260", "rc": 0, "start": "2020-04-02 23:21:33.041550", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-04-02T23:21:33.109 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:33 +0000 (0:00:00.059) 0:01:51.146 ******** 2020-04-02T23:21:33.114 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-04-02T23:21:33.115 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:33.117 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi042.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:33.129 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:33.140 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:33.140 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:33.142 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi042.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:33.187 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:33 +0000 (0:00:00.078) 0:01:51.225 ******** 2020-04-02T23:21:33.193 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:33.245 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:33 +0000 (0:00:00.052) 0:01:51.277 ******** TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-04-02T23:21:33.256 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:33.293 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:33 +0000 (0:00:00.047) 0:01:51.325 ******** 2020-04-02T23:21:33.326 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-04-02T23:21:33.327 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:33.370 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:33 +0000 (0:00:00.082) 0:01:51.408 ******** 2020-04-02T23:21:33.380 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi042.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004713", "end": "2020-04-02 23:21:33.355122", "rc": 0, "start": "2020-04-02 23:21:33.350409", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-04-02T23:21:33.421 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:33 +0000 (0:00:00.049) 0:01:51.457 ******** 2020-04-02T23:21:33.425 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-04-02T23:21:33.427 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:33.465 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:33 +0000 (0:00:00.045) 0:01:51.502 ******** 2020-04-02T23:21:33.470 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-04-02T23:21:33.471 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:33.512 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:33 +0000 (0:00:00.047) 0:01:51.550 ******** 2020-04-02T23:21:33.540 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:33.582 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:33 +0000 (0:00:00.069) 0:01:51.619 ******** 2020-04-02T23:21:33.608 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-04-02T23:21:33.608 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:33.652 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:33 +0000 (0:00:00.070) 0:01:51.689 ******** 2020-04-02T23:21:33.680 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-04-02T23:21:33.682 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:33.719 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:33 +0000 (0:00:00.066) 0:01:51.756 ******** 2020-04-02T23:21:34.393 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-04-02T23:21:34.397 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-04-02T23:21:34.440 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:34 +0000 (0:00:00.717) 0:01:52.473 ******** 2020-04-02T23:21:34.483 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-02T23:21:34.484 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item={u'block_used': 12911795, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183313, u'size_available': 930542850048, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990059, u'device': u'/dev/sda1', u'inode_used': 64917, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183313, "block_size": 4096, "block_total": 240095108, "block_used": 12911795, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990059, "inode_total": 61054976, "inode_used": 64917, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542850048, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}} 2020-04-02T23:21:34.533 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:34 +0000 (0:00:00.097) 0:01:52.571 ******** 2020-04-02T23:21:34.708 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-04-02T23:21:34.708 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-04-02T23:21:34.761 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:34 +0000 (0:00:00.226) 0:01:52.798 ******** 2020-04-02T23:21:34.766 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-04-02T23:21:34.767 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005042", "end": "2020-04-02 23:21:34.714135", "rc": 0, "start": "2020-04-02 23:21:34.709093", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:34.811 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:34 +0000 (0:00:00.050) 0:01:52.848 ******** 2020-04-02T23:21:34.816 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-02T23:21:34.817 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item={u'block_used': 12911805, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183303, u'size_available': 930542809088, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990067, u'device': u'/dev/sda1', u'inode_used': 64909, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183303, "block_size": 4096, "block_total": 240095108, "block_used": 12911805, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990067, "inode_total": 61054976, "inode_used": 64909, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542809088, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}} 2020-04-02T23:21:34.858 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:34 +0000 (0:00:00.047) 0:01:52.896 ******** 2020-04-02T23:21:34.864 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-04-02T23:21:34.865 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={u'block_used': 12911795, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183313, u'size_available': 930542850048, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990059, u'device': u'/dev/sda1', u'inode_used': 64917, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183313, "block_size": 4096, "block_total": 240095108, "block_used": 12911795, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990059, "inode_total": 61054976, "inode_used": 64917, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542850048, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:34.905 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:34 +0000 (0:00:00.046) 0:01:52.942 ******** 2020-04-02T23:21:34.941 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-04-02T23:21:34.978 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:34 +0000 (0:00:00.073) 0:01:53.016 ******** 2020-04-02T23:21:35.025 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-02T23:21:35.029 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LH7Q', u'wwn-0x5000c500918e3515'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5LH7Q', u'wwn': u'0x5000c500918e3515', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LH7Q-part1', u'wwn-0x5000c500918e3515-part1'], u'uuids': [u'02783226-4726-4004-a66c-c6bc58415d09']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LH7Q", "wwn-0x5000c500918e3515"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LH7Q-part1", "wwn-0x5000c500918e3515-part1"], "labels": [], "masters": [], "uuids": ["02783226-4726-4004-a66c-c6bc58415d09"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LH7Q", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-02T23:21:35.031 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500918e3515"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:35.077 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005306", "end": "2020-04-02 23:21:35.045516", "rc": 0, "start": "2020-04-02 23:21:35.040210", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:35.162 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:35 +0000 (0:00:00.182) 0:01:53.199 ******** 2020-04-02T23:21:35.212 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-04-02T23:21:35.212 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'block_used': 12911805, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183303, u'size_available': 930542809088, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990067, u'device': u'/dev/sda1', u'inode_used': 64909, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183303, "block_size": 4096, "block_total": 240095108, "block_used": 12911805, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990067, "inode_total": 61054976, "inode_used": 64909, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542809088, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:35.274 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:35 +0000 (0:00:00.112) 0:01:53.311 ******** 2020-04-02T23:21:35.300 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-04-02T23:21:35.345 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:35 +0000 (0:00:00.072) 0:01:53.383 ******** 2020-04-02T23:21:35.419 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-02T23:21:35.421 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4J2MS', u'wwn-0x5000c500871b7906'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4J2MS', u'wwn': u'0x5000c500871b7906', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4J2MS-part1', u'wwn-0x5000c500871b7906-part1'], u'uuids': [u'02783226-4726-4004-a66c-c6bc58415d09']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2MS", "wwn-0x5000c500871b7906"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2MS-part1", "wwn-0x5000c500871b7906-part1"], "labels": [], "masters": [], "uuids": ["02783226-4726-4004-a66c-c6bc58415d09"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J2MS", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-02T23:21:35.423 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500871b7906"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:36.693 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-CPMzhq-zFo2-4kG1-fmSf-TAcE-AuC0-0XeDoj', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400WF400BGN', u'nvme-nvme.8086-50484654363230343030574634303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.473227", "end": "2020-04-02 23:21:36.656847", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-CPMzhq-zFo2-4kG1-fmSf-TAcE-AuC0-0XeDoj", "nvme-INTEL_SSDPEDMD400G4_PHFT620400WF400BGN", "nvme-nvme.8086-50484654363230343030574634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:35.183620", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-04-02T23:21:36.700 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:21:37.052 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-4wF3Ww-Y4M8-Aka0-BGTA-ikJm-KTbL-3XyjKo', u'nvme-INTEL_SSDPED1D480GA_PHMB75130021480DGN', u'nvme-nvme.8086-50484d42373531333030323134383044474e-494e54454c2053534450454431443438304741-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', u'support_discard': u'512', u'model': u'INTEL SSDPED1D480GA', u'size': u'447.13 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'937703088', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.435271", "end": "2020-04-02 23:21:37.016996", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-4wF3Ww-Y4M8-Aka0-BGTA-ikJm-KTbL-3XyjKo", "nvme-INTEL_SSDPED1D480GA_PHMB75130021480DGN", "nvme-nvme.8086-50484d42373531333030323134383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:35.581725", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGP 2020-04-02T23:21:37.054 INFO:teuthology.task.ansible.out:T data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:21:37.952 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-JYbcasVrcfnkIhA0JceiRPRC6ReaLZA4CEukIaaHQfc6tU23dLori6NeOVp14VlV'], u'uuids': [u'89e445e5-f848-43e1-974c-fb3f9ded9bda']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.049514", "end": "2020-04-02 23:21:37.903494", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-JYbcasVrcfnkIhA0JceiRPRC6ReaLZA4CEukIaaHQfc6tU23dLori6NeOVp14VlV"], "labels": [], "masters": [], "uuids": ["89e445e5-f848-43e1-974c-fb3f9ded9bda"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:36.853980", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:21:38.305 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-NZrrFM8LGXilAJXXfjk6PKo2smByGxi7N4nHmNxAKJSTqkkZO1m5cbHOitEMB6js'], u'uuids': [u'eeb9c00c-f90a-4edf-9143-f331050151a5']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.042949", "end": "2020-04-02 23:21:38.268503", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-NZrrFM8LGXilAJXXfjk6PKo2smByGxi7N4nHmNxAKJSTqkkZO1m5cbHOitEMB6js"], "labels": [], "masters": [], "uuids": ["eeb9c00c-f90a-4edf-9143-f331050151a5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:37.225554", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:21:39.190 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-JYbcasVrcfnkIhA0JceiRPRC6ReaLZA4pZ10Opn3SI3vh7qZckqFiRaHNZptQzKO'], u'uuids': [u'bf3e24da-5816-4331-844f-903a2cc56bf3']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.053121", "end": "2020-04-02 23:21:39.154425", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-JYbcasVrcfnkIhA0JceiRPRC6ReaLZA4pZ10Opn3SI3vh7qZckqFiRaHNZptQzKO"], "labels": [], "masters": [], "uuids": ["bf3e24da-5816-4331-844f-903a2cc56bf3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:38.101304", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:21:39.609 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-NZrrFM8LGXilAJXXfjk6PKo2smByGxi71RD8jLpTfms3WR02m0GrayhlcRDJJoGY'], u'uuids': [u'e612a85e-f0bf-4349-a7ff-4eba2016aa6c']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.051212", "end": "2020-04-02 23:21:39.543492", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-NZrrFM8LGXilAJXXfjk6PKo2smByGxi71RD8jLpTfms3WR02m0GrayhlcRDJJoGY"], "labels": [], "masters": [], "uuids": ["e612a85e-f0bf-4349-a7ff-4eba2016aa6c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:38.492280", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:21:40.443 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-JYbcasVrcfnkIhA0JceiRPRC6ReaLZA44Yve3kcUa15jbgEvzeSpb0prtBoTPbiP'], u'uuids': [u'f5018a38-9af8-4fae-b45b-6e650c5626d6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.067897", "end": "2020-04-02 23:21:40.413543", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-JYbcasVrcfnkIhA0JceiRPRC6ReaLZA44Yve3kcUa15jbgEvzeSpb0prtBoTPbiP"], "labels": [], "masters": [], "uuids": ["f5018a38-9af8-4fae-b45b-6e650c5626d6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:39.345646", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:21:40.858 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-NZrrFM8LGXilAJXXfjk6PKo2smByGxi7aFRbvPFUYq10MSKcrAX0z8FjswHm1v5J'], u'uuids': [u'8651736f-6cff-4b9a-9425-cb57d45dd267']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.052796", "end": "2020-04-02 23:21:40.828370", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-NZrrFM8LGXilAJXXfjk6PKo2smByGxi7aFRbvPFUYq10MSKcrAX0z8FjswHm1v5J"], "labels": [], "masters": [], "uuids": ["8651736f-6cff-4b9a-9425-cb57d45dd267"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:39.775574", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:21:41.713 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-JYbcasVrcfnkIhA0JceiRPRC6ReaLZA4p91IfgVyLgccfmyy0839fsQOx6a4bpTi'], u'uuids': [u'b7b83fd5-cc73-49e9-b8ff-d3cb5a51e570']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.075475", "end": "2020-04-02 23:21:41.679616", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-JYbcasVrcfnkIhA0JceiRPRC6ReaLZA4p91IfgVyLgccfmyy0839fsQOx6a4bpTi"], "labels": [], "masters": [], "uuids": ["b7b83fd5-cc73-49e9-b8ff-d3cb5a51e570"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:40.604141", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:21:41.715 INFO:teuthology.task.ansible.out: 2020-04-02T23:21:42.161 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-NZrrFM8LGXilAJXXfjk6PKo2smByGxi7f8OrkEmNdbNBG5hG7ge5NjcGOiY27wIm'], u'uuids': [u'4e339441-5d85-4851-9ff3-19db3b25e25d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.082587", "end": "2020-04-02 23:21:42.118992", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-NZrrFM8LGXilAJXXfjk6PKo2smByGxi7f8OrkEmNdbNBG5hG7ge5NjcGOiY27wIm"], "labels": [], "masters": [], "uuids": ["4e339441-5d85-4851-9ff3-19db3b25e25d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:41.036405", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:21:42.981 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-JYbcasVrcfnkIhA0JceiRPRC6ReaLZA4hiazunm8q2iTJOZ1rwv09M7GENbuCgng'], u'uuids': [u'9c525c44-9358-4f38-807f-08d839daee5e']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.067432", "end": "2020-04-02 23:21:42.942856", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-JYbcasVrcfnkIhA0JceiRPRC6ReaLZA4hiazunm8q2iTJOZ1rwv09M7GENbuCgng"], "labels": [], "masters": [], "uuids": ["9c525c44-9358-4f38-807f-08d839daee5e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:41.875424", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:21:43.026 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:43 +0000 (0:00:07.680) 0:02:01.063 ******** 2020-04-02T23:21:43.073 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-02T23:21:43.074 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LH7Q', u'wwn-0x5000c500918e3515'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5LH7Q', u'wwn': u'0x5000c500918e3515', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5LH7Q-part1', u'wwn-0x5000c500918e3515-part1'], u'uuids': [u'02783226-4726-4004-a66c-c6bc58415d09']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LH7Q", "wwn-0x5000c500918e3515"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LH7Q-part1", "wwn-0x5000c500918e3515-part1"], "labels": [], "masters": [], "uuids": ["02783226-4726-4004-a66c-c6bc58415d09"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LH7Q", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-02T23:21:43.075 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500918e3515"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:43.299 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-CPMzhq-zFo2-4kG1-fmSf-TAcE-AuC0-0XeDoj', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400WF400BGN', u'nvme-nvme.8086-50484654363230343030574634303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037034", "end": "2020-04-02 23:21:43.268993", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-CPMzhq-zFo2-4kG1-fmSf-TAcE-AuC0-0XeDoj", "nvme-INTEL_SSDPEDMD400G4_PHFT620400WF400BGN", "nvme-nvme.8086-50484654363230343030574634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:43.231959", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-04-02T23:21:43.301 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0344437 s, 3.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0344437 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:43.414 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-NZrrFM8LGXilAJXXfjk6PKo2smByGxi7sxsJchBtcws6hvvVkJXpdBjtvVJURGTC'], u'uuids': [u'8d1f1dc6-c702-49a2-a3dd-96632a7204da']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.052152", "end": "2020-04-02 23:21:43.379718", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-NZrrFM8LGXilAJXXfjk6PKo2smByGxi7sxsJchBtcws6hvvVkJXpdBjtvVJURGTC"], "labels": [], "masters": [], "uuids": ["8d1f1dc6-c702-49a2-a3dd-96632a7204da"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:42.327566", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! 2020-04-02T23:21:43.416 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or", "other utilities."]} 2020-04-02T23:21:43.455 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:43 +0000 (0:00:00.429) 0:02:01.493 ******** 2020-04-02T23:21:43.493 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-02T23:21:43.494 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4J2MS', u'wwn-0x5000c500871b7906'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4J2MS', u'wwn': u'0x5000c500871b7906', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4J2MS-part1', u'wwn-0x5000c500871b7906-part1'], u'uuids': [u'02783226-4726-4004-a66c-c6bc58415d09']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2MS", "wwn-0x5000c500871b7906"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2MS-part1", "wwn-0x5000c500871b7906-part1"], "labels": [], "masters": [], "uuids": ["02783226-4726-4004-a66c-c6bc58415d09"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J2MS", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-02T23:21:43.496 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500871b7906"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:43.632 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-JYbcasVrcfnkIhA0JceiRPRC6ReaLZA4CEukIaaHQfc6tU23dLori6NeOVp14VlV'], u'uuids': [u'89e445e5-f848-43e1-974c-fb3f9ded9bda']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.139713", "end": "2020-04-02 23:21:43.601585", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-JYbcasVrcfnkIhA0JceiRPRC6ReaLZA4CEukIaaHQfc6tU23dLori6NeOVp14VlV"], "labels": [], "masters": [], "uuids": ["89e445e5-f848-43e1-974c-fb3f9ded9bda"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:43.461872", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137068 s, 842 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137068 s, 842 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:43.737 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-4wF3Ww-Y4M8-Aka0-BGTA-ikJm-KTbL-3XyjKo', u'nvme-INTEL_SSDPED1D480GA_PHMB75130021480DGN', u'nvme-nvme.8086-50484d42373531333030323134383044474e-494e54454c2053534450454431443438304741-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', u'support_discard': u'512', u'model': u'INTEL SSDPED1D480GA', u'size': u'447.13 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'937703088', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036454", "end": "2020-04-02 23:21:43.712718", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-4wF3Ww-Y4M8-Aka0-BGTA-ikJm-KTbL-3XyjKo", "nvme-INTEL_SSDPED1D480GA_PHMB75130021480DGN", "nvme-nvme.8086-50484d42373531333030323134383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:43.676264", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 2020-04-02T23:21:43.739 INFO:teuthology.task.ansible.out: 0.0337481 s, 3.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0337481 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:43.961 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-JYbcasVrcfnkIhA0JceiRPRC6ReaLZA4pZ10Opn3SI3vh7qZckqFiRaHNZptQzKO'], u'uuids': [u'bf3e24da-5816-4331-844f-903a2cc56bf3']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.147901", "end": "2020-04-02 23:21:43.930343", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-JYbcasVrcfnkIhA0JceiRPRC6ReaLZA4pZ10Opn3SI3vh7qZckqFiRaHNZptQzKO"], "labels": [], "masters": [], "uuids": ["bf3e24da-5816-4331-844f-903a2cc56bf3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:43.782442", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.145392 s, 793 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.145392 s, 793 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:44.041 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-NZrrFM8LGXilAJXXfjk6PKo2smByGxi7N4nHmNxAKJSTqkkZO1m5cbHOitEMB6js'], u'uuids': [u'eeb9c00c-f90a-4edf-9143-f331050151a5']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.095218", "end": "2020-04-02 23:21:44.004254", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-NZrrFM8LGXilAJXXfjk6PKo2smByGxi7N4nHmNxAKJSTqkkZO1m5cbHOitEMB6js"], "labels": [], "masters": [], "uuids": ["eeb9c00c-f90a-4edf-9143-f331050151a5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:43.909036", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.092541 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.092541 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:44.297 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-JYbcasVrcfnkIhA0JceiRPRC6ReaLZA44Yve3kcUa15jbgEvzeSpb0prtBoTPbiP'], u'uuids': [u'f5018a38-9af8-4fae-b45b-6e650c5626d6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.139552", "end": "2020-04-02 23:21:44.268893", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-JYbcasVrcfnkIhA0JceiRPRC6ReaLZA44Yve3kcUa15jbgEvzeSpb0prtBoTPbiP"], "labels": [], "masters": [], "uuids": ["f5018a38-9af8-4fae-b45b-6e650c5626d6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:44.129341", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136975 s, 842 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136975 s, 842 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:44.372 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-NZrrFM8LGXilAJXXfjk6PKo2smByGxi71RD8jLpTfms3WR02m0GrayhlcRDJJoGY'], u'uuids': [u'e612a85e-f0bf-4349-a7ff-4eba2016aa6c']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.094827", "end": "2020-04-02 23:21:44.335534", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-NZrrFM8LGXilAJXXfjk6PKo2smByGxi71RD8jLpTfms3WR02m0GrayhlcRDJJoGY"], "labels": [], "masters": [], "uuids": ["e612a85e-f0bf-4349-a7ff-4eba2016aa6c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:44.240707", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0921316 s, 1.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0921316 s, 1.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:44.626 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-JYbcasVrcfnkIhA0JceiRPRC6ReaLZA4p91IfgVyLgccfmyy0839fsQOx6a4bpTi'], u'uuids': [u'b7b83fd5-cc73-49e9-b8ff-d3cb5a51e570']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.140813", "end": "2020-04-02 23:21:44.604498", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-JYbcasVrcfnkIhA0JceiRPRC6ReaLZA4p91IfgVyLgccfmyy0839fsQOx6a4bpTi"], "labels": [], "masters": [], "uuids": ["b7b83fd5-cc73-49e9-b8ff-d3cb5a51e570"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:44.463685", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138161 s, 835 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138161 s, 835 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:44.670 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-NZrrFM8LGXilAJXXfjk6PKo2smByGxi7aFRbvPFUYq10MSKcrAX0z8FjswHm1v5J'], u'uuids': [u'8651736f-6cff-4b9a-9425-cb57d45dd267']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.094367", "end": "2020-04-02 23:21:44.639869", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-NZrrFM8LGXilAJXXfjk6PKo2smByGxi7aFRbvPFUYq10MSKcrAX0z8FjswHm1v5J"], "labels": [], "masters": [], "uuids": ["8651736f-6cff-4b9a-9425-cb57d45dd267"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:44.545502", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0916598 s, 1.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0916598 s, 1.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:44.963 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-NZrrFM8LGXilAJXXfjk6PKo2smByGxi7f8OrkEmNdbNBG5hG7ge5NjcGOiY27wIm'], u'uuids': [u'4e339441-5d85-4851-9ff3-19db3b25e25d']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.095061", "end": "2020-04-02 23:21:44.940628", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-NZrrFM8LGXilAJXXfjk6PKo2smByGxi7f8OrkEmNdbNBG5hG7ge5NjcGOiY27wIm"], "labels": [], "masters": [], "uuids": ["4e339441-5d85-4851-9ff3-19db3b25e25d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:44.845567", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0923693 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0923693 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:44.976 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-JYbcasVrcfnkIhA0JceiRPRC6ReaLZA4hiazunm8q2iTJOZ1rwv09M7GENbuCgng'], u'uuids': [u'9c525c44-9358-4f38-807f-08d839daee5e']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.138251", "end": "2020-04-02 23:21:44.938762", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-JYbcasVrcfnkIhA0JceiRPRC6ReaLZA4hiazunm8q2iTJOZ1rwv09M7GENbuCgng"], "labels": [], "masters": [], "uuids": ["9c525c44-9358-4f38-807f-08d839daee5e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:44.800511", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135624 s, 850 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135624 s, 850 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:45.019 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:45 +0000 (0:00:01.564) 0:02:03.057 ******** 2020-04-02T23:21:45.268 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-NZrrFM8LGXilAJXXfjk6PKo2smByGxi7sxsJchBtcws6hvvVkJXpdBjtvVJURGTC'], u'uuids': [u'8d1f1dc6-c702-49a2-a3dd-96632a7204da']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.094672", "end": "2020-04-02 23:21:45.237742", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-NZrrFM8LGXilAJXXfjk6PKo2smByGxi7sxsJchBtcws6hvvVkJXpdBjtvVJURGTC"], "labels": [], "masters": [], "uuids": ["8d1f1dc6-c702-49a2-a3dd-96632a7204da"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-02 23:21:45.143070", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0919724 s, 1.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0919724 s, 1.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:45.311 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:45 +0000 (0:00:00.291) 0:02:03.349 ******** 2020-04-02T23:21:45.317 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-04-02T23:21:45.318 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.068650", "end": "2020-04-02 23:21:45.261708", "rc": 0, "start": "2020-04-02 23:21:45.193058", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:45.369 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:45 +0000 (0:00:00.053) 0:02:03.403 ******** 2020-04-02T23:21:45.591 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.062979", "end": "2020-04-02 23:21:45.560510", "rc": 0, "start": "2020-04-02 23:21:45.497531", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:45.641 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:45 +0000 (0:00:00.276) 0:02:03.679 ******** 2020-04-02T23:21:45.649 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-04-02T23:21:45.650 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.048022", "end": "2020-04-02 23:21:45.584265", "rc": 0, "start": "2020-04-02 23:21:45.536243", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:45.694 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:45 +0000 (0:00:00.050) 0:02:03.729 ******** 2020-04-02T23:21:45.718 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-04-02T23:21:45.760 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:45 +0000 (0:00:00.068) 0:02:03.798 ******** 2020-04-02T23:21:45.799 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:45.843 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:45 +0000 (0:00:00.079) 0:02:03.877 ******** 2020-04-02T23:21:45.878 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:45.936 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:45 +0000 (0:00:00.095) 0:02:03.973 ******** 2020-04-02T23:21:45.942 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-04-02T23:21:45.942 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.047295", "end": "2020-04-02 23:21:45.871283", "rc": 0, "start": "2020-04-02 23:21:45.823988", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:45.983 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:45 +0000 (0:00:00.047) 0:02:04.021 ******** 2020-04-02T23:21:45.990 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:46.041 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:46 +0000 (0:00:00.051) 0:02:04.073 ******** 2020-04-02T23:21:46.042 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-04-02T23:21:46.088 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:46 +0000 (0:00:00.052) 0:02:04.125 ******** 2020-04-02T23:21:46.094 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-04-02T23:21:46.096 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:46.136 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:46 +0000 (0:00:00.047) 0:02:04.173 ******** 2020-04-02T23:21:46.142 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-04-02T23:21:46.142 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:46.188 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:46 +0000 (0:00:00.052) 0:02:04.225 ******** 2020-04-02T23:21:46.216 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-04-02T23:21:46.217 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:46.257 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:46 +0000 (0:00:00.068) 0:02:04.294 ******** 2020-04-02T23:21:46.295 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-02T23:21:46.297 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:46.349 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:46 +0000 (0:00:00.092) 0:02:04.386 ******** 2020-04-02T23:21:46.356 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi084.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:21:46.407 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:46 +0000 (0:00:00.057) 0:02:04.444 ******** 2020-04-02T23:21:46.414 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-04-02T23:21:46.416 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:46.456 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:46 +0000 (0:00:00.049) 0:02:04.494 ******** 2020-04-02T23:21:46.463 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi084.front.sepia.ceph.com] => (item={u'block_used': 12911795, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183313, u'size_available': 930542850048, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990059, u'device': u'/dev/sda1', u'inode_used': 64917, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183313, "block_size": 4096, "block_total": 240095108, "block_used": 12911795, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990059, "inode_total": 61054976, "inode_used": 64917, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542850048, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:46.505 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:46 +0000 (0:00:00.048) 0:02:04.543 ******** 2020-04-02T23:21:46.533 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:46.578 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:46 +0000 (0:00:00.069) 0:02:04.612 ******** 2020-04-02T23:21:46.609 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:46.655 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:46 +0000 (0:00:00.080) 0:02:04.692 ******** 2020-04-02T23:21:46.672 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-04-02T23:21:46.673 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-02T23:21:46.712 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:46 +0000 (0:00:00.057) 0:02:04.749 ******** 2020-04-02T23:21:46.723 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:46.767 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:46 +0000 (0:00:00.055) 0:02:04.805 ******** 2020-04-02T23:21:46.773 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-02T23:21:46.774 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={u'block_used': 12911805, u'uuid': u'02783226-4726-4004-a66c-c6bc58415d09', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227183303, u'size_available': 930542809088, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990067, u'device': u'/dev/sda1', u'inode_used': 64909, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227183303, "block_size": 4096, "block_total": 240095108, "block_used": 12911805, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990067, "inode_total": 61054976, "inode_used": 64909, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930542809088, "size_total": 983429562368, "uuid": "02783226-4726-4004-a66c-c6bc58415d09"}, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:46.821 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:46 +0000 (0:00:00.053) 0:02:04.858 ******** 2020-04-02T23:21:46.827 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-04-02T23:21:46.829 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:46.875 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:46 +0000 (0:00:00.054) 0:02:04.912 ******** 2020-04-02T23:21:46.883 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-04-02T23:21:46.884 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:46.939 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:46 +0000 (0:00:00.063) 0:02:04.976 ******** 2020-04-02T23:21:46.947 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-04-02T23:21:46.947 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:46.987 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:46 +0000 (0:00:00.048) 0:02:05.025 ******** 2020-04-02T23:21:46.993 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:21:46.994 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:47.033 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:47 +0000 (0:00:00.045) 0:02:05.070 ******** 2020-04-02T23:21:47.038 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-04-02T23:21:47.039 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:47.090 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:47 +0000 (0:00:00.056) 0:02:05.127 ******** 2020-04-02T23:21:47.096 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:21:47.096 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:47.136 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:47 +0000 (0:00:00.045) 0:02:05.173 ******** 2020-04-02T23:21:47.162 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-04-02T23:21:47.163 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:47.202 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:47 +0000 (0:00:00.066) 0:02:05.240 ******** 2020-04-02T23:21:47.232 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-04-02T23:21:47.233 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:47.268 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:47 +0000 (0:00:00.066) 0:02:05.306 ******** 2020-04-02T23:21:47.306 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-04-02T23:21:47.308 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:47.351 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:47 +0000 (0:00:00.083) 0:02:05.389 ******** 2020-04-02T23:21:47.852 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-04-02T23:21:47.853 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-04-02T23:21:47.855 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-04-02T23:21:47.896 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:47 +0000 (0:00:00.544) 0:02:05.934 ******** 2020-04-02T23:21:47.937 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:47 +0000 (0:00:00.037) 0:02:05.972 ******** 2020-04-02T23:21:48.594 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-02T23:21:48.595 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:21:48.923 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:21:48.955 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:21:49.265 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:21:49.306 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:21:49.613 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:21:49.681 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:21:49.960 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:21:50.003 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:50 +0000 (0:00:02.067) 0:02:08.039 ******** 2020-04-02T23:21:50.029 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-02T23:21:50.070 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:50 +0000 (0:00:00.067) 0:02:08.107 ******** 2020-04-02T23:21:50.213 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-02T23:21:50.213 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-04-02T23:21:50.262 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:50 +0000 (0:00:00.191) 0:02:08.299 ******** 2020-04-02T23:21:50.279 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-04-02T23:21:50.324 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:50 +0000 (0:00:00.062) 0:02:08.361 ******** 2020-04-02T23:21:50.341 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-02T23:21:50.343 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:50.364 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:50.535 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:21:50.582 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:21:50.736 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:21:50.771 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:21:50.929 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:21:50.987 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:21:51.124 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:21:51.170 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:51 +0000 (0:00:00.846) 0:02:09.208 ******** 2020-04-02T23:21:51.177 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-02T23:21:51.224 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:51 +0000 (0:00:00.053) 0:02:09.262 ******** 2020-04-02T23:21:51.383 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-04-02T23:21:51.384 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:21:51.421 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:51 +0000 (0:00:00.197) 0:02:09.459 ******** 2020-04-02T23:21:51.461 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-02T23:21:51.462 INFO:teuthology.task.ansible.out: 2020-04-02T23:21:51.463 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-04-02T23:21:51.463 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-04-02T23:21:51.502 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:51 +0000 (0:00:00.080) 0:02:09.539 ******** 2020-04-02T23:21:51.544 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:51 +0000 (0:00:00.039) 0:02:09.579 ******** 2020-04-02T23:21:51.548 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-04-02T23:21:51.597 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:51 +0000 (0:00:00.056) 0:02:09.635 ******** 2020-04-02T23:21:52.093 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-04-02T23:21:52.095 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true} 2020-04-02T23:21:52.145 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:52 +0000 (0:00:00.547) 0:02:10.182 ******** 2020-04-02T23:21:52.781 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-04-02T23:21:52.782 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-04-02T23:21:52.836 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:52 +0000 (0:00:00.690) 0:02:10.873 ******** 2020-04-02T23:21:52.862 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-04-02T23:21:52.864 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:52.902 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:52 +0000 (0:00:00.066) 0:02:10.939 ******** 2020-04-02T23:21:52.931 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:52.974 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:52 +0000 (0:00:00.071) 0:02:11.011 ******** 2020-04-02T23:21:53.005 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-04-02T23:21:53.006 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:53.043 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:53 +0000 (0:00:00.069) 0:02:11.080 ******** 2020-04-02T23:21:53.077 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:53.120 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:53 +0000 (0:00:00.077) 0:02:11.157 ******** 2020-04-02T23:21:53.147 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-04-02T23:21:53.149 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:53.190 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:53 +0000 (0:00:00.069) 0:02:11.227 ******** 2020-04-02T23:21:53.197 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-04-02T23:21:53.198 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true} 2020-04-02T23:21:53.238 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:53 +0000 (0:00:00.047) 0:02:11.275 ******** 2020-04-02T23:21:53.243 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-04-02T23:21:53.244 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:53.282 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:53 +0000 (0:00:00.044) 0:02:11.319 ******** 2020-04-02T23:21:53.308 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-04-02T23:21:53.310 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:53.346 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:53 +0000 (0:00:00.063) 0:02:11.383 ******** 2020-04-02T23:21:53.374 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:53.412 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:53 +0000 (0:00:00.066) 0:02:11.450 ******** 2020-04-02T23:21:53.414 INFO:teuthology.task.ansible.out: 2020-04-02T23:21:53.439 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-04-02T23:21:53.440 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:53.478 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:53 +0000 (0:00:00.064) 0:02:11.515 ******** 2020-04-02T23:21:53.504 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-04-02T23:21:53.506 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:53.539 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:53 +0000 (0:00:00.062) 0:02:11.577 ******** 2020-04-02T23:21:53.566 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-04-02T23:21:53.568 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-04-02T23:21:53.611 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:53 +0000 (0:00:00.071) 0:02:11.648 ******** 2020-04-02T23:21:53.628 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-04-02T23:21:53.630 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:53.668 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:53 +0000 (0:00:00.057) 0:02:11.706 ******** 2020-04-02T23:21:53.674 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-04-02T23:21:53.676 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:53.715 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:53 +0000 (0:00:00.046) 0:02:11.752 ******** 2020-04-02T23:21:53.743 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-04-02T23:21:53.745 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:53.788 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:53 +0000 (0:00:00.072) 0:02:11.825 ******** 2020-04-02T23:21:53.814 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-04-02T23:21:53.823 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:53.858 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:53 +0000 (0:00:00.070) 0:02:11.896 ******** 2020-04-02T23:21:53.887 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-04-02T23:21:53.888 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:53.937 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:53 +0000 (0:00:00.079) 0:02:11.975 ******** 2020-04-02T23:21:53.976 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-04-02T23:21:53.978 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:54.027 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:54 +0000 (0:00:00.089) 0:02:12.064 ******** 2020-04-02T23:21:54.064 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-04-02T23:21:54.065 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:54.105 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:54 +0000 (0:00:00.078) 0:02:12.143 ******** 2020-04-02T23:21:54.131 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-04-02T23:21:54.133 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:54.178 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:54 +0000 (0:00:00.073) 0:02:12.216 ******** 2020-04-02T23:21:54.187 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-04-02T23:21:54.232 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:54 +0000 (0:00:00.049) 0:02:12.265 ******** 2020-04-02T23:21:54.234 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-04-02T23:21:54.234 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:54.273 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:54 +0000 (0:00:00.045) 0:02:12.310 ******** 2020-04-02T23:21:54.304 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:54.339 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:54 +0000 (0:00:00.066) 0:02:12.377 ******** 2020-04-02T23:21:54.376 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:54.416 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:54 +0000 (0:00:00.077) 0:02:12.454 ******** 2020-04-02T23:21:54.467 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-04-02T23:21:54.469 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:54.507 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:54 +0000 (0:00:00.090) 0:02:12.545 ******** 2020-04-02T23:21:54.556 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-04-02T23:21:54.560 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-04-02 23:19:00 UTC", "ActiveEnterTimestampMonotonic": "14693901", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "ntpd.service ntpdate.service tmp.mount systemd-journald.socket systemd-tmpfiles-setup.service sysinit.target -.mount system.slice sntp.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-04-02 23:18:58 UTC", "AssertTimestampMonotonic": "13293956", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-04-02 23:18:58 UTC", "ConditionTimestampMonotonic": "13293896", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-04-02T23:21:54.561 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2341", "ExecMainStartTimestamp": "Thu 2020-04-02 23:19:00 UTC", "ExecMainStartTimestampMonotonic": "14583312", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-04-02 23:18:59 UTC", "InactiveExitTimestampMonotonic": "13494488", "InvocationID": "c999cdfbeb1e4dc580f42ea1c614f786", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-04-02T23:21:54.563 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127461", "LimitNPROCSoft": "127461", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127461", "LimitSIGPENDINGSoft": "127461", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2341", "MemoryAccounting": "yes", "MemoryCurrent": "3014656", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-04-02T23:21:54.564 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-04-02 23:19:00 UTC", "StateChangeTimestampMonotonic": "14693901", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-04-02 23:19:00 UTC", "WatchdogTimestampMonotonic": "14583326", "WatchdogUSec": "0"}} 2020-04-02T23:21:54.604 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:54 +0000 (0:00:00.096) 0:02:12.641 ******** 2020-04-02T23:21:54.631 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-04-02T23:21:54.632 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:54.694 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:54 +0000 (0:00:00.090) 0:02:12.731 ******** 2020-04-02T23:21:54.721 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:54.764 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:54 +0000 (0:00:00.069) 0:02:12.801 ******** 2020-04-02T23:21:54.794 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:54.832 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:54 +0000 (0:00:00.068) 0:02:12.869 ******** 2020-04-02T23:21:55.036 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-04-02T23:21:55.037 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-04-02T23:21:55.080 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:55 +0000 (0:00:00.247) 0:02:13.117 ******** 2020-04-02T23:21:55.084 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-04-02T23:21:55.085 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "gid": 1212, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-04-02T23:21:55.129 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:55 +0000 (0:00:00.048) 0:02:13.166 ******** 2020-04-02T23:21:55.389 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-04-02T23:21:55.391 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-04-02 23:19:18 UTC", "ActiveEnterTimestampMonotonic": "12035271", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service system.slice basic.target sntp.service -.mount ntpd.service ntpdate.service tmp.mount sysinit.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-04-02 23:19:17 UTC", "AssertTimestampMonotonic": "10982949", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-04-02 23:19:17 UTC", "ConditionTimestampMonotonic": "10982785", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service ntpd.service shutdown.target", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-04-02T23:21:55.393 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2328", "ExecMainStartTimestamp": "Thu 2020-04-02 23:19:18 UTC", "ExecMainStartTimestampMonotonic": "12000794", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "1844674 2020-04-02T23:21:55.399 INFO:teuthology.task.ansible.out:4073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-04-02 23:19:17 UTC", "InactiveExitTimestampMonotonic": "11102219", "InvocationID": "caf9b1b5879e43a6b07af2d17a6d3ef6", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127436", "LimitNPROCSoft": "127436", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127436", "LimitSIGPENDINGSoft": "127436", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2328", "MemoryAccounting": "yes", "MemoryCurrent": "2871296", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdj 2020-04-02T23:21:55.401 INFO:teuthology.task.ansible.out:ust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-04-02 23:19:18 UTC", "StateChangeTimestampMonotonic": "12035271", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", 2020-04-02T23:21:55.402 INFO:teuthology.task.ansible.out: "WatchdogTimestamp": "Thu 2020-04-02 23:19:18 UTC", "WatchdogTimestampMonotonic": "12000805", "WatchdogUSec": "0"}} 2020-04-02T23:21:55.443 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:55 +0000 (0:00:00.314) 0:02:13.481 ******** 2020-04-02T23:21:55.476 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:55.519 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:55 +0000 (0:00:00.075) 0:02:13.556 ******** 2020-04-02T23:21:55.546 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-04-02T23:21:55.548 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:55.590 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:55 +0000 (0:00:00.070) 0:02:13.627 ******** 2020-04-02T23:21:55.617 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-04-02T23:21:55.618 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:55.661 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:55 +0000 (0:00:00.070) 0:02:13.698 ******** 2020-04-02T23:21:55.666 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-04-02T23:21:55.667 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1212, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-04-02T23:21:55.714 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:55 +0000 (0:00:00.052) 0:02:13.751 ******** 2020-04-02T23:21:55.868 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-04-02T23:21:55.869 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "gid": 1212, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-04-02T23:21:55.908 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:55 +0000 (0:00:00.194) 0:02:13.945 ******** 2020-04-02T23:21:56.416 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-04-02T23:21:56.423 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1212, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-04-02T23:21:56.487 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:56 +0000 (0:00:00.579) 0:02:14.525 ******** 2020-04-02T23:21:57.109 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-04-02T23:21:57.110 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-04-02T23:21:57.152 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:57 +0000 (0:00:00.664) 0:02:15.189 ******** 2020-04-02T23:21:57.185 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:57.222 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:57 +0000 (0:00:00.070) 0:02:15.259 ******** 2020-04-02T23:21:57.260 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi042.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2020-04-02T23:21:57.300 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:57 +0000 (0:00:00.077) 0:02:15.337 ******** 2020-04-02T23:21:57.484 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-04-02T23:21:57.485 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-04-02T23:21:57.526 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:57 +0000 (0:00:00.226) 0:02:15.563 ******** 2020-04-02T23:21:57.532 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-04-02T23:21:57.532 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-04-02T23:21:57.572 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:57 +0000 (0:00:00.046) 0:02:15.610 ******** 2020-04-02T23:21:57.578 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-04-02T23:21:57.580 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:57.636 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:57 +0000 (0:00:00.064) 0:02:15.674 ******** 2020-04-02T23:21:57.641 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-04-02T23:21:57.643 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:57.698 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:57 +0000 (0:00:00.061) 0:02:15.735 ******** 2020-04-02T23:21:57.707 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-04-02T23:21:57.711 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-04-02T23:21:57.751 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:57 +0000 (0:00:00.053) 0:02:15.789 ******** 2020-04-02T23:21:57.758 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi042.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-04-02T23:21:57.801 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:57 +0000 (0:00:00.046) 0:02:15.835 ******** 2020-04-02T23:21:57.825 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-04-02T23:21:57.826 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:57.870 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:57 +0000 (0:00:00.071) 0:02:15.907 ******** 2020-04-02T23:21:57.943 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-04-02T23:21:57.944 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-04-02T23:21:57.989 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:57 +0000 (0:00:00.118) 0:02:16.026 ******** 2020-04-02T23:21:58.017 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:58.075 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:58 +0000 (0:00:00.084) 0:02:16.111 ******** 2020-04-02T23:21:58.095 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi042.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-04-02T23:21:58.137 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:58 +0000 (0:00:00.063) 0:02:16.175 ******** 2020-04-02T23:21:58.145 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi084.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-04-02T23:21:58.187 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:58 +0000 (0:00:00.048) 0:02:16.223 ******** 2020-04-02T23:21:58.214 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:58.284 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:58 +0000 (0:00:00.098) 0:02:16.322 ******** 2020-04-02T23:21:58.342 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-04-02T23:21:58.352 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-04-02T23:21:58.404 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:58 +0000 (0:00:00.119) 0:02:16.441 ******** 2020-04-02T23:21:58.430 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-04-02T23:21:58.432 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:58.467 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:58 +0000 (0:00:00.063) 0:02:16.505 ******** 2020-04-02T23:21:58.484 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-04-02T23:21:58.486 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-04-02T23:21:58.539 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:58 +0000 (0:00:00.071) 0:02:16.576 ******** 2020-04-02T23:21:58.543 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-04-02T23:21:58.543 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:58.545 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:58.545 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:58.547 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:58.587 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:58 +0000 (0:00:00.048) 0:02:16.625 ******** 2020-04-02T23:21:58.630 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-04-02T23:21:58.633 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:58.646 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi042.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:58.667 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:58.706 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:58 +0000 (0:00:00.118) 0:02:16.743 ******** 2020-04-02T23:21:58.741 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi084.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:58.775 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:58 +0000 (0:00:00.069) 0:02:16.812 ******** 2020-04-02T23:21:58.809 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:58 +0000 (0:00:00.033) 0:02:16.846 ******** 2020-04-02T23:21:58.825 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:58.855 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:58 +0000 (0:00:00.046) 0:02:16.892 ******** 2020-04-02T23:21:58.873 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:58.901 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:58 +0000 (0:00:00.046) 0:02:16.939 ******** 2020-04-02T23:21:58.907 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-04-02T23:21:58.909 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:58.964 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:58 +0000 (0:00:00.055) 0:02:16.994 ******** TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi084.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:58.979 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:58.981 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-04-02T23:21:59.021 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:59 +0000 (0:00:00.064) 0:02:17.058 ******** 2020-04-02T23:21:59.028 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-04-02T23:21:59.028 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:59.093 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:59 +0000 (0:00:00.071) 0:02:17.129 ******** 2020-04-02T23:21:59.099 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-04-02T23:21:59.101 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:59.102 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi084.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:59.104 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:59.105 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:59.149 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:59 +0000 (0:00:00.056) 0:02:17.186 ******** 2020-04-02T23:21:59.154 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-04-02T23:21:59.156 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:59.198 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:59 +0000 (0:00:00.048) 0:02:17.235 ******** 2020-04-02T23:21:59.203 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-02T23:21:59.205 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:59.255 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:59 +0000 (0:00:00.057) 0:02:17.292 ******** 2020-04-02T23:21:59.265 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:59.307 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:59 +0000 (0:00:00.052) 0:02:17.344 ******** 2020-04-02T23:21:59.313 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-04-02T23:21:59.315 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:59.365 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:59 +0000 (0:00:00.057) 0:02:17.402 ******** 2020-04-02T23:21:59.370 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-04-02T23:21:59.371 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:59.414 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:59 +0000 (0:00:00.049) 0:02:17.452 ******** 2020-04-02T23:21:59.420 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-04-02T23:21:59.422 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:59.465 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:59 +0000 (0:00:00.051) 0:02:17.503 ******** 2020-04-02T23:21:59.472 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-02T23:21:59.473 INFO:teuthology.task.ansible.out:skipping: [smithi042.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:59.515 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:59 +0000 (0:00:00.049) 0:02:17.552 ******** 2020-04-02T23:21:59.522 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:59.566 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:59 +0000 (0:00:00.050) 0:02:17.603 ******** 2020-04-02T23:21:59.592 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-04-02T23:21:59.594 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:59.636 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:59 +0000 (0:00:00.070) 0:02:17.673 ******** 2020-04-02T23:21:59.663 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-02T23:21:59.665 INFO:teuthology.task.ansible.out:skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:59.714 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:59 +0000 (0:00:00.078) 0:02:17.752 ******** 2020-04-02T23:21:59.745 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:59.784 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:59 +0000 (0:00:00.069) 0:02:17.822 ******** 2020-04-02T23:21:59.793 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi042.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005390", "end": "2020-04-02 23:21:59.718990", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-04-02 23:21:59.713600", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:21:59.805 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi084.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-02T23:21:59.842 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:21:59 +0000 (0:00:00.058) 0:02:17.880 ******** 2020-04-02T23:21:59.973 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi042.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003050", "end": "2020-04-02 23:21:59.925779", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-04-02 23:21:59.922729", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:22:00.073 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004944", "end": "2020-04-02 23:22:00.031832", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-04-02 23:22:00.026888", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:22:00.180 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002959", "end": "2020-04-02 23:22:00.135272", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-04-02 23:22:00.132313", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-04-02T23:22:00.255 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003100", "end": "2020-04-02 23:22:00.222007", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-04-02 23:22:00.218907", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:22:00.396 INFO:teuthology.task.ansible.out:ok: [smithi042.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.019047", "end": "2020-04-02 23:22:00.352145", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-04-02 23:22:00.333098", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:22:00.444 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:22:00 +0000 (0:00:00.602) 0:02:18.482 ******** 2020-04-02T23:22:00.456 INFO:teuthology.task.ansible.out:ok: [smithi084.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002839", "end": "2020-04-02 23:22:00.404598", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-04-02 23:22:00.401759", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-04-02T23:22:00.479 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-04-02T23:22:00.524 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:22:00 +0000 (0:00:00.074) 0:02:18.556 ******** 2020-04-02T23:22:00.644 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi084.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.015248", "end": "2020-04-02 23:22:00.605003", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-04-02 23:22:00.589755", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-02T23:22:00.690 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:22:00 +0000 (0:00:00.171) 0:02:18.728 ******** 2020-04-02T23:22:00.720 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-04-02T23:22:00.754 INFO:teuthology.task.ansible.out:Thursday 02 April 2020 23:22:00 +0000 (0:00:00.063) 0:02:18.791 ******** 2020-04-02T23:22:00.759 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-04-02T23:22:00.760 INFO:teuthology.task.ansible.out:changed: [smithi042.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-02T23:22:00.947 INFO:teuthology.task.ansible.out:changed: [smithi084.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-02T23:22:01.095 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** 2020-04-02T23:22:01.096 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-04-02T23:22:01.098 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** 2020-04-02T23:22:01.099 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-04-02T23:22:01.101 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** 2020-04-02T23:22:01.103 INFO:teuthology.task.ansible.out:skipping: no hosts matched PLAY RECAP ********************************************************************* smithi042.front.sepia.ceph.com : ok=111 changed=33 unreachable=0 failed=0 skipped=172 rescued=0 ignored=3 smithi084.front.sepia.ceph.com : ok=111 changed=33 unreachable=0 failed=0 skipped=172 rescued=0 ignored=3 Thursday 02 April 2020 23:22:01 +0000 (0:00:00.348) 0:02:19.139 ******** =============================================================================== 2020-04-02T23:22:01.103 INFO:teuthology.task.ansible.out:common : nrpe - Remove SELinux policy package -------------------------- 16.53s common : nrpe - Load SELinux policy package ---------------------------- 15.88s testnode : Zap all non-root disks --------------------------------------- 7.68s testnode : Install packages --------------------------------------------- 7.02s testnode : Base group workaround for BZ1782899 -------------------------- 4.73s common : Install Kerberos Packages (RedHat) ----------------------------- 3.15s 2020-04-02T23:22:01.103 INFO:teuthology.task.ansible.out:Gathering Facts --------------------------------------------------------- 2.69s testnode : Ensure ceph dependency packages are not present. ------------- 2.08s testnode : Create logical volume(s) ------------------------------------- 2.07s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.56s 2020-04-02T23:22:01.103 INFO:teuthology.task.ansible.out:testnode : Ensure ceph packages are not present. ------------------------ 1.56s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 1.39s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 1.26s testnode : Rebuild rpmdb ------------------------------------------------ 1.18s 2020-04-02T23:22:01.103 INFO:teuthology.task.ansible.out:common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 1.10s common : Set the hardware clock ----------------------------------------- 1.07s common : Configure local epel mirrorlists ------------------------------- 0.97s common : Configure epel repos in /etc/yum.repos.d/ ----------------- 2020-04-02T23:22:01.105 INFO:teuthology.task.ansible.out:----- 0.96s common : Make sure smartmontools is installed --------------------------- 0.93s ansible-managed : Add authorized keys for the ansible user. ------------- 0.87s 2020-04-02T23:22:01.398 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi042.front.sepia.ceph.com')] 2020-04-02T23:22:01.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:22:01.401 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi084.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:22:01.478 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:22:01.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-02T23:22:01.570 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi042.front.sepia.ceph.com', 'timeout': 60} 2020-04-02T23:22:01.684 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:22:01.779 INFO:teuthology.run_tasks:Running task clock... 2020-04-02T23:22:01.792 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-04-02T23:22:01.792 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:22:01.807 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-04-02T23:22:01.808 INFO:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-04-02T23:22:01.916 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-04-02T23:22:01.917 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-04-02T23:22:01.949 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2020-04-02T23:22:01.967 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2020-04-02T23:22:01.984 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-04-02T23:22:01.992 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-04-02T23:22:02.057 INFO:teuthology.orchestra.run.smithi084.stderr:bash: ntpq: command not found 2020-04-02T23:22:02.085 INFO:teuthology.orchestra.run.smithi084.stdout:210 Number of sources = 4 2020-04-02T23:22:02.085 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-04-02T23:22:02.086 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2020-04-02T23:22:02.086 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:22:02.086 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:22:02.086 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:22:02.086 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:22:02.086 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:22:02.107 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-04-02T23:22:02.107 INFO:teuthology.orchestra.run.smithi042:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-04-02T23:22:02.215 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-04-02T23:22:02.217 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-04-02T23:22:02.294 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: ntpd: command not found 2020-04-02T23:22:02.311 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-04-02T23:22:02.316 INFO:teuthology.orchestra.run.smithi042.stdout:506 Cannot talk to daemon 2020-04-02T23:22:02.346 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-04-02T23:22:02.411 INFO:teuthology.orchestra.run.smithi042.stderr:bash: ntpq: command not found 2020-04-02T23:22:02.433 INFO:teuthology.orchestra.run.smithi042.stdout:210 Number of sources = 4 2020-04-02T23:22:02.434 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-04-02T23:22:02.434 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2020-04-02T23:22:02.434 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:22:02.434 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:22:02.434 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:22:02.434 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-02T23:22:02.435 INFO:teuthology.run_tasks:Running task install... 2020-04-02T23:22:02.449 DEBUG:teuthology.task.install:project ceph 2020-04-02T23:22:02.449 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'}} 2020-04-02T23:22:02.449 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'} 2020-04-02T23:22:02.449 INFO:teuthology.task.install:Using flavor: basic 2020-04-02T23:22:02.475 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-04-02T23:22:02.475 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-04-02T23:22:02.475 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:22:02.491 INFO:teuthology.orchestra.run.smithi084:> sudo lsb_release -is 2020-04-02T23:22:02.569 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS 2020-04-02T23:22:02.570 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:22:02.571 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:22:02.571 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'flavor': 'basic', 'extras': None} 2020-04-02T23:22:02.571 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:22:02.585 INFO:teuthology.orchestra.run.smithi042:> sudo lsb_release -is 2020-04-02T23:22:02.636 INFO:teuthology.orchestra.run.smithi084:> sudo lsb_release -is 2020-04-02T23:22:02.675 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS 2020-04-02T23:22:02.676 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:22:02.676 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'flavor': 'basic', 'extras': None} 2020-04-02T23:22:02.676 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:22:02.712 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS 2020-04-02T23:22:02.713 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:22:02.714 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:22:02.731 INFO:teuthology.orchestra.run.smithi042:> sudo lsb_release -is 2020-04-02T23:22:02.817 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS 2020-04-02T23:22:02.817 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:22:02.818 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:22:02.954 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/ 2020-04-02T23:22:02.955 INFO:teuthology.task.install.rpm:Package version is 16.0.0-316.gcbb84f7 2020-04-02T23:22:03.089 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/ 2020-04-02T23:22:03.089 INFO:teuthology.task.install.rpm:Package version is 16.0.0-316.gcbb84f7 2020-04-02T23:22:03.141 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-04-02T23:22:03.141 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:22:03.156 INFO:teuthology.orchestra.run.smithi084:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-04-02T23:22:03.241 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel on remote rpm x86_64 2020-04-02T23:22:03.242 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:22:03.277 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-greg-testing-42/cbb84f71d70460f911296715ab61ac09c6962b17/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-04-02T23:22:03.277 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:22:03.296 INFO:teuthology.orchestra.run.smithi042:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-04-02T23:22:03.297 INFO:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cbb84f71d70460f911296715ab61ac09c6962b17/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-04-02T23:22:03.369 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:22:03.382 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel on remote rpm x86_64 2020-04-02T23:22:03.383 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:22:03.418 INFO:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-04-02T23:22:03.438 INFO:teuthology.orchestra.run.smithi042:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cbb84f71d70460f911296715ab61ac09c6962b17/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-04-02T23:22:03.500 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:22:03.513 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:22:03.554 INFO:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-04-02T23:22:03.569 INFO:teuthology.orchestra.run.smithi042:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-04-02T23:22:03.621 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2020-04-02T23:22:03.622 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:22:03.660 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:22:03.674 INFO:teuthology.orchestra.run.smithi042:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-04-02T23:22:03.675 INFO:teuthology.orchestra.run.smithi084:> sudo yum clean all 2020-04-02T23:22:03.745 INFO:teuthology.orchestra.run.smithi042.stdout:check_obsoletes = 1 2020-04-02T23:22:03.747 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:22:03.801 INFO:teuthology.orchestra.run.smithi042:> sudo yum clean all 2020-04-02T23:22:03.951 INFO:teuthology.orchestra.run.smithi084.stdout:50 files removed 2020-04-02T23:22:03.982 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:22:03.996 INFO:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel 2020-04-02T23:22:04.097 INFO:teuthology.orchestra.run.smithi042.stdout:50 files removed 2020-04-02T23:22:04.127 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:22:04.141 INFO:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel 2020-04-02T23:22:04.759 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 180 kB/s | 69 kB 00:00 2020-04-02T23:22:04.935 INFO:teuthology.orchestra.run.smithi042.stdout:ceph packages for x86_64 180 kB/s | 69 kB 00:00 2020-04-02T23:22:05.100 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 45 kB/s | 14 kB 00:00 2020-04-02T23:22:05.278 INFO:teuthology.orchestra.run.smithi042.stdout:ceph noarch packages 45 kB/s | 14 kB 00:00 2020-04-02T23:22:05.431 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 4.5 kB/s | 1.4 kB 00:00 2020-04-02T23:22:05.594 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-8 - AppStream 48 MB/s | 6.6 MB 00:00 2020-04-02T23:22:05.614 INFO:teuthology.orchestra.run.smithi042.stdout:ceph source packages 4.5 kB/s | 1.4 kB 00:00 2020-04-02T23:22:05.797 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS-8 - AppStream 44 MB/s | 6.6 MB 00:00 2020-04-02T23:22:06.742 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-8 - Base 42 MB/s | 5.0 MB 00:00 2020-04-02T23:22:07.074 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS-8 - Base 38 MB/s | 5.0 MB 00:00 2020-04-02T23:22:07.522 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-8 - Extras 71 kB/s | 4.4 kB 00:00 2020-04-02T23:22:07.740 INFO:teuthology.orchestra.run.smithi084.stdout:Copr repo for ceph-el8 owned by ktdreyer 270 kB/s | 47 kB 00:00 2020-04-02T23:22:07.905 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS-8 - Extras 68 kB/s | 4.4 kB 00:00 2020-04-02T23:22:08.071 INFO:teuthology.orchestra.run.smithi042.stdout:Copr repo for ceph-el8 owned by ktdreyer 421 kB/s | 47 kB 00:00 2020-04-02T23:22:08.084 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 21 MB/s | 6.2 MB 00:00 2020-04-02T23:22:08.478 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 17 MB/s | 6.2 MB 00:00 2020-04-02T23:22:09.349 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 5.0 MB/s | 30 kB 00:00 2020-04-02T23:22:09.837 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 5.3 MB/s | 30 kB 00:00 2020-04-02T23:22:10.232 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-04-02T23:22:10.233 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-04-02T23:22:10.236 INFO:teuthology.orchestra.run.smithi084.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-04-02T23:22:10.236 INFO:teuthology.orchestra.run.smithi084.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-04-02T23:22:10.237 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-04-02T23:22:10.238 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-04-02T23:22:10.361 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2020-04-02T23:22:10.373 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-02T23:22:10.374 INFO:teuthology.orchestra.run.smithi084.stdout: Package ArchVersion Repository Size 2020-04-02T23:22:10.374 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-02T23:22:10.374 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2020-04-02T23:22:10.374 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_642:16.0.0-316.gcbb84f7.el8 ceph 6.4 k 2020-04-02T23:22:10.374 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_642:16.0.0-316.gcbb84f7.el8 ceph 5.6 M 2020-04-02T23:22:10.374 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_642:16.0.0-316.gcbb84f7.el8 ceph 573 k 2020-04-02T23:22:10.374 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_642:16.0.0-316.gcbb84f7.el8 ceph 203 k 2020-04-02T23:22:10.375 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.4 M 2020-04-02T23:22:10.375 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_642:16.0.0-316.gcbb84f7.el8 ceph 9.8 M 2020-04-02T23:22:10.375 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_642:16.0.0-316.gcbb84f7.el8 ceph 42 M 2020-04-02T23:22:10.375 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm x86_642:16.0.0-316.gcbb84f7.el8 ceph 39 k 2020-04-02T23:22:10.375 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_642:16.0.0-316.gcbb84f7.el8 ceph 21 k 2020-04-02T23:22:10.375 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 508 k 2020-04-02T23:22:10.375 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_642:16.0.0-316.gcbb84f7.el8 ceph 141 k 2020-04-02T23:22:10.376 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_642:16.0.0-316.gcbb84f7.el8 ceph 162 k 2020-04-02T23:22:10.376 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_642:16.0.0-316.gcbb84f7.el8 ceph 352 k 2020-04-02T23:22:10.376 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_642:16.0.0-316.gcbb84f7.el8 ceph 331 k 2020-04-02T23:22:10.376 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_642:16.0.0-316.gcbb84f7.el8 ceph 113 k 2020-04-02T23:22:10.376 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_642:16.0.0-316.gcbb84f7.el8 ceph 72 k 2020-04-02T23:22:10.376 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_642:16.0.0-316.gcbb84f7.el8 ceph 2.7 M 2020-04-02T23:22:10.376 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_642:16.0.0-316.gcbb84f7.el8 ceph 141 k 2020-04-02T23:22:10.377 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 40 k 2020-04-02T23:22:10.377 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 3.3 M 2020-04-02T23:22:10.377 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 8.6 M 2020-04-02T23:22:10.377 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 27 k 2020-04-02T23:22:10.377 INFO:teuthology.orchestra.run.smithi084.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-04-02T23:22:10.377 INFO:teuthology.orchestra.run.smithi084.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-04-02T23:22:10.377 INFO:teuthology.orchestra.run.smithi084.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-04-02T23:22:10.378 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-04-02T23:22:10.378 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-04-02T23:22:10.378 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-04-02T23:22:10.378 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel x86_641:1.1.1c-2.el8 CentOS-Base 2.3 M 2020-04-02T23:22:10.378 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-04-02T23:22:10.378 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2020-04-02T23:22:10.378 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 3.6 M 2020-04-02T23:22:10.379 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.9 M 2020-04-02T23:22:10.379 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2020-04-02T23:22:10.379 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_642:16.0.0-316.gcbb84f7.el8 ceph 21 M 2020-04-02T23:22:10.379 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_642:16.0.0-316.gcbb84f7.el8 ceph 2.0 M 2020-04-02T23:22:10.379 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_642:16.0.0-316.gcbb84f7.el8 ceph 4.4 M 2020-04-02T23:22:10.379 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_642:16.0.0-316.gcbb84f7.el8 ceph 17 M 2020-04-02T23:22:10.379 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_642:16.0.0-316.gcbb84f7.el8 ceph 25 k 2020-04-02T23:22:10.379 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_642:16.0.0-316.gcbb84f7.el8 ceph 377 k 2020-04-02T23:22:10.380 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 3.2 M 2020-04-02T23:22:10.380 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse x86_642:16.0.0-316.gcbb84f7.el8 ceph 40 k 2020-04-02T23:22:10.380 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_642:16.0.0-316.gcbb84f7.el8 ceph 62 k 2020-04-02T23:22:10.380 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 22 k 2020-04-02T23:22:10.380 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 161 k 2020-04-02T23:22:10.380 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 8.7 k 2020-04-02T23:22:10.380 INFO:teuthology.orchestra.run.smithi084.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-04-02T23:22:10.380 INFO:teuthology.orchestra.run.smithi084.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-04-02T23:22:10.381 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-04-02T23:22:10.381 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-04-02T23:22:10.381 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-04-02T23:22:10.381 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-04-02T23:22:10.381 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-04-02T23:22:10.381 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-04-02T23:22:10.381 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-04-02T23:22:10.382 INFO:teuthology.orchestra.run.smithi084.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-04-02T23:22:10.382 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-04-02T23:22:10.382 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-04-02T23:22:10.382 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-04-02T23:22:10.382 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-04-02T23:22:10.382 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-04-02T23:22:10.382 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-04-02T23:22:10.383 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-04-02T23:22:10.383 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-04-02T23:22:10.383 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-04-02T23:22:10.383 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-04-02T23:22:10.383 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-04-02T23:22:10.383 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-04-02T23:22:10.383 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-04-02T23:22:10.384 INFO:teuthology.orchestra.run.smithi084.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-04-02T23:22:10.384 INFO:teuthology.orchestra.run.smithi084.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-04-02T23:22:10.384 INFO:teuthology.orchestra.run.smithi084.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-04-02T23:22:10.384 INFO:teuthology.orchestra.run.smithi084.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-04-02T23:22:10.384 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-04-02T23:22:10.384 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-04-02T23:22:10.385 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-04-02T23:22:10.385 INFO:teuthology.orchestra.run.smithi084.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-04-02T23:22:10.385 INFO:teuthology.orchestra.run.smithi084.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-04-02T23:22:10.385 INFO:teuthology.orchestra.run.smithi084.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-04-02T23:22:10.385 INFO:teuthology.orchestra.run.smithi084.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-04-02T23:22:10.385 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-04-02T23:22:10.385 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-04-02T23:22:10.386 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-04-02T23:22:10.386 INFO:teuthology.orchestra.run.smithi084.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-04-02T23:22:10.386 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-04-02T23:22:10.386 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-04-02T23:22:10.386 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-04-02T23:22:10.386 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-04-02T23:22:10.386 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-04-02T23:22:10.387 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-04-02T23:22:10.387 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-04-02T23:22:10.387 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-04-02T23:22:10.387 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-04-02T23:22:10.387 INFO:teuthology.orchestra.run.smithi084.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-04-02T23:22:10.387 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-04-02T23:22:10.387 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-04-02T23:22:10.388 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-04-02T23:22:10.388 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch7.2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-04-02T23:22:10.388 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-04-02T23:22:10.388 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-04-02T23:22:10.388 INFO:teuthology.orchestra.run.smithi084.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-04-02T23:22:10.388 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-04-02T23:22:10.389 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-04-02T23:22:10.389 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-04-02T23:22:10.389 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-04-02T23:22:10.389 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-04-02T23:22:10.389 INFO:teuthology.orchestra.run.smithi084.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-04-02T23:22:10.389 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-04-02T23:22:10.390 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-04-02T23:22:10.390 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-04-02T23:22:10.393 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-04-02T23:22:10.393 INFO:teuthology.orchestra.run.smithi084.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-04-02T23:22:10.393 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-04-02T23:22:10.393 INFO:teuthology.orchestra.run.smithi084.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-04-02T23:22:10.393 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-04-02T23:22:10.394 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-04-02T23:22:10.394 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-04-02T23:22:10.394 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch10.0.1-2.el8 epel 1.1 M 2020-04-02T23:22:10.394 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-04-02T23:22:10.394 INFO:teuthology.orchestra.run.smithi084.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-04-02T23:22:10.394 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-04-02T23:22:10.394 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-04-02T23:22:10.395 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-04-02T23:22:10.395 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-04-02T23:22:10.395 INFO:teuthology.orchestra.run.smithi084.stdout: leveldb x86_641.21-2.el8 lab-extras 179 k 2020-04-02T23:22:10.395 INFO:teuthology.orchestra.run.smithi084.stdout:Installing weak dependencies: 2020-04-02T23:22:10.395 INFO:teuthology.orchestra.run.smithi084.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-04-02T23:22:10.395 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-04-02T23:22:10.395 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:22:10.396 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2020-04-02T23:22:10.396 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2020-04-02T23:22:10.396 INFO:teuthology.orchestra.run.smithi084.stdout:Install 123 Packages 2020-04-02T23:22:10.396 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 2 Packages 2020-04-02T23:22:10.396 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:22:10.397 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 174 M 2020-04-02T23:22:10.397 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2020-04-02T23:22:10.549 INFO:teuthology.orchestra.run.smithi084.stdout:(1/125): ceph-16.0.0-316.gcbb84f7.el8.x86_64.rp 40 kB/s | 6.4 kB 00:00 2020-04-02T23:22:10.786 INFO:teuthology.orchestra.run.smithi042.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-04-02T23:22:10.797 INFO:teuthology.orchestra.run.smithi042.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-04-02T23:22:10.797 INFO:teuthology.orchestra.run.smithi042.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-04-02T23:22:10.797 INFO:teuthology.orchestra.run.smithi042.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-04-02T23:22:10.798 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-04-02T23:22:10.798 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-04-02T23:22:10.806 INFO:teuthology.orchestra.run.smithi084.stdout:(2/125): ceph-fuse-16.0.0-316.gcbb84f7.el8.x86_ 2.2 MB/s | 573 kB 00:00 2020-04-02T23:22:10.880 INFO:teuthology.orchestra.run.smithi084.stdout:(3/125): ceph-immutable-object-cache-16.0.0-316 2.7 MB/s | 203 kB 00:00 2020-04-02T23:22:10.922 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2020-04-02T23:22:10.935 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2020-04-02T23:22:10.936 INFO:teuthology.orchestra.run.smithi042.stdout: Package ArchVersion Repository Size 2020-04-02T23:22:10.936 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2020-04-02T23:22:10.936 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2020-04-02T23:22:10.936 INFO:teuthology.orchestra.run.smithi042.stdout: ceph x86_642:16.0.0-316.gcbb84f7.el8 ceph 6.4 k 2020-04-02T23:22:10.936 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base x86_642:16.0.0-316.gcbb84f7.el8 ceph 5.6 M 2020-04-02T23:22:10.936 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse x86_642:16.0.0-316.gcbb84f7.el8 ceph 573 k 2020-04-02T23:22:10.937 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache x86_642:16.0.0-316.gcbb84f7.el8 ceph 203 k 2020-04-02T23:22:10.937 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.4 M 2020-04-02T23:22:10.937 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw x86_642:16.0.0-316.gcbb84f7.el8 ceph 9.8 M 2020-04-02T23:22:10.937 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test x86_642:16.0.0-316.gcbb84f7.el8 ceph 42 M 2020-04-02T23:22:10.937 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm x86_642:16.0.0-316.gcbb84f7.el8 ceph 39 k 2020-04-02T23:22:10.937 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel x86_642:16.0.0-316.gcbb84f7.el8 ceph 21 k 2020-04-02T23:22:10.937 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 508 k 2020-04-02T23:22:10.938 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel x86_642:16.0.0-316.gcbb84f7.el8 ceph 141 k 2020-04-02T23:22:10.938 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs x86_642:16.0.0-316.gcbb84f7.el8 ceph 162 k 2020-04-02T23:22:10.938 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados x86_642:16.0.0-316.gcbb84f7.el8 ceph 352 k 2020-04-02T23:22:10.938 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd x86_642:16.0.0-316.gcbb84f7.el8 ceph 331 k 2020-04-02T23:22:10.938 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw x86_642:16.0.0-316.gcbb84f7.el8 ceph 113 k 2020-04-02T23:22:10.938 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse x86_642:16.0.0-316.gcbb84f7.el8 ceph 72 k 2020-04-02T23:22:10.938 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror x86_642:16.0.0-316.gcbb84f7.el8 ceph 2.7 M 2020-04-02T23:22:10.938 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd x86_642:16.0.0-316.gcbb84f7.el8 ceph 141 k 2020-04-02T23:22:10.939 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 40 k 2020-04-02T23:22:10.939 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 3.3 M 2020-04-02T23:22:10.939 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 8.6 M 2020-04-02T23:22:10.939 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 27 k 2020-04-02T23:22:10.939 INFO:teuthology.orchestra.run.smithi042.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-04-02T23:22:10.939 INFO:teuthology.orchestra.run.smithi042.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-04-02T23:22:10.939 INFO:teuthology.orchestra.run.smithi042.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-04-02T23:22:10.940 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-04-02T23:22:10.940 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-04-02T23:22:10.940 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-04-02T23:22:10.940 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel x86_641:1.1.1c-2.el8 CentOS-Base 2.3 M 2020-04-02T23:22:10.940 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-04-02T23:22:10.940 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrading: 2020-04-02T23:22:10.940 INFO:teuthology.orchestra.run.smithi042.stdout: librados2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 3.6 M 2020-04-02T23:22:10.941 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1 x86_642:16.0.0-316.gcbb84f7.el8 ceph 1.9 M 2020-04-02T23:22:10.941 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2020-04-02T23:22:10.941 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common x86_642:16.0.0-316.gcbb84f7.el8 ceph 21 M 2020-04-02T23:22:10.941 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds x86_642:16.0.0-316.gcbb84f7.el8 ceph 2.0 M 2020-04-02T23:22:10.941 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon x86_642:16.0.0-316.gcbb84f7.el8 ceph 4.4 M 2020-04-02T23:22:10.941 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd x86_642:16.0.0-316.gcbb84f7.el8 ceph 17 M 2020-04-02T23:22:10.941 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux x86_642:16.0.0-316.gcbb84f7.el8 ceph 25 k 2020-04-02T23:22:10.942 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1 x86_642:16.0.0-316.gcbb84f7.el8 ceph 377 k 2020-04-02T23:22:10.942 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2 x86_642:16.0.0-316.gcbb84f7.el8 ceph 3.2 M 2020-04-02T23:22:10.942 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse x86_642:16.0.0-316.gcbb84f7.el8 ceph 40 k 2020-04-02T23:22:10.942 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common x86_642:16.0.0-316.gcbb84f7.el8 ceph 62 k 2020-04-02T23:22:10.942 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 22 k 2020-04-02T23:22:10.942 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 161 k 2020-04-02T23:22:10.942 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts noarch2:16.0.0-316.gcbb84f7.el8 ceph-noarch 8.7 k 2020-04-02T23:22:10.943 INFO:teuthology.orchestra.run.smithi042.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-04-02T23:22:10.943 INFO:teuthology.orchestra.run.smithi042.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-04-02T23:22:10.943 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-04-02T23:22:10.943 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-04-02T23:22:10.943 INFO:teuthology.orchestra.run.smithi042.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-04-02T23:22:10.943 INFO:teuthology.orchestra.run.smithi042.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-04-02T23:22:10.943 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-04-02T23:22:10.944 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-04-02T23:22:10.944 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-04-02T23:22:10.944 INFO:teuthology.orchestra.run.smithi042.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-04-02T23:22:10.944 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-04-02T23:22:10.944 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-04-02T23:22:10.944 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-04-02T23:22:10.944 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-04-02T23:22:10.945 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-04-02T23:22:10.945 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-04-02T23:22:10.945 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-04-02T23:22:10.945 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-04-02T23:22:10.945 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-04-02T23:22:10.946 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-04-02T23:22:10.946 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-04-02T23:22:10.946 INFO:teuthology.orchestra.run.smithi042.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-04-02T23:22:10.946 INFO:teuthology.orchestra.run.smithi042.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-04-02T23:22:10.946 INFO:teuthology.orchestra.run.smithi042.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-04-02T23:22:10.946 INFO:teuthology.orchestra.run.smithi042.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-04-02T23:22:10.947 INFO:teuthology.orchestra.run.smithi042.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-04-02T23:22:10.947 INFO:teuthology.orchestra.run.smithi042.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-04-02T23:22:10.947 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-04-02T23:22:10.947 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-04-02T23:22:10.947 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-04-02T23:22:10.947 INFO:teuthology.orchestra.run.smithi042.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-04-02T23:22:10.947 INFO:teuthology.orchestra.run.smithi042.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-04-02T23:22:10.948 INFO:teuthology.orchestra.run.smithi042.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-04-02T23:22:10.948 INFO:teuthology.orchestra.run.smithi042.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-04-02T23:22:10.948 INFO:teuthology.orchestra.run.smithi042.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-04-02T23:22:10.948 INFO:teuthology.orchestra.run.smithi042.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-04-02T23:22:10.948 INFO:teuthology.orchestra.run.smithi042.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-04-02T23:22:10.948 INFO:teuthology.orchestra.run.smithi042.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-04-02T23:22:10.948 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-04-02T23:22:10.949 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-04-02T23:22:10.949 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-04-02T23:22:10.949 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-04-02T23:22:10.949 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-04-02T23:22:10.949 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-04-02T23:22:10.949 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-04-02T23:22:10.950 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-04-02T23:22:10.950 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-04-02T23:22:10.950 INFO:teuthology.orchestra.run.smithi042.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-04-02T23:22:10.950 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-04-02T23:22:10.950 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-04-02T23:22:10.950 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-04-02T23:22:10.951 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools noarch7.2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-04-02T23:22:10.951 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-04-02T23:22:10.951 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-04-02T23:22:10.951 INFO:teuthology.orchestra.run.smithi042.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-04-02T23:22:10.951 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-04-02T23:22:10.951 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-04-02T23:22:10.951 INFO:teuthology.orchestra.run.smithi042.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-04-02T23:22:10.952 INFO:teuthology.orchestra.run.smithi042.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-04-02T23:22:10.952 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-04-02T23:22:10.952 INFO:teuthology.orchestra.run.smithi042.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-04-02T23:22:10.952 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-04-02T23:22:10.952 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-04-02T23:22:10.952 INFO:teuthology.orchestra.run.smithi042.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-04-02T23:22:10.952 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-04-02T23:22:10.953 INFO:teuthology.orchestra.run.smithi042.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-04-02T23:22:10.953 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-04-02T23:22:10.953 INFO:teuthology.orchestra.run.smithi042.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-04-02T23:22:10.953 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-04-02T23:22:10.953 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-04-02T23:22:10.953 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-04-02T23:22:10.954 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes noarch10.0.1-2.el8 epel 1.1 M 2020-04-02T23:22:10.954 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-04-02T23:22:10.954 INFO:teuthology.orchestra.run.smithi042.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-04-02T23:22:10.954 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-04-02T23:22:10.954 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-04-02T23:22:10.954 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-04-02T23:22:10.954 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-04-02T23:22:10.955 INFO:teuthology.orchestra.run.smithi042.stdout: leveldb x86_641.21-2.el8 lab-extras 179 k 2020-04-02T23:22:10.955 INFO:teuthology.orchestra.run.smithi042.stdout:Installing weak dependencies: 2020-04-02T23:22:10.955 INFO:teuthology.orchestra.run.smithi042.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-04-02T23:22:10.955 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-04-02T23:22:10.955 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:22:10.955 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2020-04-02T23:22:10.955 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2020-04-02T23:22:10.955 INFO:teuthology.orchestra.run.smithi042.stdout:Install 123 Packages 2020-04-02T23:22:10.956 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrade 2 Packages 2020-04-02T23:22:10.956 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:22:10.956 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 174 M 2020-04-02T23:22:10.957 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2020-04-02T23:22:11.107 INFO:teuthology.orchestra.run.smithi042.stdout:(1/125): ceph-16.0.0-316.gcbb84f7.el8.x86_64.rp 42 kB/s | 6.4 kB 00:00 2020-04-02T23:22:11.285 INFO:teuthology.orchestra.run.smithi084.stdout:(4/125): ceph-mds-16.0.0-316.gcbb84f7.el8.x86_6 5.0 MB/s | 2.0 MB 00:00 2020-04-02T23:22:11.371 INFO:teuthology.orchestra.run.smithi042.stdout:(2/125): ceph-fuse-16.0.0-316.gcbb84f7.el8.x86_ 2.1 MB/s | 573 kB 00:00 2020-04-02T23:22:11.477 INFO:teuthology.orchestra.run.smithi042.stdout:(3/125): ceph-immutable-object-cache-16.0.0-316 1.9 MB/s | 203 kB 00:00 2020-04-02T23:22:11.555 INFO:teuthology.orchestra.run.smithi084.stdout:(5/125): ceph-mgr-16.0.0-316.gcbb84f7.el8.x86_6 5.2 MB/s | 1.4 MB 00:00 2020-04-02T23:22:11.588 INFO:teuthology.orchestra.run.smithi084.stdout:(6/125): ceph-base-16.0.0-316.gcbb84f7.el8.x86_ 4.7 MB/s | 5.6 MB 00:01 2020-04-02T23:22:12.149 INFO:teuthology.orchestra.run.smithi042.stdout:(4/125): ceph-mds-16.0.0-316.gcbb84f7.el8.x86_6 3.0 MB/s | 2.0 MB 00:00 2020-04-02T23:22:12.338 INFO:teuthology.orchestra.run.smithi084.stdout:(7/125): ceph-mon-16.0.0-316.gcbb84f7.el8.x86_6 5.6 MB/s | 4.4 MB 00:00 2020-04-02T23:22:12.679 INFO:teuthology.orchestra.run.smithi042.stdout:(5/125): ceph-mgr-16.0.0-316.gcbb84f7.el8.x86_6 2.7 MB/s | 1.4 MB 00:00 2020-04-02T23:22:12.833 INFO:teuthology.orchestra.run.smithi042.stdout:(6/125): ceph-base-16.0.0-316.gcbb84f7.el8.x86_ 3.0 MB/s | 5.6 MB 00:01 2020-04-02T23:22:13.977 INFO:teuthology.orchestra.run.smithi084.stdout:(8/125): ceph-common-16.0.0-316.gcbb84f7.el8.x8 5.8 MB/s | 21 MB 00:03 2020-04-02T23:22:14.043 INFO:teuthology.orchestra.run.smithi084.stdout:(9/125): ceph-selinux-16.0.0-316.gcbb84f7.el8.x 375 kB/s | 25 kB 00:00 2020-04-02T23:22:14.183 INFO:teuthology.orchestra.run.smithi042.stdout:(7/125): ceph-mon-16.0.0-316.gcbb84f7.el8.x86_6 2.9 MB/s | 4.4 MB 00:01 2020-04-02T23:22:14.285 INFO:teuthology.orchestra.run.smithi084.stdout:(10/125): ceph-osd-16.0.0-316.gcbb84f7.el8.x86_ 6.2 MB/s | 17 MB 00:02 2020-04-02T23:22:14.341 INFO:teuthology.orchestra.run.smithi084.stdout:(11/125): ceph-radosgw-16.0.0-316.gcbb84f7.el8. 4.9 MB/s | 9.8 MB 00:02 2020-04-02T23:22:14.354 INFO:teuthology.orchestra.run.smithi084.stdout:(12/125): cephadm-16.0.0-316.gcbb84f7.el8.x86_6 666 kB/s | 39 kB 00:00 2020-04-02T23:22:14.401 INFO:teuthology.orchestra.run.smithi084.stdout:(13/125): libcephfs-devel-16.0.0-316.gcbb84f7.e 358 kB/s | 21 kB 00:00 2020-04-02T23:22:14.421 INFO:teuthology.orchestra.run.smithi084.stdout:(14/125): libcephfs2-16.0.0-316.gcbb84f7.el8.x8 6.5 MB/s | 508 kB 00:00 2020-04-02T23:22:14.479 INFO:teuthology.orchestra.run.smithi084.stdout:(15/125): librados-devel-16.0.0-316.gcbb84f7.el 1.8 MB/s | 141 kB 00:00 2020-04-02T23:22:14.497 INFO:teuthology.orchestra.run.smithi084.stdout:(16/125): libradosstriper1-16.0.0-316.gcbb84f7. 4.8 MB/s | 377 kB 00:00 2020-04-02T23:22:14.567 INFO:teuthology.orchestra.run.smithi084.stdout:(17/125): python3-ceph-argparse-16.0.0-316.gcbb 575 kB/s | 40 kB 00:00 2020-04-02T23:22:14.638 INFO:teuthology.orchestra.run.smithi084.stdout:(18/125): python3-ceph-common-16.0.0-316.gcbb84 863 kB/s | 62 kB 00:00 2020-04-02T23:22:14.724 INFO:teuthology.orchestra.run.smithi084.stdout:(19/125): python3-cephfs-16.0.0-316.gcbb84f7.el 1.8 MB/s | 162 kB 00:00 2020-04-02T23:22:14.807 INFO:teuthology.orchestra.run.smithi084.stdout:(20/125): python3-rados-16.0.0-316.gcbb84f7.el8 4.1 MB/s | 352 kB 00:00 2020-04-02T23:22:14.891 INFO:teuthology.orchestra.run.smithi084.stdout:(21/125): python3-rbd-16.0.0-316.gcbb84f7.el8.x 3.9 MB/s | 331 kB 00:00 2020-04-02T23:22:14.951 INFO:teuthology.orchestra.run.smithi084.stdout:(22/125): python3-rgw-16.0.0-316.gcbb84f7.el8.x 1.8 MB/s | 113 kB 00:00 2020-04-02T23:22:14.994 INFO:teuthology.orchestra.run.smithi084.stdout:(23/125): rbd-fuse-16.0.0-316.gcbb84f7.el8.x86_ 1.6 MB/s | 72 kB 00:00 2020-04-02T23:22:15.092 INFO:teuthology.orchestra.run.smithi042.stdout:(8/125): ceph-common-16.0.0-316.gcbb84f7.el8.x8 5.0 MB/s | 21 MB 00:04 2020-04-02T23:22:15.108 INFO:teuthology.orchestra.run.smithi084.stdout:(24/125): librgw2-16.0.0-316.gcbb84f7.el8.x86_6 5.0 MB/s | 3.2 MB 00:00 2020-04-02T23:22:15.160 INFO:teuthology.orchestra.run.smithi042.stdout:(9/125): ceph-selinux-16.0.0-316.gcbb84f7.el8.x 365 kB/s | 25 kB 00:00 2020-04-02T23:22:15.173 INFO:teuthology.orchestra.run.smithi084.stdout:(25/125): rbd-nbd-16.0.0-316.gcbb84f7.el8.x86_6 2.1 MB/s | 141 kB 00:00 2020-04-02T23:22:15.254 INFO:teuthology.orchestra.run.smithi084.stdout:(26/125): ceph-grafana-dashboards-16.0.0-316.gc 278 kB/s | 22 kB 00:00 2020-04-02T23:22:15.335 INFO:teuthology.orchestra.run.smithi084.stdout:(27/125): ceph-mgr-cephadm-16.0.0-316.gcbb84f7. 489 kB/s | 40 kB 00:00 2020-04-02T23:22:15.353 INFO:teuthology.orchestra.run.smithi084.stdout:(28/125): rbd-mirror-16.0.0-316.gcbb84f7.el8.x8 7.5 MB/s | 2.7 MB 00:00 2020-04-02T23:22:16.256 INFO:teuthology.orchestra.run.smithi084.stdout:(29/125): ceph-mgr-dashboard-16.0.0-316.gcbb84f 3.6 MB/s | 3.3 MB 00:00 2020-04-02T23:22:16.322 INFO:teuthology.orchestra.run.smithi084.stdout:(30/125): ceph-mgr-modules-core-16.0.0-316.gcbb 2.4 MB/s | 161 kB 00:00 2020-04-02T23:22:16.384 INFO:teuthology.orchestra.run.smithi084.stdout:(31/125): ceph-mgr-rook-16.0.0-316.gcbb84f7.el8 446 kB/s | 27 kB 00:00 2020-04-02T23:22:16.444 INFO:teuthology.orchestra.run.smithi084.stdout:(32/125): ceph-prometheus-alerts-16.0.0-316.gcb 144 kB/s | 8.7 kB 00:00 2020-04-02T23:22:16.549 INFO:teuthology.orchestra.run.smithi084.stdout:(33/125): automake-1.16.1-6.el8.noarch.rpm 6.7 MB/s | 713 kB 00:00 2020-04-02T23:22:16.603 INFO:teuthology.orchestra.run.smithi084.stdout:(34/125): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2020-04-02T23:22:16.646 INFO:teuthology.orchestra.run.smithi084.stdout:(35/125): flex-2.6.1-9.el8.x86_64.rpm 7.2 MB/s | 320 kB 00:00 2020-04-02T23:22:16.670 INFO:teuthology.orchestra.run.smithi084.stdout:(36/125): jq-1.5-12.el8.x86_64.rpm 6.7 MB/s | 161 kB 00:00 2020-04-02T23:22:16.708 INFO:teuthology.orchestra.run.smithi084.stdout:(37/125): ceph-mgr-diskprediction-local-16.0.0- 6.3 MB/s | 8.6 MB 00:01 2020-04-02T23:22:16.723 INFO:teuthology.orchestra.run.smithi084.stdout:(38/125): librdkafka-0.11.4-1.el8.x86_64.rpm 6.5 MB/s | 353 kB 00:00 2020-04-02T23:22:16.736 INFO:teuthology.orchestra.run.smithi084.stdout:(39/125): lttng-ust-2.8.1-11.el8.x86_64.rpm 19 MB/s | 259 kB 00:00 2020-04-02T23:22:16.764 INFO:teuthology.orchestra.run.smithi084.stdout:(40/125): oniguruma-6.8.2-1.el8.x86_64.rpm 6.7 MB/s | 188 kB 00:00 2020-04-02T23:22:16.766 INFO:teuthology.orchestra.run.smithi084.stdout:(41/125): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2020-04-02T23:22:16.854 INFO:teuthology.orchestra.run.smithi084.stdout:(42/125): openblas-0.3.3-2.el8.x86_64.rpm 48 MB/s | 4.3 MB 00:00 2020-04-02T23:22:16.920 INFO:teuthology.orchestra.run.smithi084.stdout:(43/125): openblas-threads-0.3.3-2.el8.x86_64.r 28 MB/s | 4.4 MB 00:00 2020-04-02T23:22:16.922 INFO:teuthology.orchestra.run.smithi084.stdout:(44/125): python3-html5lib-0.999999999-6.el8.no 3.1 MB/s | 214 kB 00:00 2020-04-02T23:22:16.942 INFO:teuthology.orchestra.run.smithi084.stdout:(45/125): python3-jsonpointer-1.10-11.el8.noarc 1.0 MB/s | 20 kB 00:00 2020-04-02T23:22:16.947 INFO:teuthology.orchestra.run.smithi084.stdout:(46/125): python3-jsonpatch-1.21-2.el8.noarch.r 1.0 MB/s | 27 kB 00:00 2020-04-02T23:22:16.985 INFO:teuthology.orchestra.run.smithi042.stdout:(10/125): ceph-radosgw-16.0.0-316.gcbb84f7.el8. 3.5 MB/s | 9.8 MB 00:02 2020-04-02T23:22:16.992 INFO:teuthology.orchestra.run.smithi084.stdout:(47/125): python3-mako-1.0.6-13.el8.noarch.rpm 3.4 MB/s | 157 kB 00:00 2020-04-02T23:22:17.000 INFO:teuthology.orchestra.run.smithi084.stdout:(48/125): python3-markupsafe-0.23-19.el8.x86_64 5.0 MB/s | 39 kB 00:00 2020-04-02T23:22:17.017 INFO:teuthology.orchestra.run.smithi084.stdout:(49/125): python3-lxml-4.2.3-1.el8.x86_64.rpm 20 MB/s | 1.5 MB 00:00 2020-04-02T23:22:17.029 INFO:teuthology.orchestra.run.smithi042.stdout:(11/125): cephadm-16.0.0-316.gcbb84f7.el8.x86_6 888 kB/s | 39 kB 00:00 2020-04-02T23:22:17.070 INFO:teuthology.orchestra.run.smithi042.stdout:(12/125): libcephfs-devel-16.0.0-316.gcbb84f7.e 525 kB/s | 21 kB 00:00 2020-04-02T23:22:17.072 INFO:teuthology.orchestra.run.smithi084.stdout:(50/125): python3-numpy-f2py-1.14.3-9.el8.x86_6 4.1 MB/s | 225 kB 00:00 2020-04-02T23:22:17.088 INFO:teuthology.orchestra.run.smithi084.stdout:(51/125): python3-prettytable-0.7.2-14.el8.noar 2.7 MB/s | 44 kB 00:00 2020-04-02T23:22:17.104 INFO:teuthology.orchestra.run.smithi084.stdout:(52/125): python3-numpy-1.14.3-9.el8.x86_64.rpm 36 MB/s | 3.7 MB 00:00 2020-04-02T23:22:17.105 INFO:teuthology.orchestra.run.smithi084.stdout:(53/125): python3-pyasn1-0.3.7-6.el8.noarch.rpm 7.4 MB/s | 126 kB 00:00 2020-04-02T23:22:17.113 INFO:teuthology.orchestra.run.smithi084.stdout:(54/125): python3-pytz-2017.2-9.el8.noarch.rpm 6.6 MB/s | 54 kB 00:00 2020-04-02T23:22:17.116 INFO:teuthology.orchestra.run.smithi084.stdout:(55/125): python3-pyasn1-modules-0.3.7-6.el8.no 8.7 MB/s | 110 kB 00:00 2020-04-02T23:22:17.136 INFO:teuthology.orchestra.run.smithi084.stdout:(56/125): python3-webencodings-0.5.1-6.el8.noar 1.3 MB/s | 27 kB 00:00 2020-04-02T23:22:17.167 INFO:teuthology.orchestra.run.smithi084.stdout:(57/125): python3-werkzeug-0.12.2-4.el8.noarch. 15 MB/s | 457 kB 00:00 2020-04-02T23:22:17.186 INFO:teuthology.orchestra.run.smithi084.stdout:(58/125): socat-1.7.3.2-6.el8.x86_64.rpm 15 MB/s | 298 kB 00:00 2020-04-02T23:22:17.209 INFO:teuthology.orchestra.run.smithi042.stdout:(13/125): libcephfs2-16.0.0-316.gcbb84f7.el8.x8 3.6 MB/s | 508 kB 00:00 2020-04-02T23:22:17.255 INFO:teuthology.orchestra.run.smithi042.stdout:(14/125): librados-devel-16.0.0-316.gcbb84f7.el 3.0 MB/s | 141 kB 00:00 2020-04-02T23:22:17.256 INFO:teuthology.orchestra.run.smithi084.stdout:(59/125): elfutils-libelf-devel-0.176-5.el8.x86 780 kB/s | 54 kB 00:00 2020-04-02T23:22:17.335 INFO:teuthology.orchestra.run.smithi084.stdout:(60/125): python3-scipy-1.0.0-20.module_el8.1.0 66 MB/s | 15 MB 00:00 2020-04-02T23:22:17.336 INFO:teuthology.orchestra.run.smithi084.stdout:(61/125): fuse-2.9.7-12.el8.x86_64.rpm 1.0 MB/s | 82 kB 00:00 2020-04-02T23:22:17.339 INFO:teuthology.orchestra.run.smithi042.stdout:(15/125): libradosstriper1-16.0.0-316.gcbb84f7. 4.4 MB/s | 377 kB 00:00 2020-04-02T23:22:17.352 INFO:teuthology.orchestra.run.smithi084.stdout:(62/125): fuse-common-3.2.1-12.el8.x86_64.rpm 1.2 MB/s | 21 kB 00:00 2020-04-02T23:22:17.379 INFO:teuthology.orchestra.run.smithi084.stdout:(63/125): keyutils-libs-devel-1.5.10-6.el8.x86_ 1.1 MB/s | 48 kB 00:00 2020-04-02T23:22:17.400 INFO:teuthology.orchestra.run.smithi084.stdout:(64/125): libaio-devel-0.3.112-1.el8.x86_64.rpm 895 kB/s | 19 kB 00:00 2020-04-02T23:22:17.402 INFO:teuthology.orchestra.run.smithi084.stdout:(65/125): krb5-devel-1.17-9.el8.x86_64.rpm 11 MB/s | 548 kB 00:00 2020-04-02T23:22:17.436 INFO:teuthology.orchestra.run.smithi084.stdout:(66/125): libcom_err-devel-1.44.6-3.el8.x86_64. 1.0 MB/s | 38 kB 00:00 2020-04-02T23:22:17.455 INFO:teuthology.orchestra.run.smithi084.stdout:(67/125): libgfortran-8.3.1-4.5.el8.x86_64.rpm 12 MB/s | 638 kB 00:00 2020-04-02T23:22:17.456 INFO:teuthology.orchestra.run.smithi084.stdout:(68/125): libquadmath-8.3.1-4.5.el8.x86_64.rpm 8.2 MB/s | 169 kB 00:00 2020-04-02T23:22:17.466 INFO:teuthology.orchestra.run.smithi084.stdout:(69/125): librabbitmq-0.9.0-1.el8.x86_64.rpm 4.3 MB/s | 47 kB 00:00 2020-04-02T23:22:17.478 INFO:teuthology.orchestra.run.smithi084.stdout:(70/125): libselinux-devel-2.9-2.1.el8.x86_64.r 9.0 MB/s | 199 kB 00:00 2020-04-02T23:22:17.483 INFO:teuthology.orchestra.run.smithi084.stdout:(71/125): libsepol-devel-2.9-1.el8.x86_64.rpm 5.1 MB/s | 86 kB 00:00 2020-04-02T23:22:17.504 INFO:teuthology.orchestra.run.smithi084.stdout:(72/125): libverto-devel-0.3.0-5.el8.x86_64.rpm 849 kB/s | 18 kB 00:00 2020-04-02T23:22:17.513 INFO:teuthology.orchestra.run.smithi084.stdout:(73/125): libxslt-1.1.32-3.el8.x86_64.rpm 25 MB/s | 249 kB 00:00 2020-04-02T23:22:17.517 INFO:teuthology.orchestra.run.smithi084.stdout:(74/125): libuuid-devel-2.32.1-17.el8.x86_64.rp 2.4 MB/s | 95 kB 00:00 2020-04-02T23:22:17.550 INFO:teuthology.orchestra.run.smithi084.stdout:(75/125): pcre2-devel-10.32-1.el8.x86_64.rpm 18 MB/s | 605 kB 00:00 2020-04-02T23:22:17.570 INFO:teuthology.orchestra.run.smithi084.stdout:(76/125): openssl-devel-1.1.1c-2.el8.x86_64.rpm 41 MB/s | 2.3 MB 00:00 2020-04-02T23:22:17.582 INFO:teuthology.orchestra.run.smithi084.stdout:(77/125): pcre2-utf16-10.32-1.el8.x86_64.rpm 6.9 MB/s | 228 kB 00:00 2020-04-02T23:22:17.604 INFO:teuthology.orchestra.run.smithi084.stdout:(78/125): pcre2-utf32-10.32-1.el8.x86_64.rpm 6.3 MB/s | 220 kB 00:00 2020-04-02T23:22:17.627 INFO:teuthology.orchestra.run.smithi084.stdout:(79/125): python3-chardet-3.0.4-7.el8.noarch.rp 4.8 MB/s | 195 kB 00:00 2020-04-02T23:22:17.631 INFO:teuthology.orchestra.run.smithi084.stdout:(80/125): python3-jwt-1.6.1-2.el8.noarch.rpm 1.5 MB/s | 43 kB 00:00 2020-04-02T23:22:17.638 INFO:teuthology.orchestra.run.smithi084.stdout:(81/125): python3-oauthlib-2.1.0-1.el8.noarch.r 9.3 MB/s | 155 kB 00:00 2020-04-02T23:22:17.643 INFO:teuthology.orchestra.run.smithi084.stdout:(82/125): python3-pysocks-1.6.8-3.el8.noarch.rp 2.9 MB/s | 34 kB 00:00 2020-04-02T23:22:17.648 INFO:teuthology.orchestra.run.smithi084.stdout:(83/125): python3-requests-oauthlib-1.0.0-1.el8 9.2 MB/s | 43 kB 00:00 2020-04-02T23:22:17.649 INFO:teuthology.orchestra.run.smithi084.stdout:(84/125): python3-requests-2.20.0-2.1.el8_1.noa 11 MB/s | 123 kB 00:00 2020-04-02T23:22:17.675 INFO:teuthology.orchestra.run.smithi084.stdout:(85/125): python3-urllib3-1.24.2-2.el8.noarch.r 6.2 MB/s | 176 kB 00:00 2020-04-02T23:22:17.685 INFO:teuthology.orchestra.run.smithi084.stdout:(86/125): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 1.9 MB/s | 69 kB 00:00 2020-04-02T23:22:17.688 INFO:teuthology.orchestra.run.smithi084.stdout:(87/125): zlib-devel-1.2.11-10.el8.x86_64.rpm 4.2 MB/s | 56 kB 00:00 2020-04-02T23:22:17.748 INFO:teuthology.orchestra.run.smithi084.stdout:(88/125): python3-cheroot-8.2.1-1.el8.noarch.rp 2.3 MB/s | 145 kB 00:00 2020-04-02T23:22:17.758 INFO:teuthology.orchestra.run.smithi084.stdout:(89/125): python3-cherrypy-18.4.0-1.el8.noarch. 5.4 MB/s | 385 kB 00:00 2020-04-02T23:22:17.766 INFO:teuthology.orchestra.run.smithi084.stdout:(90/125): python3-jaraco-6.2-6.el8.noarch.rpm 1.4 MB/s | 11 kB 00:00 2020-04-02T23:22:17.768 INFO:teuthology.orchestra.run.smithi084.stdout:(91/125): python3-execnet-1.7.1-1.el8.2.noarch. 17 MB/s | 356 kB 00:00 2020-04-02T23:22:17.775 INFO:teuthology.orchestra.run.smithi084.stdout:(92/125): python3-jaraco-functools-2.0-4.el8.no 2.1 MB/s | 18 kB 00:00 2020-04-02T23:22:17.776 INFO:teuthology.orchestra.run.smithi084.stdout:(93/125): python3-logutils-0.3.5-11.el8.noarch. 5.7 MB/s | 49 kB 00:00 2020-04-02T23:22:17.784 INFO:teuthology.orchestra.run.smithi084.stdout:(94/125): python3-more-itertools-7.2.0-4.el8.no 6.8 MB/s | 59 kB 00:00 2020-04-02T23:22:17.788 INFO:teuthology.orchestra.run.smithi084.stdout:(95/125): python3-pecan-1.3.2-9.el8.noarch.rpm 23 MB/s | 283 kB 00:00 2020-04-02T23:22:17.792 INFO:teuthology.orchestra.run.smithi084.stdout:(96/125): python3-portend-2.6-1.el8.noarch.rpm 2.0 MB/s | 16 kB 00:00 2020-04-02T23:22:17.797 INFO:teuthology.orchestra.run.smithi084.stdout:(97/125): python3-remoto-1.1.4-4.el8.noarch.rpm 5.5 MB/s | 48 kB 00:00 2020-04-02T23:22:17.800 INFO:teuthology.orchestra.run.smithi084.stdout:(98/125): python3-repoze-lru-0.7-6.el8.noarch.r 4.0 MB/s | 34 kB 00:00 2020-04-02T23:22:17.808 INFO:teuthology.orchestra.run.smithi084.stdout:(99/125): python3-routes-2.4.1-12.el8.noarch.rp 17 MB/s | 197 kB 00:00 2020-04-02T23:22:17.809 INFO:teuthology.orchestra.run.smithi084.stdout:(100/125): python3-simplegeneric-0.8.1-17.el8.n 2.2 MB/s | 19 kB 00:00 2020-04-02T23:22:17.817 INFO:teuthology.orchestra.run.smithi084.stdout:(101/125): python3-singledispatch-3.4.0.3-18.el 2.7 MB/s | 24 kB 00:00 2020-04-02T23:22:17.818 INFO:teuthology.orchestra.run.smithi084.stdout:(102/125): python3-tempora-1.14.1-5.el8.noarch. 3.4 MB/s | 30 kB 00:00 2020-04-02T23:22:17.834 INFO:teuthology.orchestra.run.smithi084.stdout:(103/125): python3-trustme-0.5.2-4.el8.noarch.r 3.1 MB/s | 27 kB 00:00 2020-04-02T23:22:17.834 INFO:teuthology.orchestra.run.smithi084.stdout:(104/125): python3-zc-lockfile-2.0-2.el8.noarch 2.8 MB/s | 23 kB 00:00 2020-04-02T23:22:17.889 INFO:teuthology.orchestra.run.smithi084.stdout:(105/125): liboath-2.6.2-3.el8.x86_64.rpm 936 kB/s | 59 kB 00:00 2020-04-02T23:22:17.920 INFO:teuthology.orchestra.run.smithi084.stdout:(106/125): libunwind-1.3.1-3.el8.x86_64.rpm 2.4 MB/s | 75 kB 00:00 2020-04-02T23:22:17.936 INFO:teuthology.orchestra.run.smithi084.stdout:(107/125): python3-apipkg-1.5-6.el8.noarch.rpm 1.3 MB/s | 21 kB 00:00 2020-04-02T23:22:17.952 INFO:teuthology.orchestra.run.smithi084.stdout:(108/125): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.7 MB/s | 44 kB 00:00 2020-04-02T23:22:17.957 INFO:teuthology.orchestra.run.smithi084.stdout:(109/125): gperftools-libs-2.7-6.el8.x86_64.rpm 2.3 MB/s | 315 kB 00:00 2020-04-02T23:22:17.977 INFO:teuthology.orchestra.run.smithi084.stdout:(110/125): python3-cachetools-3.1.1-4.el8.noarc 1.7 MB/s | 33 kB 00:00 2020-04-02T23:22:17.983 INFO:teuthology.orchestra.run.smithi084.stdout:(111/125): python3-beautifulsoup4-4.6.3-2.el8.1 5.8 MB/s | 185 kB 00:00 2020-04-02T23:22:17.996 INFO:teuthology.orchestra.run.smithi084.stdout:(112/125): python3-certifi-2018.10.15-7.el8.noa 868 kB/s | 16 kB 00:00 2020-04-02T23:22:17.999 INFO:teuthology.orchestra.run.smithi084.stdout:(113/125): python3-cssselect-0.9.2-10.el8.noarc 2.5 MB/s | 40 kB 00:00 2020-04-02T23:22:18.016 INFO:teuthology.orchestra.run.smithi084.stdout:(114/125): python3-google-auth-1.1.1-10.el8.noa 4.0 MB/s | 81 kB 00:00 2020-04-02T23:22:18.034 INFO:teuthology.orchestra.run.smithi042.stdout:(16/125): librgw2-16.0.0-316.gcbb84f7.el8.x86_6 4.6 MB/s | 3.2 MB 00:00 2020-04-02T23:22:18.041 INFO:teuthology.orchestra.run.smithi084.stdout:(115/125): python3-rsa-3.4.2-12.el8.noarch.rpm 3.7 MB/s | 73 kB 00:00 2020-04-02T23:22:18.064 INFO:teuthology.orchestra.run.smithi084.stdout:(116/125): python3-kubernetes-10.0.1-2.el8.noar 17 MB/s | 1.1 MB 00:00 2020-04-02T23:22:18.073 INFO:teuthology.orchestra.run.smithi084.stdout:(117/125): python3-waitress-1.2.1-2.el8.1.noarc 6.3 MB/s | 241 kB 00:00 2020-04-02T23:22:18.078 INFO:teuthology.orchestra.run.smithi042.stdout:(17/125): python3-ceph-argparse-16.0.0-316.gcbb 895 kB/s | 40 kB 00:00 2020-04-02T23:22:18.081 INFO:teuthology.orchestra.run.smithi084.stdout:(118/125): python3-webob-1.8.5-1.el8.1.noarch.r 14 MB/s | 251 kB 00:00 2020-04-02T23:22:18.093 INFO:teuthology.orchestra.run.smithi084.stdout:(119/125): python3-websocket-client-0.56.0-5.el 3.1 MB/s | 61 kB 00:00 2020-04-02T23:22:18.098 INFO:teuthology.orchestra.run.smithi084.stdout:(120/125): python3-webtest-2.0.33-1.el8.noarch. 5.2 MB/s | 85 kB 00:00 2020-04-02T23:22:18.103 INFO:teuthology.orchestra.run.smithi084.stdout:(121/125): leveldb-1.21-2.el8.x86_64.rpm 33 MB/s | 179 kB 00:00 2020-04-02T23:22:18.112 INFO:teuthology.orchestra.run.smithi084.stdout:(122/125): xmlstarlet-1.6.1-11.el8.x86_64.rpm 3.5 MB/s | 69 kB 00:00 2020-04-02T23:22:18.123 INFO:teuthology.orchestra.run.smithi042.stdout:(18/125): python3-ceph-common-16.0.0-316.gcbb84 1.3 MB/s | 62 kB 00:00 2020-04-02T23:22:18.173 INFO:teuthology.orchestra.run.smithi042.stdout:(19/125): python3-cephfs-16.0.0-316.gcbb84f7.el 3.2 MB/s | 162 kB 00:00 2020-04-02T23:22:18.322 INFO:teuthology.orchestra.run.smithi042.stdout:(20/125): ceph-osd-16.0.0-316.gcbb84f7.el8.x86_ 3.0 MB/s | 17 MB 00:05 2020-04-02T23:22:18.325 INFO:teuthology.orchestra.run.smithi042.stdout:(21/125): python3-rados-16.0.0-316.gcbb84f7.el8 2.3 MB/s | 352 kB 00:00 2020-04-02T23:22:18.378 INFO:teuthology.orchestra.run.smithi042.stdout:(22/125): python3-rgw-16.0.0-316.gcbb84f7.el8.x 2.1 MB/s | 113 kB 00:00 2020-04-02T23:22:18.433 INFO:teuthology.orchestra.run.smithi042.stdout:(23/125): python3-rbd-16.0.0-316.gcbb84f7.el8.x 2.9 MB/s | 331 kB 00:00 2020-04-02T23:22:18.439 INFO:teuthology.orchestra.run.smithi042.stdout:(24/125): rbd-fuse-16.0.0-316.gcbb84f7.el8.x86_ 1.2 MB/s | 72 kB 00:00 2020-04-02T23:22:18.506 INFO:teuthology.orchestra.run.smithi042.stdout:(25/125): rbd-nbd-16.0.0-316.gcbb84f7.el8.x86_6 2.1 MB/s | 141 kB 00:00 2020-04-02T23:22:18.559 INFO:teuthology.orchestra.run.smithi042.stdout:(26/125): ceph-grafana-dashboards-16.0.0-316.gc 431 kB/s | 22 kB 00:00 2020-04-02T23:22:18.595 INFO:teuthology.orchestra.run.smithi042.stdout:(27/125): ceph-mgr-cephadm-16.0.0-316.gcbb84f7. 1.1 MB/s | 40 kB 00:00 2020-04-02T23:22:18.855 INFO:teuthology.orchestra.run.smithi084.stdout:(123/125): ceph-test-16.0.0-316.gcbb84f7.el8.x8 8.7 MB/s | 42 MB 00:04 2020-04-02T23:22:18.862 INFO:teuthology.orchestra.run.smithi084.stdout:(124/125): librbd1-16.0.0-316.gcbb84f7.el8.x86_ 2.6 MB/s | 1.9 MB 00:00 2020-04-02T23:22:19.027 INFO:teuthology.orchestra.run.smithi042.stdout:(28/125): rbd-mirror-16.0.0-316.gcbb84f7.el8.x8 4.5 MB/s | 2.7 MB 00:00 2020-04-02T23:22:19.114 INFO:teuthology.orchestra.run.smithi042.stdout:(29/125): ceph-mgr-dashboard-16.0.0-316.gcbb84f 6.4 MB/s | 3.3 MB 00:00 2020-04-02T23:22:19.156 INFO:teuthology.orchestra.run.smithi042.stdout:(30/125): ceph-mgr-modules-core-16.0.0-316.gcbb 3.8 MB/s | 161 kB 00:00 2020-04-02T23:22:19.193 INFO:teuthology.orchestra.run.smithi042.stdout:(31/125): ceph-mgr-rook-16.0.0-316.gcbb84f7.el8 737 kB/s | 27 kB 00:00 2020-04-02T23:22:19.230 INFO:teuthology.orchestra.run.smithi042.stdout:(32/125): ceph-prometheus-alerts-16.0.0-316.gcb 238 kB/s | 8.7 kB 00:00 2020-04-02T23:22:19.270 INFO:teuthology.orchestra.run.smithi042.stdout:(33/125): automake-1.16.1-6.el8.noarch.rpm 17 MB/s | 713 kB 00:00 2020-04-02T23:22:19.281 INFO:teuthology.orchestra.run.smithi042.stdout:(34/125): bison-3.0.4-10.el8.x86_64.rpm 63 MB/s | 688 kB 00:00 2020-04-02T23:22:19.286 INFO:teuthology.orchestra.run.smithi042.stdout:(35/125): flex-2.6.1-9.el8.x86_64.rpm 63 MB/s | 320 kB 00:00 2020-04-02T23:22:19.289 INFO:teuthology.orchestra.run.smithi042.stdout:(36/125): jq-1.5-12.el8.x86_64.rpm 55 MB/s | 161 kB 00:00 2020-04-02T23:22:19.295 INFO:teuthology.orchestra.run.smithi042.stdout:(37/125): librdkafka-0.11.4-1.el8.x86_64.rpm 67 MB/s | 353 kB 00:00 2020-04-02T23:22:19.304 INFO:teuthology.orchestra.run.smithi042.stdout:(38/125): libtool-2.4.6-25.el8.x86_64.rpm 72 MB/s | 709 kB 00:00 2020-04-02T23:22:19.308 INFO:teuthology.orchestra.run.smithi042.stdout:(39/125): lttng-ust-2.8.1-11.el8.x86_64.rpm 66 MB/s | 259 kB 00:00 2020-04-02T23:22:19.311 INFO:teuthology.orchestra.run.smithi042.stdout:(40/125): oniguruma-6.8.2-1.el8.x86_64.rpm 63 MB/s | 188 kB 00:00 2020-04-02T23:22:19.363 INFO:teuthology.orchestra.run.smithi042.stdout:(41/125): openblas-0.3.3-2.el8.x86_64.rpm 84 MB/s | 4.3 MB 00:00 2020-04-02T23:22:19.415 INFO:teuthology.orchestra.run.smithi042.stdout:(42/125): openblas-threads-0.3.3-2.el8.x86_64.r 84 MB/s | 4.4 MB 00:00 2020-04-02T23:22:19.419 INFO:teuthology.orchestra.run.smithi042.stdout:(43/125): python3-html5lib-0.999999999-6.el8.no 60 MB/s | 214 kB 00:00 2020-04-02T23:22:19.420 INFO:teuthology.orchestra.run.smithi042.stdout:(44/125): python3-jsonpatch-1.21-2.el8.noarch.r 22 MB/s | 27 kB 00:00 2020-04-02T23:22:19.421 INFO:teuthology.orchestra.run.smithi042.stdout:(45/125): python3-jsonpointer-1.10-11.el8.noarc 18 MB/s | 20 kB 00:00 2020-04-02T23:22:19.440 INFO:teuthology.orchestra.run.smithi042.stdout:(46/125): python3-lxml-4.2.3-1.el8.x86_64.rpm 81 MB/s | 1.5 MB 00:00 2020-04-02T23:22:19.443 INFO:teuthology.orchestra.run.smithi042.stdout:(47/125): python3-mako-1.0.6-13.el8.noarch.rpm 62 MB/s | 157 kB 00:00 2020-04-02T23:22:19.444 INFO:teuthology.orchestra.run.smithi042.stdout:(48/125): python3-markupsafe-0.23-19.el8.x86_64 33 MB/s | 39 kB 00:00 2020-04-02T23:22:19.489 INFO:teuthology.orchestra.run.smithi042.stdout:(49/125): python3-numpy-1.14.3-9.el8.x86_64.rpm 84 MB/s | 3.7 MB 00:00 2020-04-02T23:22:19.492 INFO:teuthology.orchestra.run.smithi042.stdout:(50/125): python3-numpy-f2py-1.14.3-9.el8.x86_6 60 MB/s | 225 kB 00:00 2020-04-02T23:22:19.494 INFO:teuthology.orchestra.run.smithi042.stdout:(51/125): python3-prettytable-0.7.2-14.el8.noar 33 MB/s | 44 kB 00:00 2020-04-02T23:22:19.496 INFO:teuthology.orchestra.run.smithi042.stdout:(52/125): python3-pyasn1-0.3.7-6.el8.noarch.rpm 56 MB/s | 126 kB 00:00 2020-04-02T23:22:19.498 INFO:teuthology.orchestra.run.smithi042.stdout:(53/125): python3-pyasn1-modules-0.3.7-6.el8.no 52 MB/s | 110 kB 00:00 2020-04-02T23:22:19.500 INFO:teuthology.orchestra.run.smithi042.stdout:(54/125): python3-pytz-2017.2-9.el8.noarch.rpm 35 MB/s | 54 kB 00:00 2020-04-02T23:22:19.733 INFO:teuthology.orchestra.run.smithi084.stdout:(125/125): librados2-16.0.0-316.gcbb84f7.el8.x8 2.2 MB/s | 3.6 MB 00:01 2020-04-02T23:22:19.737 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2020-04-02T23:22:19.739 INFO:teuthology.orchestra.run.smithi084.stdout:Total 19 MB/s | 174 MB 00:09 2020-04-02T23:22:19.806 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2020-04-02T23:22:19.815 INFO:teuthology.orchestra.run.smithi042.stdout:(55/125): ceph-test-16.0.0-316.gcbb84f7.el8.x86 9.0 MB/s | 42 MB 00:04 2020-04-02T23:22:19.849 INFO:teuthology.orchestra.run.smithi042.stdout:(56/125): python3-webencodings-0.5.1-6.el8.noar 807 kB/s | 27 kB 00:00 2020-04-02T23:22:19.880 INFO:teuthology.orchestra.run.smithi042.stdout:(57/125): python3-werkzeug-0.12.2-4.el8.noarch. 15 MB/s | 457 kB 00:00 2020-04-02T23:22:19.899 INFO:teuthology.orchestra.run.smithi042.stdout:(58/125): socat-1.7.3.2-6.el8.x86_64.rpm 15 MB/s | 298 kB 00:00 2020-04-02T23:22:19.904 INFO:teuthology.orchestra.run.smithi042.stdout:(59/125): elfutils-libelf-devel-0.176-5.el8.x86 12 MB/s | 54 kB 00:00 2020-04-02T23:22:19.909 INFO:teuthology.orchestra.run.smithi042.stdout:(60/125): fuse-2.9.7-12.el8.x86_64.rpm 18 MB/s | 82 kB 00:00 2020-04-02T23:22:19.911 INFO:teuthology.orchestra.run.smithi042.stdout:(61/125): fuse-common-3.2.1-12.el8.x86_64.rpm 7.8 MB/s | 21 kB 00:00 2020-04-02T23:22:19.915 INFO:teuthology.orchestra.run.smithi042.stdout:(62/125): keyutils-libs-devel-1.5.10-6.el8.x86_ 15 MB/s | 48 kB 00:00 2020-04-02T23:22:19.916 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2020-04-02T23:22:19.916 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2020-04-02T23:22:20.023 INFO:teuthology.orchestra.run.smithi042.stdout:(63/125): python3-scipy-1.0.0-20.module_el8.1.0 28 MB/s | 15 MB 00:00 2020-04-02T23:22:20.025 INFO:teuthology.orchestra.run.smithi042.stdout:(64/125): libaio-devel-0.3.112-1.el8.x86_64.rpm 12 MB/s | 19 kB 00:00 2020-04-02T23:22:20.026 INFO:teuthology.orchestra.run.smithi042.stdout:(65/125): krb5-devel-1.17-9.el8.x86_64.rpm 4.8 MB/s | 548 kB 00:00 2020-04-02T23:22:20.027 INFO:teuthology.orchestra.run.smithi042.stdout:(66/125): libcom_err-devel-1.44.6-3.el8.x86_64. 14 MB/s | 38 kB 00:00 2020-04-02T23:22:20.031 INFO:teuthology.orchestra.run.smithi042.stdout:(67/125): libquadmath-8.3.1-4.5.el8.x86_64.rpm 48 MB/s | 169 kB 00:00 2020-04-02T23:22:20.033 INFO:teuthology.orchestra.run.smithi042.stdout:(68/125): librabbitmq-0.9.0-1.el8.x86_64.rpm 27 MB/s | 47 kB 00:00 2020-04-02T23:22:20.037 INFO:teuthology.orchestra.run.smithi042.stdout:(69/125): libselinux-devel-2.9-2.1.el8.x86_64.r 49 MB/s | 199 kB 00:00 2020-04-02T23:22:20.041 INFO:teuthology.orchestra.run.smithi042.stdout:(70/125): libgfortran-8.3.1-4.5.el8.x86_64.rpm 49 MB/s | 638 kB 00:00 2020-04-02T23:22:20.041 INFO:teuthology.orchestra.run.smithi042.stdout:(71/125): libsepol-devel-2.9-1.el8.x86_64.rpm 26 MB/s | 86 kB 00:00 2020-04-02T23:22:20.042 INFO:teuthology.orchestra.run.smithi042.stdout:(72/125): libuuid-devel-2.32.1-17.el8.x86_64.rp 45 MB/s | 95 kB 00:00 2020-04-02T23:22:20.042 INFO:teuthology.orchestra.run.smithi042.stdout:(73/125): libverto-devel-0.3.0-5.el8.x86_64.rpm 11 MB/s | 18 kB 00:00 2020-04-02T23:22:20.050 INFO:teuthology.orchestra.run.smithi042.stdout:(74/125): libxslt-1.1.32-3.el8.x86_64.rpm 30 MB/s | 249 kB 00:00 2020-04-02T23:22:20.081 INFO:teuthology.orchestra.run.smithi042.stdout:(75/125): pcre2-devel-10.32-1.el8.x86_64.rpm 28 MB/s | 605 kB 00:00 2020-04-02T23:22:20.081 INFO:teuthology.orchestra.run.smithi042.stdout:(76/125): openssl-devel-1.1.1c-2.el8.x86_64.rpm 64 MB/s | 2.3 MB 00:00 2020-04-02T23:22:20.082 INFO:teuthology.orchestra.run.smithi042.stdout:(77/125): pcre2-utf16-10.32-1.el8.x86_64.rpm 23 MB/s | 228 kB 00:00 2020-04-02T23:22:20.083 INFO:teuthology.orchestra.run.smithi042.stdout:(78/125): pcre2-utf32-10.32-1.el8.x86_64.rpm 50 MB/s | 220 kB 00:00 2020-04-02T23:22:20.088 INFO:teuthology.orchestra.run.smithi042.stdout:(79/125): python3-jwt-1.6.1-2.el8.noarch.rpm 8.5 MB/s | 43 kB 00:00 2020-04-02T23:22:20.089 INFO:teuthology.orchestra.run.smithi042.stdout:(80/125): python3-chardet-3.0.4-7.el8.noarch.rp 26 MB/s | 195 kB 00:00 2020-04-02T23:22:20.091 INFO:teuthology.orchestra.run.smithi042.stdout:(81/125): python3-oauthlib-2.1.0-1.el8.noarch.r 56 MB/s | 155 kB 00:00 2020-04-02T23:22:20.091 INFO:teuthology.orchestra.run.smithi042.stdout:(82/125): python3-pysocks-1.6.8-3.el8.noarch.rp 14 MB/s | 34 kB 00:00 2020-04-02T23:22:20.093 INFO:teuthology.orchestra.run.smithi042.stdout:(83/125): python3-requests-2.20.0-2.1.el8_1.noa 55 MB/s | 123 kB 00:00 2020-04-02T23:22:20.093 INFO:teuthology.orchestra.run.smithi042.stdout:(84/125): python3-requests-oauthlib-1.0.0-1.el8 18 MB/s | 43 kB 00:00 2020-04-02T23:22:20.096 INFO:teuthology.orchestra.run.smithi042.stdout:(85/125): python3-urllib3-1.24.2-2.el8.noarch.r 60 MB/s | 176 kB 00:00 2020-04-02T23:22:20.097 INFO:teuthology.orchestra.run.smithi042.stdout:(86/125): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 21 MB/s | 69 kB 00:00 2020-04-02T23:22:20.098 INFO:teuthology.orchestra.run.smithi042.stdout:(87/125): zlib-devel-1.2.11-10.el8.x86_64.rpm 35 MB/s | 56 kB 00:00 2020-04-02T23:22:20.157 INFO:teuthology.orchestra.run.smithi042.stdout:(88/125): python3-cheroot-8.2.1-1.el8.noarch.rp 2.4 MB/s | 145 kB 00:00 2020-04-02T23:22:20.174 INFO:teuthology.orchestra.run.smithi042.stdout:(89/125): python3-cherrypy-18.4.0-1.el8.noarch. 5.0 MB/s | 385 kB 00:00 2020-04-02T23:22:20.178 INFO:teuthology.orchestra.run.smithi042.stdout:(90/125): python3-execnet-1.7.1-1.el8.2.noarch. 17 MB/s | 356 kB 00:00 2020-04-02T23:22:20.182 INFO:teuthology.orchestra.run.smithi042.stdout:(91/125): python3-jaraco-6.2-6.el8.noarch.rpm 1.3 MB/s | 11 kB 00:00 2020-04-02T23:22:20.188 INFO:teuthology.orchestra.run.smithi042.stdout:(92/125): python3-jaraco-functools-2.0-4.el8.no 1.8 MB/s | 18 kB 00:00 2020-04-02T23:22:20.191 INFO:teuthology.orchestra.run.smithi042.stdout:(93/125): python3-logutils-0.3.5-11.el8.noarch. 5.6 MB/s | 49 kB 00:00 2020-04-02T23:22:20.202 INFO:teuthology.orchestra.run.smithi042.stdout:(94/125): python3-more-itertools-7.2.0-4.el8.no 4.1 MB/s | 59 kB 00:00 2020-04-02T23:22:20.204 INFO:teuthology.orchestra.run.smithi042.stdout:(95/125): python3-pecan-1.3.2-9.el8.noarch.rpm 22 MB/s | 283 kB 00:00 2020-04-02T23:22:20.210 INFO:teuthology.orchestra.run.smithi042.stdout:(96/125): python3-portend-2.6-1.el8.noarch.rpm 1.9 MB/s | 16 kB 00:00 2020-04-02T23:22:20.213 INFO:teuthology.orchestra.run.smithi042.stdout:(97/125): python3-remoto-1.1.4-4.el8.noarch.rpm 5.4 MB/s | 48 kB 00:00 2020-04-02T23:22:20.221 INFO:teuthology.orchestra.run.smithi042.stdout:(98/125): python3-repoze-lru-0.7-6.el8.noarch.r 3.1 MB/s | 34 kB 00:00 2020-04-02T23:22:20.224 INFO:teuthology.orchestra.run.smithi042.stdout:(99/125): python3-routes-2.4.1-12.el8.noarch.rp 18 MB/s | 197 kB 00:00 2020-04-02T23:22:20.230 INFO:teuthology.orchestra.run.smithi042.stdout:(100/125): python3-simplegeneric-0.8.1-17.el8.n 2.1 MB/s | 19 kB 00:00 2020-04-02T23:22:20.233 INFO:teuthology.orchestra.run.smithi042.stdout:(101/125): python3-singledispatch-3.4.0.3-18.el 2.7 MB/s | 24 kB 00:00 2020-04-02T23:22:20.242 INFO:teuthology.orchestra.run.smithi042.stdout:(102/125): python3-tempora-1.14.1-5.el8.noarch. 3.5 MB/s | 30 kB 00:00 2020-04-02T23:22:20.242 INFO:teuthology.orchestra.run.smithi042.stdout:(103/125): python3-trustme-0.5.2-4.el8.noarch.r 3.1 MB/s | 27 kB 00:00 2020-04-02T23:22:20.247 INFO:teuthology.orchestra.run.smithi042.stdout:(104/125): python3-zc-lockfile-2.0-2.el8.noarch 2.7 MB/s | 23 kB 00:00 2020-04-02T23:22:20.309 INFO:teuthology.orchestra.run.smithi042.stdout:(105/125): liboath-2.6.2-3.el8.x86_64.rpm 959 kB/s | 59 kB 00:00 2020-04-02T23:22:20.335 INFO:teuthology.orchestra.run.smithi042.stdout:(106/125): gperftools-libs-2.7-6.el8.x86_64.rpm 3.3 MB/s | 315 kB 00:00 2020-04-02T23:22:20.340 INFO:teuthology.orchestra.run.smithi042.stdout:(107/125): libunwind-1.3.1-3.el8.x86_64.rpm 2.4 MB/s | 75 kB 00:00 2020-04-02T23:22:20.351 INFO:teuthology.orchestra.run.smithi042.stdout:(108/125): python3-apipkg-1.5-6.el8.noarch.rpm 1.3 MB/s | 21 kB 00:00 2020-04-02T23:22:20.356 INFO:teuthology.orchestra.run.smithi042.stdout:(109/125): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.7 MB/s | 44 kB 00:00 2020-04-02T23:22:20.368 INFO:teuthology.orchestra.run.smithi042.stdout:(110/125): python3-beautifulsoup4-4.6.3-2.el8.1 11 MB/s | 185 kB 00:00 2020-04-02T23:22:20.372 INFO:teuthology.orchestra.run.smithi042.stdout:(111/125): python3-cachetools-3.1.1-4.el8.noarc 2.0 MB/s | 33 kB 00:00 2020-04-02T23:22:20.384 INFO:teuthology.orchestra.run.smithi042.stdout:(112/125): python3-certifi-2018.10.15-7.el8.noa 1.0 MB/s | 16 kB 00:00 2020-04-02T23:22:20.394 INFO:teuthology.orchestra.run.smithi042.stdout:(113/125): python3-cssselect-0.9.2-10.el8.noarc 2.5 MB/s | 40 kB 00:00 2020-04-02T23:22:20.400 INFO:teuthology.orchestra.run.smithi042.stdout:(114/125): python3-google-auth-1.1.1-10.el8.noa 4.8 MB/s | 81 kB 00:00 2020-04-02T23:22:20.416 INFO:teuthology.orchestra.run.smithi042.stdout:(115/125): python3-rsa-3.4.2-12.el8.noarch.rpm 4.4 MB/s | 73 kB 00:00 2020-04-02T23:22:20.434 INFO:teuthology.orchestra.run.smithi042.stdout:(116/125): python3-waitress-1.2.1-2.el8.1.noarc 13 MB/s | 241 kB 00:00 2020-04-02T23:22:20.452 INFO:teuthology.orchestra.run.smithi042.stdout:(117/125): python3-webob-1.8.5-1.el8.1.noarch.r 14 MB/s | 251 kB 00:00 2020-04-02T23:22:20.467 INFO:teuthology.orchestra.run.smithi042.stdout:(118/125): python3-kubernetes-10.0.1-2.el8.noar 14 MB/s | 1.1 MB 00:00 2020-04-02T23:22:20.468 INFO:teuthology.orchestra.run.smithi042.stdout:(119/125): python3-websocket-client-0.56.0-5.el 3.7 MB/s | 61 kB 00:00 2020-04-02T23:22:20.484 INFO:teuthology.orchestra.run.smithi042.stdout:(120/125): python3-webtest-2.0.33-1.el8.noarch. 5.1 MB/s | 85 kB 00:00 2020-04-02T23:22:20.484 INFO:teuthology.orchestra.run.smithi042.stdout:(121/125): xmlstarlet-1.6.1-11.el8.x86_64.rpm 4.1 MB/s | 69 kB 00:00 2020-04-02T23:22:20.489 INFO:teuthology.orchestra.run.smithi042.stdout:(122/125): leveldb-1.21-2.el8.x86_64.rpm 37 MB/s | 179 kB 00:00 2020-04-02T23:22:20.745 INFO:teuthology.orchestra.run.smithi042.stdout:(123/125): ceph-mgr-diskprediction-local-16.0.0 5.0 MB/s | 8.6 MB 00:01 2020-04-02T23:22:20.759 INFO:teuthology.orchestra.run.smithi042.stdout:(124/125): librbd1-16.0.0-316.gcbb84f7.el8.x86_ 7.1 MB/s | 1.9 MB 00:00 2020-04-02T23:22:21.092 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2020-04-02T23:22:21.093 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2020-04-02T23:22:21.189 INFO:teuthology.orchestra.run.smithi042.stdout:(125/125): librados2-16.0.0-316.gcbb84f7.el8.x8 5.1 MB/s | 3.6 MB 00:00 2020-04-02T23:22:21.194 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2020-04-02T23:22:21.194 INFO:teuthology.orchestra.run.smithi042.stdout:Total 17 MB/s | 174 MB 00:10 2020-04-02T23:22:21.263 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2020-04-02T23:22:21.382 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2020-04-02T23:22:21.382 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2020-04-02T23:22:22.668 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2020-04-02T23:22:22.668 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2020-04-02T23:22:25.694 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2020-04-02T23:22:25.840 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/127 2020-04-02T23:22:26.011 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 2/127 2020-04-02T23:22:26.191 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/127 2020-04-02T23:22:26.570 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/127 2020-04-02T23:22:26.758 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 4/127 2020-04-02T23:22:26.995 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 4/127 2020-04-02T23:22:27.166 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 5/127 2020-04-02T23:22:27.214 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2020-04-02T23:22:27.274 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 5/127 2020-04-02T23:22:27.391 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/127 2020-04-02T23:22:27.416 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 6/127 2020-04-02T23:22:27.501 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 6/127 2020-04-02T23:22:27.581 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 2/127 2020-04-02T23:22:27.674 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 7/127 2020-04-02T23:22:27.742 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/127 2020-04-02T23:22:27.807 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/127 2020-04-02T23:22:28.153 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/127 2020-04-02T23:22:28.180 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/127 2020-04-02T23:22:28.316 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 9/127 2020-04-02T23:22:28.392 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 4/127 2020-04-02T23:22:28.419 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 9/127 2020-04-02T23:22:28.635 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 4/127 2020-04-02T23:22:28.650 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/127 2020-04-02T23:22:28.774 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 11/127 2020-04-02T23:22:28.825 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 5/127 2020-04-02T23:22:28.897 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 11/127 2020-04-02T23:22:28.927 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 5/127 2020-04-02T23:22:29.059 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 12/127 2020-04-02T23:22:29.092 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 6/127 2020-04-02T23:22:29.167 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 6/127 2020-04-02T23:22:29.171 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-7.2.0-4.el8.noarch 13/127 2020-04-02T23:22:29.325 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 14/127 2020-04-02T23:22:29.335 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 7/127 2020-04-02T23:22:29.491 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/127 2020-04-02T23:22:29.506 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 15/127 2020-04-02T23:22:29.710 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 16/127 2020-04-02T23:22:29.832 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 17/127 2020-04-02T23:22:29.885 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/127 2020-04-02T23:22:30.009 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 17/127 2020-04-02T23:22:30.017 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 9/127 2020-04-02T23:22:30.126 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 9/127 2020-04-02T23:22:30.182 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 18/127 2020-04-02T23:22:30.329 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/127 2020-04-02T23:22:30.475 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 11/127 2020-04-02T23:22:30.599 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 11/127 2020-04-02T23:22:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 18/127 2020-04-02T23:22:30.787 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 12/127 2020-04-02T23:22:30.899 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.3-2.el8.x86_64 19/127 2020-04-02T23:22:30.923 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-more-itertools-7.2.0-4.el8.noarch 13/127 2020-04-02T23:22:31.061 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 14/127 2020-04-02T23:22:31.226 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 15/127 2020-04-02T23:22:31.446 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 19/127 2020-04-02T23:22:31.453 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 16/127 2020-04-02T23:22:31.583 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 17/127 2020-04-02T23:22:31.615 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 20/127 2020-04-02T23:22:31.715 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 17/127 2020-04-02T23:22:31.917 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 18/127 2020-04-02T23:22:32.316 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 20/127 2020-04-02T23:22:32.485 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 18/127 2020-04-02T23:22:32.615 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/127 2020-04-02T23:22:32.633 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-0.3.3-2.el8.x86_64 19/127 2020-04-02T23:22:32.794 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/127 2020-04-02T23:22:32.940 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8. 23/127 2020-04-02T23:22:33.127 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 24/127 2020-04-02T23:22:33.207 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 19/127 2020-04-02T23:22:33.339 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/127 2020-04-02T23:22:33.349 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 20/127 2020-04-02T23:22:34.094 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 20/127 2020-04-02T23:22:34.417 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/127 2020-04-02T23:22:34.563 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/127 2020-04-02T23:22:34.685 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8. 23/127 2020-04-02T23:22:34.936 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 24/127 2020-04-02T23:22:35.116 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/127 2020-04-02T23:22:35.305 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/127 2020-04-02T23:22:35.558 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 26/127 2020-04-02T23:22:35.741 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 27/127 2020-04-02T23:22:35.959 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 28/127 2020-04-02T23:22:36.169 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 29/127 2020-04-02T23:22:36.408 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 30/127 2020-04-02T23:22:36.570 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 31/127 2020-04-02T23:22:36.752 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 32/127 2020-04-02T23:22:36.916 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 33/127 2020-04-02T23:22:37.168 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 34/127 2020-04-02T23:22:37.217 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/127 2020-04-02T23:22:37.382 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 35/127 2020-04-02T23:22:37.461 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 26/127 2020-04-02T23:22:37.545 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 36/127 2020-04-02T23:22:37.693 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 27/127 2020-04-02T23:22:37.769 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 37/127 2020-04-02T23:22:37.894 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 28/127 2020-04-02T23:22:37.974 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 38/127 2020-04-02T23:22:38.099 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 29/127 2020-04-02T23:22:38.164 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 39/127 2020-04-02T23:22:38.352 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 30/127 2020-04-02T23:22:38.421 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 40/127 2020-04-02T23:22:38.517 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 31/127 2020-04-02T23:22:38.640 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 41/127 2020-04-02T23:22:38.797 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 32/127 2020-04-02T23:22:38.954 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 33/127 2020-04-02T23:22:39.186 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 34/127 2020-04-02T23:22:39.345 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 42/127 2020-04-02T23:22:39.360 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 35/127 2020-04-02T23:22:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 36/127 2020-04-02T23:22:39.549 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 43/127 2020-04-02T23:22:39.690 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 37/127 2020-04-02T23:22:39.743 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 44/127 2020-04-02T23:22:39.901 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 38/127 2020-04-02T23:22:39.956 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 45/127 2020-04-02T23:22:40.093 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 39/127 2020-04-02T23:22:40.130 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : leveldb-1.21-2.el8.x86_64 46/127 2020-04-02T23:22:40.272 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/127 2020-04-02T23:22:40.304 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 40/127 2020-04-02T23:22:40.496 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 48/127 2020-04-02T23:22:40.573 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 41/127 2020-04-02T23:22:40.634 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 49/127 2020-04-02T23:22:40.790 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 42/127 2020-04-02T23:22:40.791 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 50/127 2020-04-02T23:22:40.942 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 43/127 2020-04-02T23:22:40.957 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 51/127 2020-04-02T23:22:41.138 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 44/127 2020-04-02T23:22:41.158 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 52/127 2020-04-02T23:22:41.291 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 53/127 2020-04-02T23:22:41.328 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 45/127 2020-04-02T23:22:41.444 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 54/127 2020-04-02T23:22:41.483 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : leveldb-1.21-2.el8.x86_64 46/127 2020-04-02T23:22:41.636 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 55/127 2020-04-02T23:22:41.675 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/127 2020-04-02T23:22:41.832 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 48/127 2020-04-02T23:22:41.870 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 56/127 2020-04-02T23:22:41.996 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 49/127 2020-04-02T23:22:42.068 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 57/127 2020-04-02T23:22:42.136 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 50/127 2020-04-02T23:22:42.337 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 51/127 2020-04-02T23:22:42.341 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 58/127 2020-04-02T23:22:42.495 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 52/127 2020-04-02T23:22:42.602 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 59/127 2020-04-02T23:22:42.627 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 53/127 2020-04-02T23:22:42.746 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 54/127 2020-04-02T23:22:42.819 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 60/127 2020-04-02T23:22:42.935 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 55/127 2020-04-02T23:22:43.124 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 56/127 2020-04-02T23:22:43.325 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 57/127 2020-04-02T23:22:43.589 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 58/127 2020-04-02T23:22:43.866 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 61/127 2020-04-02T23:22:43.992 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 59/127 2020-04-02T23:22:44.123 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-10.0.1-2.el8.noarch 62/127 2020-04-02T23:22:44.309 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 60/127 2020-04-02T23:22:44.682 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 63/127 2020-04-02T23:22:44.981 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 64/127 2020-04-02T23:22:45.156 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 65/127 2020-04-02T23:22:45.261 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 66/127 2020-04-02T23:22:45.403 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 61/127 2020-04-02T23:22:45.433 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 67/127 2020-04-02T23:22:45.627 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-kubernetes-10.0.1-2.el8.noarch 62/127 2020-04-02T23:22:45.659 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 68/127 2020-04-02T23:22:45.815 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 69/127 2020-04-02T23:22:45.861 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 63/127 2020-04-02T23:22:45.999 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 70/127 2020-04-02T23:22:46.141 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 64/127 2020-04-02T23:22:46.189 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 71/127 2020-04-02T23:22:46.317 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 65/127 2020-04-02T23:22:46.389 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 72/127 2020-04-02T23:22:46.389 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 73/127 2020-04-02T23:22:46.390 INFO:teuthology.orchestra.run.smithi084.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-04-02T23:22:46.390 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:22:46.456 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 66/127 2020-04-02T23:22:46.608 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 67/127 2020-04-02T23:22:46.738 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.7-12.el8.x86_64 74/127 2020-04-02T23:22:46.865 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 68/127 2020-04-02T23:22:46.897 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 75/127 2020-04-02T23:22:47.027 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 69/127 2020-04-02T23:22:47.174 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 76/127 2020-04-02T23:22:47.177 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 70/127 2020-04-02T23:22:47.375 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 71/127 2020-04-02T23:22:47.390 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 77/127 2020-04-02T23:22:47.584 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 72/127 2020-04-02T23:22:47.584 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 73/127 2020-04-02T23:22:47.584 INFO:teuthology.orchestra.run.smithi042.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-04-02T23:22:47.585 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:22:47.737 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 78/127 2020-04-02T23:22:47.944 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : fuse-2.9.7-12.el8.x86_64 74/127 2020-04-02T23:22:48.008 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 79/127 2020-04-02T23:22:48.119 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 75/127 2020-04-02T23:22:48.201 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/127 2020-04-02T23:22:48.364 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 76/127 2020-04-02T23:22:48.405 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 81/127 2020-04-02T23:22:48.547 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 77/127 2020-04-02T23:22:48.613 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/127 2020-04-02T23:22:48.861 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/127 2020-04-02T23:22:48.945 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 78/127 2020-04-02T23:22:49.128 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/127 2020-04-02T23:22:49.201 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 79/127 2020-04-02T23:22:49.324 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 85/127 2020-04-02T23:22:49.388 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/127 2020-04-02T23:22:49.535 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 81/127 2020-04-02T23:22:49.565 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 86/127 2020-04-02T23:22:49.720 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/127 2020-04-02T23:22:49.893 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 87/127 2020-04-02T23:22:49.964 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/127 2020-04-02T23:22:50.151 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 88/127 2020-04-02T23:22:50.187 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/127 2020-04-02T23:22:50.368 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 85/127 2020-04-02T23:22:50.376 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 89/127 2020-04-02T23:22:50.598 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 90/127 2020-04-02T23:22:50.602 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 86/127 2020-04-02T23:22:50.752 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 91/127 2020-04-02T23:22:50.817 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 91/127 2020-04-02T23:22:50.917 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 87/127 2020-04-02T23:22:51.127 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : jq-1.5-12.el8.x86_64 92/127 2020-04-02T23:22:51.129 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 88/127 2020-04-02T23:22:51.297 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 89/127 2020-04-02T23:22:51.387 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : automake-1.16.1-6.el8.noarch 93/127 2020-04-02T23:22:51.494 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 90/127 2020-04-02T23:22:51.500 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8 94/127 2020-04-02T23:22:51.639 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 91/127 2020-04-02T23:22:51.665 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el 95/127 2020-04-02T23:22:51.725 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 91/127 2020-04-02T23:22:51.878 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x8 96/127 2020-04-02T23:22:51.992 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : jq-1.5-12.el8.x86_64 92/127 2020-04-02T23:22:52.204 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : automake-1.16.1-6.el8.noarch 93/127 2020-04-02T23:22:52.338 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8 94/127 2020-04-02T23:22:52.499 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el 95/127 2020-04-02T23:22:52.689 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x8 96/127 2020-04-02T23:22:55.298 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/127 2020-04-02T23:22:55.551 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/127 2020-04-02T23:22:56.240 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/127 2020-04-02T23:22:56.404 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/127 2020-04-02T23:22:56.540 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 98/127 2020-04-02T23:22:56.622 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/127 2020-04-02T23:22:56.628 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 98/127 2020-04-02T23:22:56.809 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 99/127 2020-04-02T23:22:57.366 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 97/127 2020-04-02T23:22:57.640 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 98/127 2020-04-02T23:22:57.708 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 98/127 2020-04-02T23:22:57.846 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 99/127 2020-04-02T23:23:13.085 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 99/127 2020-04-02T23:23:13.085 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2020-04-02T23:23:13.086 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2020-04-02T23:23:13.086 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /dev 2020-04-02T23:23:13.086 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /run 2020-04-02T23:23:13.086 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2020-04-02T23:23:13.086 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2020-04-02T23:23:13.086 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2020-04-02T23:23:13.086 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2020-04-02T23:23:13.087 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /dev 2020-04-02T23:23:13.087 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:13.481 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 100/127 2020-04-02T23:23:13.872 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 100/127 2020-04-02T23:23:14.089 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 101/127 2020-04-02T23:23:14.666 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 99/127 2020-04-02T23:23:14.666 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /sys 2020-04-02T23:23:14.666 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /proc 2020-04-02T23:23:14.666 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /dev 2020-04-02T23:23:14.666 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /run 2020-04-02T23:23:14.667 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /mnt 2020-04-02T23:23:14.667 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /var/tmp 2020-04-02T23:23:14.667 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /home 2020-04-02T23:23:14.667 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /tmp 2020-04-02T23:23:14.667 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /dev 2020-04-02T23:23:14.667 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:15.053 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 100/127 2020-04-02T23:23:15.469 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 100/127 2020-04-02T23:23:15.516 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 101/127 2020-04-02T23:23:15.669 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 101/127 2020-04-02T23:23:15.705 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 102/127 2020-04-02T23:23:15.729 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 102/127 2020-04-02T23:23:17.180 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 101/127 2020-04-02T23:23:17.486 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 102/127 2020-04-02T23:23:17.509 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 102/127 2020-04-02T23:23:17.671 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 103/127 2020-04-02T23:23:17.833 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 103/127 2020-04-02T23:23:17.971 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 104/127 2020-04-02T23:23:18.817 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 104/127 2020-04-02T23:23:18.896 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 103/127 2020-04-02T23:23:19.036 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 103/127 2020-04-02T23:23:19.062 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 105/127 2020-04-02T23:23:19.193 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 104/127 2020-04-02T23:23:20.095 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 104/127 2020-04-02T23:23:20.101 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 105/127 2020-04-02T23:23:20.320 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 106/127 2020-04-02T23:23:20.352 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 105/127 2020-04-02T23:23:20.390 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 106/127 2020-04-02T23:23:20.722 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8. 107/127 2020-04-02T23:23:20.884 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 108/127 2020-04-02T23:23:20.912 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 108/127 2020-04-02T23:23:21.115 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 109/127 2020-04-02T23:23:21.130 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 109/127 2020-04-02T23:23:21.460 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 105/127 2020-04-02T23:23:21.627 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 106/127 2020-04-02T23:23:21.698 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 106/127 2020-04-02T23:23:22.054 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8. 107/127 2020-04-02T23:23:22.092 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 110/127 2020-04-02T23:23:22.262 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 111/127 2020-04-02T23:23:22.590 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 111/127 2020-04-02T23:23:22.595 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 108/127 2020-04-02T23:23:22.624 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 108/127 2020-04-02T23:23:22.821 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 109/127 2020-04-02T23:23:22.835 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 109/127 2020-04-02T23:23:23.037 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 112/127 2020-04-02T23:23:23.885 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 110/127 2020-04-02T23:23:24.052 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 111/127 2020-04-02T23:23:24.380 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 111/127 2020-04-02T23:23:24.551 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 112/127 2020-04-02T23:23:26.952 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 112/127 2020-04-02T23:23:27.278 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 113/127 2020-04-02T23:23:27.436 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libtool-2.4.6-25.el8.x86_64 114/127 2020-04-02T23:23:27.496 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 114/127 2020-04-02T23:23:28.381 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 115/127 2020-04-02T23:23:28.810 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 112/127 2020-04-02T23:23:29.356 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 113/127 2020-04-02T23:23:29.517 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libtool-2.4.6-25.el8.x86_64 114/127 2020-04-02T23:23:29.579 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 114/127 2020-04-02T23:23:29.757 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openssl-devel-1:1.1.1c-2.el8.x86_64 116/127 2020-04-02T23:23:29.889 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 117/127 2020-04-02T23:23:29.996 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 118/127 2020-04-02T23:23:30.134 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 119/127 2020-04-02T23:23:30.307 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 120/127 2020-04-02T23:23:30.489 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 121/127 2020-04-02T23:23:30.536 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 115/127 2020-04-02T23:23:30.672 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 122/127 2020-04-02T23:23:30.698 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 122/127 2020-04-02T23:23:30.812 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openssl-devel-1:1.1.1c-2.el8.x86_64 116/127 2020-04-02T23:23:30.869 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 123/127 2020-04-02T23:23:31.043 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flex-2.6.1-9.el8.x86_64 124/127 2020-04-02T23:23:31.087 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 117/127 2020-04-02T23:23:31.144 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 124/127 2020-04-02T23:23:31.237 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 118/127 2020-04-02T23:23:31.377 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : bison-3.0.4-10.el8.x86_64 125/127 2020-04-02T23:23:31.392 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 125/127 2020-04-02T23:23:31.392 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 126/127 2020-04-02T23:23:31.392 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 119/127 2020-04-02T23:23:31.590 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 120/127 2020-04-02T23:23:31.649 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 126/127 2020-04-02T23:23:31.649 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/127 2020-04-02T23:23:31.772 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 121/127 2020-04-02T23:23:31.968 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 122/127 2020-04-02T23:23:31.992 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 122/127 2020-04-02T23:23:32.173 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 123/127 2020-04-02T23:23:32.333 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flex-2.6.1-9.el8.x86_64 124/127 2020-04-02T23:23:32.433 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/127 2020-04-02T23:23:32.434 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 1/127 2020-04-02T23:23:32.434 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 2/127 2020-04-02T23:23:32.434 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 3/127 2020-04-02T23:23:32.434 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 4/127 2020-04-02T23:23:32.434 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 5/127 2020-04-02T23:23:32.434 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 6/127 2020-04-02T23:23:32.434 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 7/127 2020-04-02T23:23:32.435 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 8/127 2020-04-02T23:23:32.435 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 9/127 2020-04-02T23:23:32.435 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 10/127 2020-04-02T23:23:32.435 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 11/127 2020-04-02T23:23:32.435 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 12/127 2020-04-02T23:23:32.435 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 13/127 2020-04-02T23:23:32.435 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 14/127 2020-04-02T23:23:32.436 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 15/127 2020-04-02T23:23:32.436 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 16/127 2020-04-02T23:23:32.436 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 17/127 2020-04-02T23:23:32.436 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 18/127 2020-04-02T23:23:32.436 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8. 19/127 2020-04-02T23:23:32.436 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x8 20/127 2020-04-02T23:23:32.436 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 21/127 2020-04-02T23:23:32.436 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 22/127 2020-04-02T23:23:32.437 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 23/127 2020-04-02T23:23:32.437 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 24/127 2020-04-02T23:23:32.437 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 25/127 2020-04-02T23:23:32.437 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 26/127 2020-04-02T23:23:32.437 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 27/127 2020-04-02T23:23:32.437 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el 28/127 2020-04-02T23:23:32.437 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 29/127 2020-04-02T23:23:32.438 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 30/127 2020-04-02T23:23:32.438 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 31/127 2020-04-02T23:23:32.438 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8. 32/127 2020-04-02T23:23:32.438 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 33/127 2020-04-02T23:23:32.438 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8 34/127 2020-04-02T23:23:32.438 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : automake-1.16.1-6.el8.noarch 35/127 2020-04-02T23:23:32.438 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : bison-3.0.4-10.el8.x86_64 36/127 2020-04-02T23:23:32.438 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flex-2.6.1-9.el8.x86_64 37/127 2020-04-02T23:23:32.439 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : jq-1.5-12.el8.x86_64 38/127 2020-04-02T23:23:32.439 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 39/127 2020-04-02T23:23:32.439 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 40/127 2020-04-02T23:23:32.439 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 41/127 2020-04-02T23:23:32.439 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 42/127 2020-04-02T23:23:32.439 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 43/127 2020-04-02T23:23:32.439 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 44/127 2020-04-02T23:23:32.440 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 45/127 2020-04-02T23:23:32.440 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 46/127 2020-04-02T23:23:32.440 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 47/127 2020-04-02T23:23:32.440 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 48/127 2020-04-02T23:23:32.440 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 49/127 2020-04-02T23:23:32.440 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 50/127 2020-04-02T23:23:32.440 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 51/127 2020-04-02T23:23:32.440 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 52/127 2020-04-02T23:23:32.441 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 53/127 2020-04-02T23:23:32.441 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 54/127 2020-04-02T23:23:32.441 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 55/127 2020-04-02T23:23:32.441 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 56/127 2020-04-02T23:23:32.441 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 57/127 2020-04-02T23:23:32.441 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 58/127 2020-04-02T23:23:32.441 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 59/127 2020-04-02T23:23:32.442 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 60/127 2020-04-02T23:23:32.442 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 61/127 2020-04-02T23:23:32.442 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 62/127 2020-04-02T23:23:32.442 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 63/127 2020-04-02T23:23:32.442 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 64/127 2020-04-02T23:23:32.442 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 65/127 2020-04-02T23:23:32.442 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 66/127 2020-04-02T23:23:32.442 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 67/127 2020-04-02T23:23:32.443 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 68/127 2020-04-02T23:23:32.443 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 69/127 2020-04-02T23:23:32.443 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 70/127 2020-04-02T23:23:32.443 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 71/127 2020-04-02T23:23:32.443 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 72/127 2020-04-02T23:23:32.443 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 73/127 2020-04-02T23:23:32.443 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 74/127 2020-04-02T23:23:32.444 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 75/127 2020-04-02T23:23:32.444 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8.x86_64 76/127 2020-04-02T23:23:32.444 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 77/127 2020-04-02T23:23:32.444 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 78/127 2020-04-02T23:23:32.444 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 79/127 2020-04-02T23:23:32.444 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 80/127 2020-04-02T23:23:32.444 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 81/127 2020-04-02T23:23:32.444 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 82/127 2020-04-02T23:23:32.445 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 83/127 2020-04-02T23:23:32.445 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 84/127 2020-04-02T23:23:32.445 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 85/127 2020-04-02T23:23:32.445 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 86/127 2020-04-02T23:23:32.445 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 87/127 2020-04-02T23:23:32.445 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 88/127 2020-04-02T23:23:32.445 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 89/127 2020-04-02T23:23:32.446 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 90/127 2020-04-02T23:23:32.446 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 91/127 2020-04-02T23:23:32.446 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 92/127 2020-04-02T23:23:32.447 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 93/127 2020-04-02T23:23:32.447 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 94/127 2020-04-02T23:23:32.447 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-7.2.0-4.el8.noarch 95/127 2020-04-02T23:23:32.447 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 96/127 2020-04-02T23:23:32.447 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-2.6-1.el8.noarch 97/127 2020-04-02T23:23:32.447 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 98/127 2020-04-02T23:23:32.448 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 99/127 2020-04-02T23:23:32.448 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 100/127 2020-04-02T23:23:32.448 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 101/127 2020-04-02T23:23:32.449 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 102/127 2020-04-02T23:23:32.449 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 103/127 2020-04-02T23:23:32.449 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 104/127 2020-04-02T23:23:32.449 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 105/127 2020-04-02T23:23:32.449 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 106/127 2020-04-02T23:23:32.449 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 107/127 2020-04-02T23:23:32.449 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 108/127 2020-04-02T23:23:32.450 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 109/127 2020-04-02T23:23:32.450 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 110/127 2020-04-02T23:23:32.450 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 111/127 2020-04-02T23:23:32.450 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 112/127 2020-04-02T23:23:32.450 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 113/127 2020-04-02T23:23:32.450 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 114/127 2020-04-02T23:23:32.450 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 115/127 2020-04-02T23:23:32.450 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-10.0.1-2.el8.noarch 116/127 2020-04-02T23:23:32.451 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 117/127 2020-04-02T23:23:32.451 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 118/127 2020-04-02T23:23:32.451 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 119/127 2020-04-02T23:23:32.451 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 120/127 2020-04-02T23:23:32.451 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 121/127 2020-04-02T23:23:32.451 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 122/127 2020-04-02T23:23:32.451 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : leveldb-1.21-2.el8.x86_64 123/127 2020-04-02T23:23:32.452 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 124/127 2020-04-02T23:23:32.452 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/127 2020-04-02T23:23:32.452 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 126/127 2020-04-02T23:23:32.452 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 124/127 2020-04-02T23:23:32.659 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : bison-3.0.4-10.el8.x86_64 125/127 2020-04-02T23:23:32.673 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 125/127 2020-04-02T23:23:32.674 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 126/127 2020-04-02T23:23:32.904 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 126/127 2020-04-02T23:23:32.904 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/127 2020-04-02T23:23:33.727 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/127 2020-04-02T23:23:33.727 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 1/127 2020-04-02T23:23:33.727 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 2/127 2020-04-02T23:23:33.727 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 3/127 2020-04-02T23:23:33.728 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 4/127 2020-04-02T23:23:33.728 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-316.gcbb84f 5/127 2020-04-02T23:23:33.728 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 6/127 2020-04-02T23:23:33.728 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 7/127 2020-04-02T23:23:33.728 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 8/127 2020-04-02T23:23:33.728 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 9/127 2020-04-02T23:23:33.728 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 10/127 2020-04-02T23:23:33.729 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 11/127 2020-04-02T23:23:33.729 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 12/127 2020-04-02T23:23:33.729 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 13/127 2020-04-02T23:23:33.729 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 14/127 2020-04-02T23:23:33.729 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 15/127 2020-04-02T23:23:33.729 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 16/127 2020-04-02T23:23:33.729 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_6 17/127 2020-04-02T23:23:33.729 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 18/127 2020-04-02T23:23:33.730 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8. 19/127 2020-04-02T23:23:33.730 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x8 20/127 2020-04-02T23:23:33.730 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 21/127 2020-04-02T23:23:33.730 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 22/127 2020-04-02T23:23:33.730 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 23/127 2020-04-02T23:23:33.730 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 24/127 2020-04-02T23:23:33.730 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 25/127 2020-04-02T23:23:33.730 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 26/127 2020-04-02T23:23:33.731 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 27/127 2020-04-02T23:23:33.731 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el 28/127 2020-04-02T23:23:33.731 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarc 29/127 2020-04-02T23:23:33.731 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noa 30/127 2020-04-02T23:23:33.739 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb8 31/127 2020-04-02T23:23:33.739 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8. 32/127 2020-04-02T23:23:33.739 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 33/127 2020-04-02T23:23:33.740 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8 34/127 2020-04-02T23:23:33.740 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : automake-1.16.1-6.el8.noarch 35/127 2020-04-02T23:23:33.740 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : bison-3.0.4-10.el8.x86_64 36/127 2020-04-02T23:23:33.740 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flex-2.6.1-9.el8.x86_64 37/127 2020-04-02T23:23:33.740 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : jq-1.5-12.el8.x86_64 38/127 2020-04-02T23:23:33.740 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 39/127 2020-04-02T23:23:33.740 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 40/127 2020-04-02T23:23:33.740 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 41/127 2020-04-02T23:23:33.741 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 42/127 2020-04-02T23:23:33.741 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 43/127 2020-04-02T23:23:33.741 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 44/127 2020-04-02T23:23:33.741 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 45/127 2020-04-02T23:23:33.741 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 46/127 2020-04-02T23:23:33.741 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 47/127 2020-04-02T23:23:33.741 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 48/127 2020-04-02T23:23:33.742 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 49/127 2020-04-02T23:23:33.742 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 50/127 2020-04-02T23:23:33.742 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 51/127 2020-04-02T23:23:33.742 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 52/127 2020-04-02T23:23:33.742 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 53/127 2020-04-02T23:23:33.742 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 54/127 2020-04-02T23:23:33.742 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 55/127 2020-04-02T23:23:33.743 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 56/127 2020-04-02T23:23:33.743 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 57/127 2020-04-02T23:23:33.743 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 58/127 2020-04-02T23:23:33.743 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 59/127 2020-04-02T23:23:33.743 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 60/127 2020-04-02T23:23:33.743 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 61/127 2020-04-02T23:23:33.743 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 62/127 2020-04-02T23:23:33.744 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 63/127 2020-04-02T23:23:33.744 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 64/127 2020-04-02T23:23:33.744 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 65/127 2020-04-02T23:23:33.744 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 66/127 2020-04-02T23:23:33.744 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 67/127 2020-04-02T23:23:33.744 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 68/127 2020-04-02T23:23:33.744 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 69/127 2020-04-02T23:23:33.744 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 70/127 2020-04-02T23:23:33.745 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 71/127 2020-04-02T23:23:33.745 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 72/127 2020-04-02T23:23:33.745 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 73/127 2020-04-02T23:23:33.745 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 74/127 2020-04-02T23:23:33.745 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 75/127 2020-04-02T23:23:33.745 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8.x86_64 76/127 2020-04-02T23:23:33.745 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 77/127 2020-04-02T23:23:33.746 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 78/127 2020-04-02T23:23:33.746 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 79/127 2020-04-02T23:23:33.746 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 80/127 2020-04-02T23:23:33.746 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 81/127 2020-04-02T23:23:33.746 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 82/127 2020-04-02T23:23:33.746 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 83/127 2020-04-02T23:23:33.746 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 84/127 2020-04-02T23:23:33.746 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 85/127 2020-04-02T23:23:33.747 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 86/127 2020-04-02T23:23:33.747 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 87/127 2020-04-02T23:23:33.747 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 88/127 2020-04-02T23:23:33.747 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 89/127 2020-04-02T23:23:33.747 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 90/127 2020-04-02T23:23:33.747 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 91/127 2020-04-02T23:23:33.747 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 92/127 2020-04-02T23:23:33.747 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 93/127 2020-04-02T23:23:33.748 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 94/127 2020-04-02T23:23:33.748 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-more-itertools-7.2.0-4.el8.noarch 95/127 2020-04-02T23:23:33.748 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 96/127 2020-04-02T23:23:33.748 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-portend-2.6-1.el8.noarch 97/127 2020-04-02T23:23:33.748 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 98/127 2020-04-02T23:23:33.748 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 99/127 2020-04-02T23:23:33.748 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 100/127 2020-04-02T23:23:33.749 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 101/127 2020-04-02T23:23:33.749 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 102/127 2020-04-02T23:23:33.749 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 103/127 2020-04-02T23:23:33.750 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 104/127 2020-04-02T23:23:33.750 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 105/127 2020-04-02T23:23:33.750 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 106/127 2020-04-02T23:23:33.750 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 107/127 2020-04-02T23:23:33.750 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 108/127 2020-04-02T23:23:33.750 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 109/127 2020-04-02T23:23:33.750 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 110/127 2020-04-02T23:23:33.751 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 111/127 2020-04-02T23:23:33.751 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 112/127 2020-04-02T23:23:33.751 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 113/127 2020-04-02T23:23:33.751 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 114/127 2020-04-02T23:23:33.751 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 115/127 2020-04-02T23:23:33.751 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-kubernetes-10.0.1-2.el8.noarch 116/127 2020-04-02T23:23:33.751 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 117/127 2020-04-02T23:23:33.751 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 118/127 2020-04-02T23:23:33.752 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 119/127 2020-04-02T23:23:33.752 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 120/127 2020-04-02T23:23:33.752 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 121/127 2020-04-02T23:23:33.752 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 122/127 2020-04-02T23:23:33.752 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : leveldb-1.21-2.el8.x86_64 123/127 2020-04-02T23:23:33.752 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 124/127 2020-04-02T23:23:33.752 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/127 2020-04-02T23:23:33.753 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 126/127 2020-04-02T23:23:34.038 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/127 2020-04-02T23:23:34.039 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:34.039 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2020-04-02T23:23:34.039 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.039 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.039 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:34.039 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2020-04-02T23:23:34.040 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.040 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.040 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.040 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.040 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.040 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.040 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.040 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.041 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.041 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.041 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.041 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.041 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.041 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.041 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.042 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.042 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.042 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.042 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:23:34.042 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:23:34.042 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:23:34.042 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:23:34.042 INFO:teuthology.orchestra.run.smithi084.stdout: bison-3.0.4-10.el8.x86_64 2020-04-02T23:23:34.043 INFO:teuthology.orchestra.run.smithi084.stdout: flex-2.6.1-9.el8.x86_64 2020-04-02T23:23:34.043 INFO:teuthology.orchestra.run.smithi084.stdout: libtool-2.4.6-25.el8.x86_64 2020-04-02T23:23:34.043 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-04-02T23:23:34.043 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-04-02T23:23:34.043 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-04-02T23:23:34.043 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel-1:1.1.1c-2.el8.x86_64 2020-04-02T23:23:34.043 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-04-02T23:23:34.044 INFO:teuthology.orchestra.run.smithi084.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-04-02T23:23:34.044 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-04-02T23:23:34.044 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.044 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.044 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.044 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.044 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.045 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.045 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.045 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.046 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:34.046 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:23:34.046 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:23:34.046 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:23:34.046 INFO:teuthology.orchestra.run.smithi084.stdout: automake-1.16.1-6.el8.noarch 2020-04-02T23:23:34.046 INFO:teuthology.orchestra.run.smithi084.stdout: jq-1.5-12.el8.x86_64 2020-04-02T23:23:34.046 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-04-02T23:23:34.046 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-04-02T23:23:34.047 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-04-02T23:23:34.047 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.3-2.el8.x86_64 2020-04-02T23:23:34.047 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-04-02T23:23:34.047 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-04-02T23:23:34.047 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-04-02T23:23:34.047 INFO:teuthology.orchestra.run.smithi084.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-04-02T23:23:34.047 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.0.6-13.el8.noarch 2020-04-02T23:23:34.048 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-04-02T23:23:34.048 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-04-02T23:23:34.048 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-04-02T23:23:34.048 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-04-02T23:23:34.048 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-04-02T23:23:34.048 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-04-02T23:23:34.048 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2017.2-9.el8.noarch 2020-04-02T23:23:34.048 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-04-02T23:23:34.049 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-04-02T23:23:34.049 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-04-02T23:23:34.049 INFO:teuthology.orchestra.run.smithi084.stdout: socat-1.7.3.2-6.el8.x86_64 2020-04-02T23:23:34.049 INFO:teuthology.orchestra.run.smithi084.stdout: fuse-2.9.7-12.el8.x86_64 2020-04-02T23:23:34.049 INFO:teuthology.orchestra.run.smithi084.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-04-02T23:23:34.049 INFO:teuthology.orchestra.run.smithi084.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-04-02T23:23:34.049 INFO:teuthology.orchestra.run.smithi084.stdout: krb5-devel-1.17-9.el8.x86_64 2020-04-02T23:23:34.049 INFO:teuthology.orchestra.run.smithi084.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-04-02T23:23:34.050 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-04-02T23:23:34.050 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-04-02T23:23:34.050 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-04-02T23:23:34.050 INFO:teuthology.orchestra.run.smithi084.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-04-02T23:23:34.050 INFO:teuthology.orchestra.run.smithi084.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-04-02T23:23:34.050 INFO:teuthology.orchestra.run.smithi084.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-04-02T23:23:34.050 INFO:teuthology.orchestra.run.smithi084.stdout: libxslt-1.1.32-3.el8.x86_64 2020-04-02T23:23:34.050 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-04-02T23:23:34.051 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-04-02T23:23:34.051 INFO:teuthology.orchestra.run.smithi084.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-04-02T23:23:34.051 INFO:teuthology.orchestra.run.smithi084.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-04-02T23:23:34.051 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-04-02T23:23:34.051 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-04-02T23:23:34.051 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-04-02T23:23:34.051 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-04-02T23:23:34.052 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-04-02T23:23:34.052 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-04-02T23:23:34.052 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-04-02T23:23:34.052 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-04-02T23:23:34.052 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-04-02T23:23:34.052 INFO:teuthology.orchestra.run.smithi084.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-04-02T23:23:34.052 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-6.2-6.el8.noarch 2020-04-02T23:23:34.052 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-04-02T23:23:34.053 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-04-02T23:23:34.053 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-7.2.0-4.el8.noarch 2020-04-02T23:23:34.053 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-04-02T23:23:34.053 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-2.6-1.el8.noarch 2020-04-02T23:23:34.053 INFO:teuthology.orchestra.run.smithi084.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-04-02T23:23:34.053 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-04-02T23:23:34.053 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.4.1-12.el8.noarch 2020-04-02T23:23:34.054 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-04-02T23:23:34.054 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-04-02T23:23:34.054 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-04-02T23:23:34.054 INFO:teuthology.orchestra.run.smithi084.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-04-02T23:23:34.054 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-04-02T23:23:34.054 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-04-02T23:23:34.054 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.2-3.el8.x86_64 2020-04-02T23:23:34.054 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.3.1-3.el8.x86_64 2020-04-02T23:23:34.055 INFO:teuthology.orchestra.run.smithi084.stdout: python3-apipkg-1.5-6.el8.noarch 2020-04-02T23:23:34.055 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-04-02T23:23:34.055 INFO:teuthology.orchestra.run.smithi084.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-04-02T23:23:34.055 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-04-02T23:23:34.056 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-04-02T23:23:34.056 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-04-02T23:23:34.056 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-10.0.1-2.el8.noarch 2020-04-02T23:23:34.056 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-04-02T23:23:34.056 INFO:teuthology.orchestra.run.smithi084.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-04-02T23:23:34.056 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-04-02T23:23:34.056 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-04-02T23:23:34.056 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-04-02T23:23:34.057 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-04-02T23:23:34.057 INFO:teuthology.orchestra.run.smithi084.stdout: leveldb-1.21-2.el8.x86_64 2020-04-02T23:23:34.057 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:34.057 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2020-04-02T23:23:34.181 DEBUG:teuthology.parallel:result is None 2020-04-02T23:23:35.288 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/127 2020-04-02T23:23:35.289 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:35.289 INFO:teuthology.orchestra.run.smithi042.stdout:Upgraded: 2020-04-02T23:23:35.289 INFO:teuthology.orchestra.run.smithi042.stdout: librados2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.289 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.289 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:35.289 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2020-04-02T23:23:35.290 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.290 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.290 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.290 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.290 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.290 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.290 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.291 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.291 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.291 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.291 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.291 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.291 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.291 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.291 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.292 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.292 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.292 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.292 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:23:35.292 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:23:35.292 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:23:35.292 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:23:35.293 INFO:teuthology.orchestra.run.smithi042.stdout: bison-3.0.4-10.el8.x86_64 2020-04-02T23:23:35.293 INFO:teuthology.orchestra.run.smithi042.stdout: flex-2.6.1-9.el8.x86_64 2020-04-02T23:23:35.293 INFO:teuthology.orchestra.run.smithi042.stdout: libtool-2.4.6-25.el8.x86_64 2020-04-02T23:23:35.293 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-04-02T23:23:35.293 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-04-02T23:23:35.293 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-04-02T23:23:35.293 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel-1:1.1.1c-2.el8.x86_64 2020-04-02T23:23:35.294 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-04-02T23:23:35.294 INFO:teuthology.orchestra.run.smithi042.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-04-02T23:23:35.294 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-04-02T23:23:35.294 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.294 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.294 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.294 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.294 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.295 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.295 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.295 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.295 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common-2:16.0.0-316.gcbb84f7.el8.x86_64 2020-04-02T23:23:35.295 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:23:35.295 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:23:35.295 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts-2:16.0.0-316.gcbb84f7.el8.noarch 2020-04-02T23:23:35.295 INFO:teuthology.orchestra.run.smithi042.stdout: automake-1.16.1-6.el8.noarch 2020-04-02T23:23:35.296 INFO:teuthology.orchestra.run.smithi042.stdout: jq-1.5-12.el8.x86_64 2020-04-02T23:23:35.296 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-04-02T23:23:35.296 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-04-02T23:23:35.296 INFO:teuthology.orchestra.run.smithi042.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-04-02T23:23:35.296 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-0.3.3-2.el8.x86_64 2020-04-02T23:23:35.296 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-04-02T23:23:35.296 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-04-02T23:23:35.297 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-04-02T23:23:35.297 INFO:teuthology.orchestra.run.smithi042.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-04-02T23:23:35.297 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako-1.0.6-13.el8.noarch 2020-04-02T23:23:35.297 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-04-02T23:23:35.297 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-04-02T23:23:35.298 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-04-02T23:23:35.298 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-04-02T23:23:35.298 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-04-02T23:23:35.298 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-04-02T23:23:35.298 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz-2017.2-9.el8.noarch 2020-04-02T23:23:35.298 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-04-02T23:23:35.298 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-04-02T23:23:35.298 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-04-02T23:23:35.299 INFO:teuthology.orchestra.run.smithi042.stdout: socat-1.7.3.2-6.el8.x86_64 2020-04-02T23:23:35.299 INFO:teuthology.orchestra.run.smithi042.stdout: fuse-2.9.7-12.el8.x86_64 2020-04-02T23:23:35.299 INFO:teuthology.orchestra.run.smithi042.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-04-02T23:23:35.299 INFO:teuthology.orchestra.run.smithi042.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-04-02T23:23:35.299 INFO:teuthology.orchestra.run.smithi042.stdout: krb5-devel-1.17-9.el8.x86_64 2020-04-02T23:23:35.299 INFO:teuthology.orchestra.run.smithi042.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-04-02T23:23:35.299 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-04-02T23:23:35.299 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-04-02T23:23:35.300 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-04-02T23:23:35.300 INFO:teuthology.orchestra.run.smithi042.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-04-02T23:23:35.300 INFO:teuthology.orchestra.run.smithi042.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-04-02T23:23:35.300 INFO:teuthology.orchestra.run.smithi042.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-04-02T23:23:35.300 INFO:teuthology.orchestra.run.smithi042.stdout: libxslt-1.1.32-3.el8.x86_64 2020-04-02T23:23:35.300 INFO:teuthology.orchestra.run.smithi042.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-04-02T23:23:35.301 INFO:teuthology.orchestra.run.smithi042.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-04-02T23:23:35.301 INFO:teuthology.orchestra.run.smithi042.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-04-02T23:23:35.301 INFO:teuthology.orchestra.run.smithi042.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-04-02T23:23:35.301 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-04-02T23:23:35.301 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-04-02T23:23:35.301 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-04-02T23:23:35.301 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-04-02T23:23:35.301 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-04-02T23:23:35.302 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-04-02T23:23:35.302 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-04-02T23:23:35.302 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-04-02T23:23:35.302 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-04-02T23:23:35.302 INFO:teuthology.orchestra.run.smithi042.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-04-02T23:23:35.302 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-6.2-6.el8.noarch 2020-04-02T23:23:35.302 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-04-02T23:23:35.303 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-04-02T23:23:35.303 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools-7.2.0-4.el8.noarch 2020-04-02T23:23:35.303 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-04-02T23:23:35.303 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend-2.6-1.el8.noarch 2020-04-02T23:23:35.303 INFO:teuthology.orchestra.run.smithi042.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-04-02T23:23:35.303 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-04-02T23:23:35.303 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes-2.4.1-12.el8.noarch 2020-04-02T23:23:35.303 INFO:teuthology.orchestra.run.smithi042.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-04-02T23:23:35.304 INFO:teuthology.orchestra.run.smithi042.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-04-02T23:23:35.304 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-04-02T23:23:35.304 INFO:teuthology.orchestra.run.smithi042.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-04-02T23:23:35.304 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-04-02T23:23:35.304 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-04-02T23:23:35.304 INFO:teuthology.orchestra.run.smithi042.stdout: liboath-2.6.2-3.el8.x86_64 2020-04-02T23:23:35.304 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind-1.3.1-3.el8.x86_64 2020-04-02T23:23:35.304 INFO:teuthology.orchestra.run.smithi042.stdout: python3-apipkg-1.5-6.el8.noarch 2020-04-02T23:23:35.305 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-04-02T23:23:35.305 INFO:teuthology.orchestra.run.smithi042.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-04-02T23:23:35.305 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-04-02T23:23:35.305 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-04-02T23:23:35.305 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-04-02T23:23:35.305 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes-10.0.1-2.el8.noarch 2020-04-02T23:23:35.305 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-04-02T23:23:35.306 INFO:teuthology.orchestra.run.smithi042.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-04-02T23:23:35.306 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-04-02T23:23:35.306 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-04-02T23:23:35.306 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-04-02T23:23:35.306 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-04-02T23:23:35.306 INFO:teuthology.orchestra.run.smithi042.stdout: leveldb-1.21-2.el8.x86_64 2020-04-02T23:23:35.306 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:35.307 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2020-04-02T23:23:35.469 DEBUG:teuthology.parallel:result is None 2020-04-02T23:23:35.469 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:35.487 INFO:teuthology.orchestra.run.smithi084:> sudo lsb_release -is 2020-04-02T23:23:35.574 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS 2020-04-02T23:23:35.575 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:23:35.575 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:23:35.824 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:35.839 INFO:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-04-02T23:23:35.898 INFO:teuthology.orchestra.run.smithi084.stdout:16.0.0-316.gcbb84f7.el8 2020-04-02T23:23:35.898 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-316.gcbb84f7.el8 2020-04-02T23:23:35.899 INFO:teuthology.task.install:The correct ceph version 16.0.0-316.gcbb84f7 is installed. 2020-04-02T23:23:35.899 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:35.914 INFO:teuthology.orchestra.run.smithi042:> sudo lsb_release -is 2020-04-02T23:23:36.007 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS 2020-04-02T23:23:36.008 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-02T23:23:36.008 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:23:36.249 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:36.263 INFO:teuthology.orchestra.run.smithi042:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-04-02T23:23:36.324 INFO:teuthology.orchestra.run.smithi042.stdout:16.0.0-316.gcbb84f7.el8 2020-04-02T23:23:36.324 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-316.gcbb84f7.el8 2020-04-02T23:23:36.324 INFO:teuthology.task.install:The correct ceph version 16.0.0-316.gcbb84f7 is installed. 2020-04-02T23:23:36.325 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-04-02T23:23:36.325 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:36.340 INFO:teuthology.orchestra.run.smithi084:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-04-02T23:23:36.411 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:36.430 INFO:teuthology.orchestra.run.smithi042:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-04-02T23:23:36.503 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-04-02T23:23:36.503 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:36.518 INFO:teuthology.orchestra.run.smithi084:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-04-02T23:23:36.589 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:36.643 INFO:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-04-02T23:23:36.713 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:36.727 INFO:teuthology.orchestra.run.smithi042:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-04-02T23:23:36.802 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:36.856 INFO:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-04-02T23:23:36.929 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-04-02T23:23:36.929 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:36.948 INFO:teuthology.orchestra.run.smithi084:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-04-02T23:23:37.036 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:37.091 INFO:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-04-02T23:23:37.158 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:37.173 INFO:teuthology.orchestra.run.smithi042:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-04-02T23:23:37.260 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:37.315 INFO:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-04-02T23:23:37.388 INFO:teuthology.run_tasks:Running task ceph... 2020-04-02T23:23:37.463 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-04-02T23:23:37.464 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:37.478 INFO:teuthology.orchestra.run.smithi042:> sudo chmod 777 /var/log/ceph 2020-04-02T23:23:37.520 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:37.535 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 777 /var/log/ceph 2020-04-02T23:23:37.605 INFO:tasks.ceph:Disabling ceph logrotate... 2020-04-02T23:23:37.605 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:37.619 INFO:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/logrotate.d/ceph 2020-04-02T23:23:37.661 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:37.675 INFO:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/logrotate.d/ceph 2020-04-02T23:23:37.742 INFO:tasks.ceph:Creating extra log directories... 2020-04-02T23:23:37.742 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:37.756 INFO:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-04-02T23:23:37.798 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:37.811 INFO:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-04-02T23:23:37.879 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-04-02T23:23:37.879 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-04-02T23:23:37.879 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-04-02T23:23:37.880 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:37.932 INFO:teuthology.orchestra.run.smithi084:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-04-02T23:23:38.017 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:38.071 INFO:teuthology.orchestra.run.smithi084:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-04-02T23:23:38.184 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:38.197 INFO:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-04-02T23:23:38.264 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:38.279 INFO:teuthology.orchestra.run.smithi042:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-04-02T23:23:38.365 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:38.419 INFO:teuthology.orchestra.run.smithi042:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-04-02T23:23:38.554 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:38.569 INFO:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-04-02T23:23:38.640 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-04-02T23:23:38.640 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'SLOW_OPS', 'slow request'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon op complaint time': 120, 'debug ms': 1}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'filestore flush min': 0, 'debug osd': 25, 'bluestore compression mode': 'aggressive', 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'osd_max_omap_entries_per_request': 10000, 'debug journal': 20, 'debug rocksdb': 10, 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'osd op complaint time': 180}}} 2020-04-02T23:23:38.641 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'}}, {'ceph': None}, {'ceph-fuse': None}, {'check-counter': {'counters': {'mds': ['mds.dir_split']}}}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_wip-greg-testing-42/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.14489', 'owner': 'scheduled_gregf@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'targets': {'smithi042.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHmc1pxguZHSR1ysZN/cg637hB68wv4QOG8P54/6P1AyoLyI4YTdfbzT7wzv1J99+g3IwtTTkEpDs1l0WGWihkhP+bubw2Yn5WI0HON0cZs7O9/LNBdbipdh8GhFHfAEyH2GumLfcFaGgSBvg+6QZTkSQ3x744y/f6jD9em9w3UeLSfFw+FkAMcI+CDVWBmJk+T1Q+GaUNhhQfDZyHysNQWI8VIZ7pr2s5MXrHYvxtgynJG4uSHXaagur70Wb19ZZsW0i8cem3d3izpcC9ELjo4WJss4Mw+Ri3Zk9OXdtHKSS2JuBKr0E1uxoLFbF8FCArdZl2wVEvYq/FZ7ofZlvm7Z3g607hHhgieBO/wk/4Gjq9j8ROVlXz5AtyTouUflErpnhoXHC3owyzIOqCxrOMNn8dkjYOXyx0cdBaxIgcE7c94UHKPQCQYMIp+h4GJS2+S1HJyvrQ2c07rMXcXP4QvAyi5aPQf1bK4vW+JQdZWuwoe0TAWI/ePYq59pqU0Lk=', 'smithi084.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDa8OwPz1tE8KM9I5IoXBzqM0VN6ZZwwDimHNMmjMhGwTVSoUoxmw3Uv1VUlFzi3LqvMB+p6MYgeWQ2Xbq9rh0Zv5etTThJT3bwqpANyi8vKVKCJoR+Hkxn20pP5vJtxUzucLdrTcWH5ij9uPg5u5bTBEECfhghErMN7c+atmD6/TWWW2aX/AEW9JmII6zpoHQSGC2lgbnTe1YdwcGu69CjaxGZhG+8CX8/iFQEYm7hoFW1oOvcFMBoUB1XlmNqQt6cQojJhVuEk/ojtbG8JH+lMSPhdv+KRhC9MeJAu2vJWAIgBbVcxbUL0NU/guCuZjEkLr0jAAZ6Z4+LFj5q5sHlStGjVRalzKqThEHyDvLj226MKR50+RqNQWN2MnI8QgqxxXrp2zK3Y3+n381DCZx/4Z8847BtQCaFcLQCVYHPtmjeQHrj6Xnt9afZu45tFEQoZQlQHjoMC+cJO3E/fpaGfpy30+ZRS66/vVujCVGwY7/MHPd1BzXcbqjPSyBcgo0='}, 'job_id': '4919136', 'tube': 'smithi', 'suite_branch': 'wip-greg-testing-42', 'priority': 101, 'os_version': '8.1', 'first_in_suite': False, 'branch': 'wip-greg-testing-42', 'suite': 'fs', 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'email': 'gfarnum@redhat.com', 'archive_path': '/home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919136', 'description': 'fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_ffsb.yaml}', 'nuke-on-error': True, 'repo': 'git://git.ceph.com/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17', 'name': 'gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'overrides': {'ceph': {'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'SLOW_OPS', 'slow request'], 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon op complaint time': 120, 'debug ms': 1}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'filestore flush min': 0, 'debug osd': 25, 'bluestore compression mode': 'aggressive', 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'osd_max_omap_entries_per_request': 10000, 'debug journal': 20, 'debug rocksdb': 10, 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'osd op complaint time': 180}}, 'fs': 'xfs', 'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'}}, 'admin_socket': {'branch': 'wip-greg-testing-42'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17', 'branch': 'wip-greg-testing-42'}}, 'os_type': 'centos', 'suite_sha1': 'cbb84f71d70460f911296715ab61ac09c6962b17'} 2020-04-02T23:23:38.641 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:38.701 INFO:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-04-02T23:23:38.744 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:38.757 INFO:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-04-02T23:23:38.812 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:38.826 INFO:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/run/ceph 2020-04-02T23:23:38.868 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:38.885 INFO:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/run/ceph 2020-04-02T23:23:39.011 DEBUG:teuthology.orchestra.remote:smithi084:/scratch_devs is 72B 2020-04-02T23:23:39.059 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-04-02T23:23:39.060 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:39.073 INFO:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-04-02T23:23:39.126 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-04-02T23:23:39.126 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:23:39.126 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 58816 Links: 1 2020-04-02T23:23:39.126 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:23:39.126 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:23:39.126 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2020-04-02 23:23:32.073223808 +0000 2020-04-02T23:23:39.127 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2020-04-02 23:21:48.888079429 +0000 2020-04-02T23:23:39.127 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2020-04-02 23:21:48.888079429 +0000 2020-04-02T23:23:39.127 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2020-04-02T23:23:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2020-04-02T23:23:39.139 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2020-04-02T23:23:39.140 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000229772 s, 2.2 MB/s 2020-04-02T23:23:39.142 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:39.195 INFO:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-04-02T23:23:39.251 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-04-02T23:23:39.251 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:23:39.252 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 57311 Links: 1 2020-04-02T23:23:39.252 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:23:39.252 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:23:39.252 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2020-04-02 23:23:32.073223808 +0000 2020-04-02T23:23:39.253 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2020-04-02 23:21:49.230078918 +0000 2020-04-02T23:23:39.253 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2020-04-02 23:21:49.230078918 +0000 2020-04-02T23:23:39.253 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2020-04-02T23:23:39.263 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2020-04-02T23:23:39.263 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2020-04-02T23:23:39.263 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000205647 s, 2.5 MB/s 2020-04-02T23:23:39.265 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:39.319 INFO:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-04-02T23:23:39.373 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-04-02T23:23:39.373 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:23:39.373 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 64538 Links: 1 2020-04-02T23:23:39.374 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:23:39.374 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:23:39.374 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2020-04-02 23:23:32.073223808 +0000 2020-04-02T23:23:39.374 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2020-04-02 23:21:49.570078410 +0000 2020-04-02T23:23:39.374 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2020-04-02 23:21:49.570078410 +0000 2020-04-02T23:23:39.375 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2020-04-02T23:23:39.386 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2020-04-02T23:23:39.386 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2020-04-02T23:23:39.386 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000223119 s, 2.3 MB/s 2020-04-02T23:23:39.388 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:39.443 INFO:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-04-02T23:23:39.497 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-04-02T23:23:39.497 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:23:39.497 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 64601 Links: 1 2020-04-02T23:23:39.498 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:23:39.498 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:23:39.498 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2020-04-02 23:23:32.073223808 +0000 2020-04-02T23:23:39.498 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2020-04-02 23:21:49.911077902 +0000 2020-04-02T23:23:39.498 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2020-04-02 23:21:49.911077902 +0000 2020-04-02T23:23:39.499 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2020-04-02T23:23:39.510 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2020-04-02T23:23:39.510 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2020-04-02T23:23:39.510 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000223689 s, 2.3 MB/s 2020-04-02T23:23:39.512 INFO:tasks.ceph:osd dev map: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-02T23:23:39.534 DEBUG:teuthology.orchestra.remote:smithi042:/scratch_devs is 72B 2020-04-02T23:23:39.583 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-04-02T23:23:39.583 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:39.600 INFO:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-04-02T23:23:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-04-02T23:23:39.655 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:23:39.655 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 59616 Links: 1 2020-04-02T23:23:39.656 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:23:39.656 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:23:39.656 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2020-04-02 23:23:33.387064992 +0000 2020-04-02T23:23:39.656 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2020-04-02 23:21:48.921853826 +0000 2020-04-02T23:23:39.656 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2020-04-02 23:21:48.921853826 +0000 2020-04-02T23:23:39.657 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: - 2020-04-02T23:23:39.673 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2020-04-02T23:23:39.673 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2020-04-02T23:23:39.674 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000112068 s, 4.6 MB/s 2020-04-02T23:23:39.676 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:39.732 INFO:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-04-02T23:23:39.789 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-04-02T23:23:39.789 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:23:39.789 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 59676 Links: 1 2020-04-02T23:23:39.790 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:23:39.790 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:23:39.790 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2020-04-02 23:23:33.387064992 +0000 2020-04-02T23:23:39.791 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2020-04-02 23:21:49.273850933 +0000 2020-04-02T23:23:39.791 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2020-04-02 23:21:49.273850933 +0000 2020-04-02T23:23:39.791 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: - 2020-04-02T23:23:39.806 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2020-04-02T23:23:39.806 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2020-04-02T23:23:39.807 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000110133 s, 4.6 MB/s 2020-04-02T23:23:39.810 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:39.865 INFO:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-04-02T23:23:39.921 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-04-02T23:23:39.922 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:23:39.922 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 62635 Links: 1 2020-04-02T23:23:39.922 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:23:39.922 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:23:39.922 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2020-04-02 23:23:33.387064992 +0000 2020-04-02T23:23:39.922 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2020-04-02 23:21:49.632847982 +0000 2020-04-02T23:23:39.923 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2020-04-02 23:21:49.632847982 +0000 2020-04-02T23:23:39.923 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: - 2020-04-02T23:23:39.939 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2020-04-02T23:23:39.939 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2020-04-02T23:23:39.939 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 8.316e-05 s, 6.2 MB/s 2020-04-02T23:23:39.941 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:39.996 INFO:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-04-02T23:23:40.052 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-04-02T23:23:40.052 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-02T23:23:40.052 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 59771 Links: 1 2020-04-02T23:23:40.053 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:23:40.053 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2020-04-02T23:23:40.053 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2020-04-02 23:23:33.387064992 +0000 2020-04-02T23:23:40.053 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2020-04-02 23:21:49.989845048 +0000 2020-04-02T23:23:40.053 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2020-04-02 23:21:49.989845048 +0000 2020-04-02T23:23:40.054 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: - 2020-04-02T23:23:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2020-04-02T23:23:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2020-04-02T23:23:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 8.4544e-05 s, 6.1 MB/s 2020-04-02T23:23:40.074 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-02T23:23:40.075 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'}} 2020-04-02T23:23:40.075 INFO:tasks.ceph:Generating config... 2020-04-02T23:23:40.077 INFO:tasks.ceph:[mds] mds debug frag = True 2020-04-02T23:23:40.078 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-04-02T23:23:40.079 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-04-02T23:23:40.079 INFO:tasks.ceph:[mds] debug mds = 20 2020-04-02T23:23:40.079 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-04-02T23:23:40.079 INFO:tasks.ceph:[mds] debug ms = 1 2020-04-02T23:23:40.080 INFO:tasks.ceph:[mds] mds bal frag = True 2020-04-02T23:23:40.081 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-04-02T23:23:40.081 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-04-02T23:23:40.081 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-04-02T23:23:40.081 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-04-02T23:23:40.082 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-04-02T23:23:40.082 INFO:tasks.ceph:[client] debug ms = 1 2020-04-02T23:23:40.082 INFO:tasks.ceph:[client] debug client = 20 2020-04-02T23:23:40.083 INFO:tasks.ceph:[client] client mount timeout = 600 2020-04-02T23:23:40.083 INFO:tasks.ceph:[mon] debug mon = 20 2020-04-02T23:23:40.084 INFO:tasks.ceph:[mon] debug paxos = 20 2020-04-02T23:23:40.084 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-04-02T23:23:40.084 INFO:tasks.ceph:[mon] debug ms = 1 2020-04-02T23:23:40.084 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-04-02T23:23:40.085 INFO:tasks.ceph:[osd] debug ms = 1 2020-04-02T23:23:40.085 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-04-02T23:23:40.085 INFO:tasks.ceph:[osd] filestore flush min = 0 2020-04-02T23:23:40.085 INFO:tasks.ceph:[osd] debug osd = 25 2020-04-02T23:23:40.086 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2020-04-02T23:23:40.086 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-04-02T23:23:40.086 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-04-02T23:23:40.087 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-04-02T23:23:40.087 INFO:tasks.ceph:[osd] osd_max_omap_entries_per_request = 10000 2020-04-02T23:23:40.087 INFO:tasks.ceph:[osd] debug journal = 20 2020-04-02T23:23:40.087 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-04-02T23:23:40.088 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-04-02T23:23:40.088 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-04-02T23:23:40.088 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-04-02T23:23:40.089 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-04-02T23:23:40.089 INFO:tasks.ceph:[osd] debug filestore = 20 2020-04-02T23:23:40.089 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-04-02T23:23:40.090 INFO:tasks.ceph:Setting up mon.a... 2020-04-02T23:23:40.090 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:40.129 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-04-02T23:23:40.240 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.keyring 2020-04-02T23:23:40.245 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:40.260 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-04-02T23:23:40.346 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:40.359 INFO:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-02T23:23:40.431 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.42'), ('mon.c', '[v2:172.21.15.84:3301,v1:172.21.15.84:6790]'), ('mon.b', '172.21.15.84')] 2020-04-02T23:23:40.431 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:40.485 INFO:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.42 --addv c '[v2:172.21.15.84:3301,v1:172.21.15.84:6790]' --add b 172.21.15.84 --print /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:23:40.563 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:23:40.563 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: generated fsid 571c521c-9ca7-4052-ba5b-7a77e18ff12c 2020-04-02T23:23:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:epoch 0 2020-04-02T23:23:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:fsid 571c521c-9ca7-4052-ba5b-7a77e18ff12c 2020-04-02T23:23:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:last_changed 2020-04-02T23:23:40.562275+0000 2020-04-02T23:23:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:created 2020-04-02T23:23:40.562275+0000 2020-04-02T23:23:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:min_mon_release 0 (unknown) 2020-04-02T23:23:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2020-04-02T23:23:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:1: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.b 2020-04-02T23:23:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:2: [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] mon.c 2020-04-02T23:23:40.565 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-04-02T23:23:40.566 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 571c521c-9ca7-4052-ba5b-7a77e18ff12c... 2020-04-02T23:23:40.567 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:40.619 INFO:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-04-02T23:23:40.663 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:40.680 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-04-02T23:23:40.724 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2020-04-02T23:23:40.724 INFO:teuthology.orchestra.run.smithi042.stdout: chdir = "" 2020-04-02T23:23:40.724 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-04-02T23:23:40.724 INFO:teuthology.orchestra.run.smithi042.stdout: auth supported = cephx 2020-04-02T23:23:40.724 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: filestore xattr use omap = true 2020-04-02T23:23:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: mon clock drift allowed = 1.000 2020-04-02T23:23:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: osd crush chooseleaf type = 0 2020-04-02T23:23:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: auth debug = true 2020-04-02T23:23:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on old message = true 2020-04-02T23:23:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on bug = true 2020-04-02T23:23:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: mon max pg per osd = 10000 # >= luminous 2020-04-02T23:23:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: mon pg warn max object skew = 0 2020-04-02T23:23:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.726 INFO:teuthology.orchestra.run.smithi042.stdout: # disable pg_autoscaler by default for new pools 2020-04-02T23:23:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: osd_pool_default_pg_autoscale_mode = off 2020-04-02T23:23:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default size = 2 2020-04-02T23:23:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow primary affinity = true 2020-04-02T23:23:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow pg remap = true 2020-04-02T23:23:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on legacy crush tunables = false 2020-04-02T23:23:40.727 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on crush straw calc version zero = false 2020-04-02T23:23:40.728 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on no sortbitwise = false 2020-04-02T23:23:40.728 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on osd down out interval zero = false 2020-04-02T23:23:40.728 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on too few osds = false 2020-04-02T23:23:40.728 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-04-02T23:23:40.728 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_no_redundancy = false 2020-04-02T23:23:40.728 INFO:teuthology.orchestra.run.smithi042.stdout: mon_allow_pool_size_one = true 2020-04-02T23:23:40.728 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-04-02T23:23:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: osd default data pool replay window = 5 2020-04-02T23:23:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: mon allow pool delete = true 2020-04-02T23:23:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.729 INFO:teuthology.orchestra.run.smithi042.stdout: mon cluster log file level = debug 2020-04-02T23:23:40.730 INFO:teuthology.orchestra.run.smithi042.stdout: debug asserts on shutdown = true 2020-04-02T23:23:40.730 INFO:teuthology.orchestra.run.smithi042.stdout: mon host = "172.21.15.42,[v2:172.21.15.84:3301,v1:172.21.15.84:6790],172.21.15.84" 2020-04-02T23:23:40.730 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = 571c521c-9ca7-4052-ba5b-7a77e18ff12c 2020-04-02T23:23:40.730 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.730 INFO:teuthology.orchestra.run.smithi042.stdout:[osd] 2020-04-02T23:23:40.730 INFO:teuthology.orchestra.run.smithi042.stdout: osd journal size = 100 2020-04-02T23:23:40.730 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.731 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub load threshold = 5.0 2020-04-02T23:23:40.731 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub max interval = 600 2020-04-02T23:23:40.731 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.731 INFO:teuthology.orchestra.run.smithi042.stdout: osd recover clone overlap = true 2020-04-02T23:23:40.731 INFO:teuthology.orchestra.run.smithi042.stdout: osd recovery max chunk = 1048576 2020-04-02T23:23:40.732 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.732 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug shutdown = true 2020-04-02T23:23:40.732 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug op order = true 2020-04-02T23:23:40.732 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug verify stray on activate = true 2020-04-02T23:23:40.732 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.732 INFO:teuthology.orchestra.run.smithi042.stdout: osd open classes on start = true 2020-04-02T23:23:40.732 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug pg log writeout = true 2020-04-02T23:23:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: osd deep scrub update digest min age = 30 2020-04-02T23:23:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: osd map max advance = 10 2020-04-02T23:23:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: journal zero on create = true 2020-04-02T23:23:40.733 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: filestore ondisk finisher threads = 3 2020-04-02T23:23:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: filestore apply finisher threads = 3 2020-04-02T23:23:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: bdev debug aio = true 2020-04-02T23:23:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug misdirected ops = true 2020-04-02T23:23:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd full ratio = 0.9 2020-04-02T23:23:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2020-04-02T23:23:40.734 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore fsck on mount = True 2020-04-02T23:23:40.735 INFO:teuthology.orchestra.run.smithi042.stdout: filestore flush min = 0 2020-04-02T23:23:40.735 INFO:teuthology.orchestra.run.smithi042.stdout: debug osd = 25 2020-04-02T23:23:40.735 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore compression mode = aggressive 2020-04-02T23:23:40.735 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluestore = 20 2020-04-02T23:23:40.735 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluefs = 20 2020-04-02T23:23:40.735 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd backfillfull_ratio = 0.85 2020-04-02T23:23:40.735 INFO:teuthology.orchestra.run.smithi042.stdout: osd_max_omap_entries_per_request = 10000 2020-04-02T23:23:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: debug journal = 20 2020-04-02T23:23:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: debug rocksdb = 10 2020-04-02T23:23:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd nearfull ratio = 0.8 2020-04-02T23:23:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: osd objectstore = bluestore 2020-04-02T23:23:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: osd failsafe full ratio = 0.95 2020-04-02T23:23:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore block size = 96636764160 2020-04-02T23:23:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: debug filestore = 20 2020-04-02T23:23:40.736 INFO:teuthology.orchestra.run.smithi042.stdout: osd op complaint time = 180 2020-04-02T23:23:40.737 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.737 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr] 2020-04-02T23:23:40.737 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2020-04-02T23:23:40.737 INFO:teuthology.orchestra.run.smithi042.stdout: debug mgr = 20 2020-04-02T23:23:40.737 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2020-04-02T23:23:40.737 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2020-04-02T23:23:40.737 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2020-04-02T23:23:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2020-04-02T23:23:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: mgr/telemetry/nag = false 2020-04-02T23:23:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.738 INFO:teuthology.orchestra.run.smithi042.stdout:[mon] 2020-04-02T23:23:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2020-04-02T23:23:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2020-04-02T23:23:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: debug paxos = 20 2020-04-02T23:23:40.738 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2020-04-02T23:23:40.739 INFO:teuthology.orchestra.run.smithi042.stdout: mon data avail warn = 5 2020-04-02T23:23:40.739 INFO:teuthology.orchestra.run.smithi042.stdout: mon mgr mkfs grace = 240 2020-04-02T23:23:40.739 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2020-04-02T23:23:40.739 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd reporter subtree level = osd 2020-04-02T23:23:40.739 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd prime pg temp = true 2020-04-02T23:23:40.739 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2020-04-02T23:23:40.739 INFO:teuthology.orchestra.run.smithi042.stdout: mon op complaint time = 120 2020-04-02T23:23:40.740 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:23:40.740 INFO:teuthology.orchestra.run.smithi042.stdout:[client] 2020-04-02T23:23:40.740 INFO:teuthology.orchestra.run.smithi042.stdout: rgw cache enabled = true 2020-04-02T23:23:40.740 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable ops log = true 2020-04-02T23:23:40.740 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable usage log = true 2020-04-02T23:23:40.740 INFO:teuthology.orchestra.run.smithi042.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-04-02T23:23:40.740 INFO:teuthology.orchestra.run.smithi042.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-04-02T23:23:40.741 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2020-04-02T23:23:40.741 INFO:teuthology.orchestra.run.smithi042.stdout: debug client = 20 2020-04-02T23:23:40.741 INFO:teuthology.orchestra.run.smithi042.stdout: client mount timeout = 600 2020-04-02T23:23:40.741 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.a] 2020-04-02T23:23:40.741 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.c] 2020-04-02T23:23:40.741 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.b] 2020-04-02T23:23:40.741 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b] 2020-04-02T23:23:40.741 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a] 2020-04-02T23:23:40.742 INFO:teuthology.orchestra.run.smithi042.stdout:[mds] 2020-04-02T23:23:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: mds debug frag = True 2020-04-02T23:23:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: mds bal split bits = 3 2020-04-02T23:23:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: mds bal split size = 100 2020-04-02T23:23:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: debug mds = 20 2020-04-02T23:23:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: mds bal merge size = 5 2020-04-02T23:23:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2020-04-02T23:23:40.743 INFO:teuthology.orchestra.run.smithi042.stdout: mds bal frag = True 2020-04-02T23:23:40.743 INFO:teuthology.orchestra.run.smithi042.stdout: mds bal fragment size max = 10000 2020-04-02T23:23:40.743 INFO:teuthology.orchestra.run.smithi042.stdout: mds op complaint time = 180 2020-04-02T23:23:40.743 INFO:teuthology.orchestra.run.smithi042.stdout: mds debug scatterstat = True 2020-04-02T23:23:40.743 INFO:teuthology.orchestra.run.smithi042.stdout: osd op complaint time = 180 2020-04-02T23:23:40.743 INFO:teuthology.orchestra.run.smithi042.stdout: mds verify scatter = True 2020-04-02T23:23:40.780 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2020-04-02T23:23:40.780 INFO:teuthology.orchestra.run.smithi084.stdout: chdir = "" 2020-04-02T23:23:40.781 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-04-02T23:23:40.781 INFO:teuthology.orchestra.run.smithi084.stdout: auth supported = cephx 2020-04-02T23:23:40.781 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.781 INFO:teuthology.orchestra.run.smithi084.stdout: filestore xattr use omap = true 2020-04-02T23:23:40.781 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.781 INFO:teuthology.orchestra.run.smithi084.stdout: mon clock drift allowed = 1.000 2020-04-02T23:23:40.781 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.781 INFO:teuthology.orchestra.run.smithi084.stdout: osd crush chooseleaf type = 0 2020-04-02T23:23:40.782 INFO:teuthology.orchestra.run.smithi084.stdout: auth debug = true 2020-04-02T23:23:40.782 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.782 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on old message = true 2020-04-02T23:23:40.782 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on bug = true 2020-04-02T23:23:40.782 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.782 INFO:teuthology.orchestra.run.smithi084.stdout: mon max pg per osd = 10000 # >= luminous 2020-04-02T23:23:40.782 INFO:teuthology.orchestra.run.smithi084.stdout: mon pg warn max object skew = 0 2020-04-02T23:23:40.783 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.783 INFO:teuthology.orchestra.run.smithi084.stdout: # disable pg_autoscaler by default for new pools 2020-04-02T23:23:40.783 INFO:teuthology.orchestra.run.smithi084.stdout: osd_pool_default_pg_autoscale_mode = off 2020-04-02T23:23:40.783 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.783 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default size = 2 2020-04-02T23:23:40.783 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.783 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow primary affinity = true 2020-04-02T23:23:40.783 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow pg remap = true 2020-04-02T23:23:40.784 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on legacy crush tunables = false 2020-04-02T23:23:40.784 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on crush straw calc version zero = false 2020-04-02T23:23:40.784 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on no sortbitwise = false 2020-04-02T23:23:40.784 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on osd down out interval zero = false 2020-04-02T23:23:40.784 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on too few osds = false 2020-04-02T23:23:40.784 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-04-02T23:23:40.784 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_no_redundancy = false 2020-04-02T23:23:40.785 INFO:teuthology.orchestra.run.smithi084.stdout: mon_allow_pool_size_one = true 2020-04-02T23:23:40.785 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.785 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-04-02T23:23:40.785 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.785 INFO:teuthology.orchestra.run.smithi084.stdout: osd default data pool replay window = 5 2020-04-02T23:23:40.785 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.785 INFO:teuthology.orchestra.run.smithi084.stdout: mon allow pool delete = true 2020-04-02T23:23:40.786 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.786 INFO:teuthology.orchestra.run.smithi084.stdout: mon cluster log file level = debug 2020-04-02T23:23:40.787 INFO:teuthology.orchestra.run.smithi084.stdout: debug asserts on shutdown = true 2020-04-02T23:23:40.787 INFO:teuthology.orchestra.run.smithi084.stdout: mon host = "172.21.15.42,[v2:172.21.15.84:3301,v1:172.21.15.84:6790],172.21.15.84" 2020-04-02T23:23:40.787 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = 571c521c-9ca7-4052-ba5b-7a77e18ff12c 2020-04-02T23:23:40.787 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.788 INFO:teuthology.orchestra.run.smithi084.stdout:[osd] 2020-04-02T23:23:40.788 INFO:teuthology.orchestra.run.smithi084.stdout: osd journal size = 100 2020-04-02T23:23:40.788 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.788 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub load threshold = 5.0 2020-04-02T23:23:40.788 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub max interval = 600 2020-04-02T23:23:40.788 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.788 INFO:teuthology.orchestra.run.smithi084.stdout: osd recover clone overlap = true 2020-04-02T23:23:40.788 INFO:teuthology.orchestra.run.smithi084.stdout: osd recovery max chunk = 1048576 2020-04-02T23:23:40.789 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.789 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug shutdown = true 2020-04-02T23:23:40.789 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug op order = true 2020-04-02T23:23:40.789 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug verify stray on activate = true 2020-04-02T23:23:40.789 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.789 INFO:teuthology.orchestra.run.smithi084.stdout: osd open classes on start = true 2020-04-02T23:23:40.789 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug pg log writeout = true 2020-04-02T23:23:40.790 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.790 INFO:teuthology.orchestra.run.smithi084.stdout: osd deep scrub update digest min age = 30 2020-04-02T23:23:40.790 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.790 INFO:teuthology.orchestra.run.smithi084.stdout: osd map max advance = 10 2020-04-02T23:23:40.790 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.790 INFO:teuthology.orchestra.run.smithi084.stdout: journal zero on create = true 2020-04-02T23:23:40.790 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.791 INFO:teuthology.orchestra.run.smithi084.stdout: filestore ondisk finisher threads = 3 2020-04-02T23:23:40.791 INFO:teuthology.orchestra.run.smithi084.stdout: filestore apply finisher threads = 3 2020-04-02T23:23:40.791 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.791 INFO:teuthology.orchestra.run.smithi084.stdout: bdev debug aio = true 2020-04-02T23:23:40.791 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug misdirected ops = true 2020-04-02T23:23:40.791 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd full ratio = 0.9 2020-04-02T23:23:40.791 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2020-04-02T23:23:40.791 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore fsck on mount = True 2020-04-02T23:23:40.792 INFO:teuthology.orchestra.run.smithi084.stdout: filestore flush min = 0 2020-04-02T23:23:40.792 INFO:teuthology.orchestra.run.smithi084.stdout: debug osd = 25 2020-04-02T23:23:40.792 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore compression mode = aggressive 2020-04-02T23:23:40.792 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluestore = 20 2020-04-02T23:23:40.792 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluefs = 20 2020-04-02T23:23:40.792 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd backfillfull_ratio = 0.85 2020-04-02T23:23:40.792 INFO:teuthology.orchestra.run.smithi084.stdout: osd_max_omap_entries_per_request = 10000 2020-04-02T23:23:40.793 INFO:teuthology.orchestra.run.smithi084.stdout: debug journal = 20 2020-04-02T23:23:40.793 INFO:teuthology.orchestra.run.smithi084.stdout: debug rocksdb = 10 2020-04-02T23:23:40.793 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd nearfull ratio = 0.8 2020-04-02T23:23:40.793 INFO:teuthology.orchestra.run.smithi084.stdout: osd objectstore = bluestore 2020-04-02T23:23:40.793 INFO:teuthology.orchestra.run.smithi084.stdout: osd failsafe full ratio = 0.95 2020-04-02T23:23:40.793 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore block size = 96636764160 2020-04-02T23:23:40.793 INFO:teuthology.orchestra.run.smithi084.stdout: debug filestore = 20 2020-04-02T23:23:40.794 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2020-04-02T23:23:40.794 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.794 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr] 2020-04-02T23:23:40.794 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2020-04-02T23:23:40.794 INFO:teuthology.orchestra.run.smithi084.stdout: debug mgr = 20 2020-04-02T23:23:40.794 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2020-04-02T23:23:40.795 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2020-04-02T23:23:40.795 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2020-04-02T23:23:40.795 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2020-04-02T23:23:40.795 INFO:teuthology.orchestra.run.smithi084.stdout: mgr/telemetry/nag = false 2020-04-02T23:23:40.795 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.795 INFO:teuthology.orchestra.run.smithi084.stdout:[mon] 2020-04-02T23:23:40.795 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2020-04-02T23:23:40.796 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2020-04-02T23:23:40.796 INFO:teuthology.orchestra.run.smithi084.stdout: debug paxos = 20 2020-04-02T23:23:40.797 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2020-04-02T23:23:40.797 INFO:teuthology.orchestra.run.smithi084.stdout: mon data avail warn = 5 2020-04-02T23:23:40.797 INFO:teuthology.orchestra.run.smithi084.stdout: mon mgr mkfs grace = 240 2020-04-02T23:23:40.797 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2020-04-02T23:23:40.797 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd reporter subtree level = osd 2020-04-02T23:23:40.797 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd prime pg temp = true 2020-04-02T23:23:40.797 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2020-04-02T23:23:40.797 INFO:teuthology.orchestra.run.smithi084.stdout: mon op complaint time = 120 2020-04-02T23:23:40.798 INFO:teuthology.orchestra.run.smithi084.stdout: 2020-04-02T23:23:40.798 INFO:teuthology.orchestra.run.smithi084.stdout:[client] 2020-04-02T23:23:40.798 INFO:teuthology.orchestra.run.smithi084.stdout: rgw cache enabled = true 2020-04-02T23:23:40.798 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable ops log = true 2020-04-02T23:23:40.798 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable usage log = true 2020-04-02T23:23:40.798 INFO:teuthology.orchestra.run.smithi084.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-04-02T23:23:40.798 INFO:teuthology.orchestra.run.smithi084.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-04-02T23:23:40.799 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2020-04-02T23:23:40.799 INFO:teuthology.orchestra.run.smithi084.stdout: debug client = 20 2020-04-02T23:23:40.799 INFO:teuthology.orchestra.run.smithi084.stdout: client mount timeout = 600 2020-04-02T23:23:40.799 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.a] 2020-04-02T23:23:40.799 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.c] 2020-04-02T23:23:40.799 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.b] 2020-04-02T23:23:40.799 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2020-04-02T23:23:40.800 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2020-04-02T23:23:40.800 INFO:teuthology.orchestra.run.smithi084.stdout:[mds] 2020-04-02T23:23:40.800 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug frag = True 2020-04-02T23:23:40.800 INFO:teuthology.orchestra.run.smithi084.stdout: mds bal split bits = 3 2020-04-02T23:23:40.800 INFO:teuthology.orchestra.run.smithi084.stdout: mds bal split size = 100 2020-04-02T23:23:40.800 INFO:teuthology.orchestra.run.smithi084.stdout: debug mds = 20 2020-04-02T23:23:40.800 INFO:teuthology.orchestra.run.smithi084.stdout: mds bal merge size = 5 2020-04-02T23:23:40.801 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2020-04-02T23:23:40.801 INFO:teuthology.orchestra.run.smithi084.stdout: mds bal frag = True 2020-04-02T23:23:40.801 INFO:teuthology.orchestra.run.smithi084.stdout: mds bal fragment size max = 10000 2020-04-02T23:23:40.801 INFO:teuthology.orchestra.run.smithi084.stdout: mds op complaint time = 180 2020-04-02T23:23:40.801 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug scatterstat = True 2020-04-02T23:23:40.801 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2020-04-02T23:23:40.801 INFO:teuthology.orchestra.run.smithi084.stdout: mds verify scatter = True 2020-04-02T23:23:40.802 INFO:tasks.ceph:Creating admin key on mon.a... 2020-04-02T23:23:40.803 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:40.826 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-04-02T23:23:40.922 INFO:tasks.ceph:Copying monmap to all nodes... 2020-04-02T23:23:40.943 DEBUG:teuthology.orchestra.remote:smithi042:/etc/ceph/ceph.keyring is 206B 2020-04-02T23:23:41.037 DEBUG:teuthology.orchestra.remote:smithi042:/home/ubuntu/cephtest/ceph.monmap is 379B 2020-04-02T23:23:41.085 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi084.front.sepia.ceph.com 2020-04-02T23:23:41.085 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:41.100 INFO:teuthology.orchestra.run.smithi084:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-02T23:23:41.201 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:41.255 INFO:teuthology.orchestra.run.smithi084:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:23:41.340 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi042.front.sepia.ceph.com 2020-04-02T23:23:41.341 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:41.355 INFO:teuthology.orchestra.run.smithi042:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-02T23:23:41.457 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:41.512 INFO:teuthology.orchestra.run.smithi042:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:23:41.597 INFO:tasks.ceph:Setting up mon nodes... 2020-04-02T23:23:41.598 INFO:tasks.ceph:Setting up mgr nodes... 2020-04-02T23:23:41.598 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:41.613 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-04-02T23:23:41.756 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-04-02T23:23:41.758 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:41.773 INFO:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-04-02T23:23:41.876 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-04-02T23:23:41.878 INFO:tasks.ceph:Setting up mds nodes... 2020-04-02T23:23:41.878 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:41.893 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-04-02T23:23:41.987 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-04-02T23:23:41.989 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:42.003 INFO:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-04-02T23:23:42.073 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:42.088 INFO:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-04-02T23:23:42.192 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-04-02T23:23:42.194 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:42.207 INFO:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-04-02T23:23:42.279 INFO:tasks.ceph_client:Setting up client nodes... 2020-04-02T23:23:42.279 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:42.334 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-04-02T23:23:42.419 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-04-02T23:23:42.438 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-04-02T23:23:42.439 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'}} 2020-04-02T23:23:42.439 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:42.452 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-04-02T23:23:42.521 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-02T23:23:42.521 INFO:tasks.ceph:role: osd.4 2020-04-02T23:23:42.521 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com 2020-04-02T23:23:42.521 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:42.574 INFO:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-04-02T23:23:43.106 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:23:43.107 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:23:43.107 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:23:43.107 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 2020-04-02T23:23:43.107 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:23:43.107 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:23:43.107 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:23:43.108 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:23:43.108 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:23:43.108 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:23:43.109 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2020-04-02T23:23:43.109 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:43.124 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2020-04-02T23:23:43.270 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:43.284 INFO:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-04-02T23:23:43.356 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:43.410 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-04-02T23:23:43.479 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-02T23:23:43.479 INFO:tasks.ceph:role: osd.5 2020-04-02T23:23:43.479 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com 2020-04-02T23:23:43.479 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:43.532 INFO:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-04-02T23:23:44.044 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:23:44.044 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:23:44.045 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:23:44.045 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 2020-04-02T23:23:44.045 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:23:44.045 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:23:44.045 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:23:44.045 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:23:44.045 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:23:44.046 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:23:44.046 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2020-04-02T23:23:44.047 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:44.065 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2020-04-02T23:23:44.184 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:44.200 INFO:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-04-02T23:23:44.270 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:44.323 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-04-02T23:23:44.389 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-02T23:23:44.389 INFO:tasks.ceph:role: osd.6 2020-04-02T23:23:44.390 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com 2020-04-02T23:23:44.390 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:44.443 INFO:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-04-02T23:23:44.988 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:23:44.988 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:23:44.988 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:23:44.988 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 2020-04-02T23:23:44.988 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:23:44.989 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:23:44.989 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:23:44.989 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:23:44.989 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:23:44.989 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:23:44.989 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2020-04-02T23:23:44.990 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:45.003 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2020-04-02T23:23:45.156 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:45.169 INFO:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-04-02T23:23:45.247 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:45.300 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-04-02T23:23:45.366 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-02T23:23:45.366 INFO:tasks.ceph:role: osd.7 2020-04-02T23:23:45.367 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com 2020-04-02T23:23:45.367 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:45.420 INFO:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-04-02T23:23:45.922 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:23:45.923 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:23:45.923 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:23:45.923 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 2020-04-02T23:23:45.923 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:23:45.923 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:23:45.923 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:23:45.923 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:23:45.924 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:23:45.924 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:23:45.925 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2020-04-02T23:23:45.925 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:45.939 INFO:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7 2020-04-02T23:23:46.040 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:46.053 INFO:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-04-02T23:23:46.124 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:46.178 INFO:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:23:46.274 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:46.272+0000 7ffaeda59ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-04-02T23:23:46.276 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:46.274+0000 7ffaeda59ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-04-02T23:23:46.276 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:46.274+0000 7ffaeda59ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-04-02T23:23:46.277 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:46.274+0000 7ffaeda59ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-04-02T23:23:46.277 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:46.274+0000 7ffaeda59ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-04-02T23:23:46.279 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:46.278+0000 7ffaeda59ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-04-02T23:23:48.620 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:48.636 INFO:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-04-02T23:23:48.711 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:48.766 INFO:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:23:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:48.851+0000 7fab3c4a0ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-04-02T23:23:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:48.851+0000 7fab3c4a0ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-04-02T23:23:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:48.851+0000 7fab3c4a0ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-04-02T23:23:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:48.851+0000 7fab3c4a0ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-04-02T23:23:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:48.851+0000 7fab3c4a0ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-04-02T23:23:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:48.852+0000 7fab3c4a0ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-04-02T23:23:51.196 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:51.212 INFO:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-04-02T23:23:51.284 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:51.339 INFO:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:23:51.429 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:51.427+0000 7f13c8e3eec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-04-02T23:23:51.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:51.427+0000 7f13c8e3eec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-04-02T23:23:51.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:51.427+0000 7f13c8e3eec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-04-02T23:23:51.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:51.427+0000 7f13c8e3eec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-04-02T23:23:51.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:51.427+0000 7f13c8e3eec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-04-02T23:23:51.430 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:51.428+0000 7f13c8e3eec0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-04-02T23:23:53.774 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:53.790 INFO:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-04-02T23:23:53.862 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:53.922 INFO:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:23:54.009 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:54.007+0000 7fec5d72aec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-04-02T23:23:54.010 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:54.007+0000 7fec5d72aec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-04-02T23:23:54.010 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:54.007+0000 7fec5d72aec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-04-02T23:23:54.010 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:54.007+0000 7fec5d72aec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-04-02T23:23:54.010 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:54.007+0000 7fec5d72aec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-04-02T23:23:54.010 INFO:teuthology.orchestra.run.smithi084.stderr:2020-04-02T23:23:54.008+0000 7fec5d72aec0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-04-02T23:23:56.352 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:23:56.368 INFO:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-04-02T23:23:56.442 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:56.465 INFO:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-04-02T23:23:56.541 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-02T23:23:56.541 INFO:tasks.ceph:role: osd.0 2020-04-02T23:23:56.541 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi042.front.sepia.ceph.com 2020-04-02T23:23:56.542 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:56.597 INFO:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-04-02T23:23:56.696 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:23:56.696 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:23:56.697 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:23:56.697 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 2020-04-02T23:23:56.697 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:23:56.697 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:23:56.697 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:23:56.697 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:23:56.697 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:23:56.698 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:23:56.698 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2020-04-02T23:23:56.699 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:56.716 INFO:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2020-04-02T23:23:56.809 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:56.823 INFO:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-04-02T23:23:56.899 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:56.953 INFO:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-04-02T23:23:57.024 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-02T23:23:57.024 INFO:tasks.ceph:role: osd.1 2020-04-02T23:23:57.024 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com 2020-04-02T23:23:57.025 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:57.077 INFO:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-04-02T23:23:57.172 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:23:57.172 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:23:57.173 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:23:57.173 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 2020-04-02T23:23:57.173 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:23:57.173 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:23:57.173 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:23:57.173 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:23:57.173 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:23:57.174 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:23:57.174 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2020-04-02T23:23:57.175 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:57.189 INFO:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1 2020-04-02T23:23:57.272 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:57.327 INFO:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-04-02T23:23:57.401 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:57.455 INFO:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-04-02T23:23:57.525 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-02T23:23:57.525 INFO:tasks.ceph:role: osd.2 2020-04-02T23:23:57.526 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com 2020-04-02T23:23:57.526 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:57.579 INFO:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-04-02T23:23:57.674 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:23:57.675 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:23:57.675 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:23:57.675 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 2020-04-02T23:23:57.675 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:23:57.675 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:23:57.675 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:23:57.675 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:23:57.676 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:23:57.676 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:23:57.677 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2020-04-02T23:23:57.677 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:57.691 INFO:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2020-04-02T23:23:57.775 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:57.829 INFO:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-04-02T23:23:57.902 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:57.958 INFO:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-04-02T23:23:58.028 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-02T23:23:58.029 INFO:tasks.ceph:role: osd.3 2020-04-02T23:23:58.029 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com 2020-04-02T23:23:58.029 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:58.083 INFO:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-04-02T23:23:58.178 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-04-02T23:23:58.178 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-02T23:23:58.179 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-02T23:23:58.179 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 2020-04-02T23:23:58.179 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-02T23:23:58.179 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2020-04-02T23:23:58.179 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-02T23:23:58.179 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-02T23:23:58.179 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-02T23:23:58.180 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-02T23:23:58.180 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2020-04-02T23:23:58.181 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:58.197 INFO:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2020-04-02T23:23:58.281 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:58.335 INFO:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-04-02T23:23:58.410 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:23:58.467 INFO:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:23:58.569 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:23:58.565+0000 7f2f61621ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-04-02T23:23:58.569 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:23:58.566+0000 7f2f61621ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-04-02T23:23:58.569 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:23:58.566+0000 7f2f61621ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-04-02T23:23:58.570 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:23:58.566+0000 7f2f61621ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-04-02T23:23:58.570 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:23:58.566+0000 7f2f61621ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-04-02T23:23:58.570 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:23:58.566+0000 7f2f61621ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-04-02T23:24:00.902 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:00.919 INFO:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-04-02T23:24:00.997 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:01.053 INFO:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:24:01.145 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:01.141+0000 7f4185dceec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-04-02T23:24:01.146 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:01.141+0000 7f4185dceec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-04-02T23:24:01.146 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:01.141+0000 7f4185dceec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-04-02T23:24:01.146 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:01.141+0000 7f4185dceec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-04-02T23:24:01.146 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:01.141+0000 7f4185dceec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-04-02T23:24:01.146 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:01.142+0000 7f4185dceec0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-04-02T23:24:03.487 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:03.509 INFO:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-04-02T23:24:03.583 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:03.639 INFO:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:24:03.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:03.728+0000 7fdc0ff74ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-04-02T23:24:03.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:03.728+0000 7fdc0ff74ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-04-02T23:24:03.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:03.728+0000 7fdc0ff74ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-04-02T23:24:03.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:03.728+0000 7fdc0ff74ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-04-02T23:24:03.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:03.728+0000 7fdc0ff74ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-04-02T23:24:03.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:03.729+0000 7fdc0ff74ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-04-02T23:24:06.069 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:06.086 INFO:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-04-02T23:24:06.165 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:06.220 INFO:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:24:06.311 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:06.307+0000 7f8fef1e8ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-04-02T23:24:06.311 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:06.308+0000 7f8fef1e8ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-04-02T23:24:06.311 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:06.308+0000 7f8fef1e8ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-04-02T23:24:06.311 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:06.308+0000 7f8fef1e8ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-04-02T23:24:06.312 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:06.308+0000 7f8fef1e8ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-04-02T23:24:06.312 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:06.308+0000 7f8fef1e8ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-04-02T23:24:08.643 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:08.648 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:08.660 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:24:08.703 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:08.716 INFO:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-04-02T23:24:08.720 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:24:08.790 INFO:tasks.ceph:Reading keys from all nodes... 2020-04-02T23:24:08.791 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:08.818 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-02T23:24:08.895 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.zDN54EGtlK 2020-04-02T23:24:08.896 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:08.951 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.zDN54EGtlK 2020-04-02T23:24:09.020 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:09.074 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.zDN54EGtlK 2020-04-02T23:24:09.201 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.zDN54EGtlK is 56B 2020-04-02T23:24:09.250 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:09.263 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.zDN54EGtlK 2020-04-02T23:24:09.317 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:09.372 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-02T23:24:09.426 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.QFqJncfNYv 2020-04-02T23:24:09.426 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:09.480 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.QFqJncfNYv 2020-04-02T23:24:09.548 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:09.602 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.QFqJncfNYv 2020-04-02T23:24:09.725 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.QFqJncfNYv is 56B 2020-04-02T23:24:09.773 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:09.787 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.QFqJncfNYv 2020-04-02T23:24:09.839 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:09.893 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-02T23:24:09.947 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.HimlaLmEG9 2020-04-02T23:24:09.948 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:10.001 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.HimlaLmEG9 2020-04-02T23:24:10.068 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:10.121 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.HimlaLmEG9 2020-04-02T23:24:10.244 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.HimlaLmEG9 is 56B 2020-04-02T23:24:10.293 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:10.306 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.HimlaLmEG9 2020-04-02T23:24:10.358 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:10.411 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-02T23:24:10.464 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.aFtV0nTPpB 2020-04-02T23:24:10.465 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:10.518 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.aFtV0nTPpB 2020-04-02T23:24:10.585 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:10.638 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.aFtV0nTPpB 2020-04-02T23:24:10.761 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.aFtV0nTPpB is 56B 2020-04-02T23:24:10.809 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:10.823 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.aFtV0nTPpB 2020-04-02T23:24:10.875 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:10.928 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-02T23:24:10.981 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.HOUNBSN2hi 2020-04-02T23:24:10.981 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:11.034 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.HOUNBSN2hi 2020-04-02T23:24:11.101 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:11.160 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.HOUNBSN2hi 2020-04-02T23:24:11.283 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.HOUNBSN2hi is 56B 2020-04-02T23:24:11.335 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:11.348 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.HOUNBSN2hi 2020-04-02T23:24:11.401 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:11.455 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-02T23:24:11.508 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.NirHuM9wf1 2020-04-02T23:24:11.509 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:11.562 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.NirHuM9wf1 2020-04-02T23:24:11.629 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:11.682 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.NirHuM9wf1 2020-04-02T23:24:11.805 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.NirHuM9wf1 is 56B 2020-04-02T23:24:11.854 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:11.866 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.NirHuM9wf1 2020-04-02T23:24:11.920 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:11.938 INFO:teuthology.orchestra.run.smithi042:> mktemp 2020-04-02T23:24:11.995 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.JiNKmpv0xT 2020-04-02T23:24:11.996 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:12.053 INFO:teuthology.orchestra.run.smithi042:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.JiNKmpv0xT 2020-04-02T23:24:12.133 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:12.189 INFO:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.JiNKmpv0xT 2020-04-02T23:24:12.325 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.JiNKmpv0xT is 56B 2020-04-02T23:24:12.373 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:12.388 INFO:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.JiNKmpv0xT 2020-04-02T23:24:12.444 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:12.499 INFO:teuthology.orchestra.run.smithi042:> mktemp 2020-04-02T23:24:12.555 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.EemaXmFXZD 2020-04-02T23:24:12.556 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:12.611 INFO:teuthology.orchestra.run.smithi042:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.EemaXmFXZD 2020-04-02T23:24:12.684 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:12.738 INFO:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.EemaXmFXZD 2020-04-02T23:24:12.869 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.EemaXmFXZD is 56B 2020-04-02T23:24:12.927 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:12.941 INFO:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.EemaXmFXZD 2020-04-02T23:24:12.996 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:13.049 INFO:teuthology.orchestra.run.smithi042:> mktemp 2020-04-02T23:24:13.104 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.IlK2wq8AQT 2020-04-02T23:24:13.104 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:13.158 INFO:teuthology.orchestra.run.smithi042:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.IlK2wq8AQT 2020-04-02T23:24:13.230 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:13.284 INFO:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.IlK2wq8AQT 2020-04-02T23:24:13.414 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.IlK2wq8AQT is 56B 2020-04-02T23:24:13.464 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:13.477 INFO:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.IlK2wq8AQT 2020-04-02T23:24:13.531 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:13.584 INFO:teuthology.orchestra.run.smithi042:> mktemp 2020-04-02T23:24:13.639 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.64VeYyKRkj 2020-04-02T23:24:13.639 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:13.692 INFO:teuthology.orchestra.run.smithi042:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.64VeYyKRkj 2020-04-02T23:24:13.764 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:13.827 INFO:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.64VeYyKRkj 2020-04-02T23:24:13.954 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.64VeYyKRkj is 56B 2020-04-02T23:24:14.002 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:14.016 INFO:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.64VeYyKRkj 2020-04-02T23:24:14.074 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:14.127 INFO:teuthology.orchestra.run.smithi042:> mktemp 2020-04-02T23:24:14.180 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.sHcCTThUhn 2020-04-02T23:24:14.181 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:14.234 INFO:teuthology.orchestra.run.smithi042:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.sHcCTThUhn 2020-04-02T23:24:14.306 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:14.359 INFO:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.sHcCTThUhn 2020-04-02T23:24:14.488 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.sHcCTThUhn is 56B 2020-04-02T23:24:14.535 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:14.549 INFO:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.sHcCTThUhn 2020-04-02T23:24:14.601 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:14.655 INFO:teuthology.orchestra.run.smithi042:> mktemp 2020-04-02T23:24:14.710 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.JE2HPpexye 2020-04-02T23:24:14.710 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:14.764 INFO:teuthology.orchestra.run.smithi042:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.JE2HPpexye 2020-04-02T23:24:14.835 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:14.889 INFO:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.JE2HPpexye 2020-04-02T23:24:15.038 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.JE2HPpexye is 56B 2020-04-02T23:24:15.075 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:15.090 INFO:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.JE2HPpexye 2020-04-02T23:24:15.203 DEBUG:teuthology.orchestra.remote:smithi042:/etc/ceph/ceph.client.0.keyring is 59B 2020-04-02T23:24:15.251 INFO:tasks.ceph:Adding keys to all mons... 2020-04-02T23:24:15.252 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:15.265 INFO:teuthology.orchestra.run.smithi042:> sudo tee -a /etc/ceph/ceph.keyring 2020-04-02T23:24:15.307 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:15.322 INFO:teuthology.orchestra.run.smithi084:> sudo tee -a /etc/ceph/ceph.keyring 2020-04-02T23:24:15.367 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr.x] 2020-04-02T23:24:15.367 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQD9c4ZeXEIDLRAACmoNziugnglUag7RiVWRaw== 2020-04-02T23:24:15.367 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b] 2020-04-02T23:24:15.367 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQD9c4ZeaanMOhAArLeu5hvPhXpqrQRNqmLITg== 2020-04-02T23:24:15.367 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.4] 2020-04-02T23:24:15.368 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQACdIZe3nVJEBAA5rndk0vyxgUeJt8yHSs5gA== 2020-04-02T23:24:15.368 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.5] 2020-04-02T23:24:15.368 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQAEdIZet0/KMhAAu0ITlyBiyLoajwCyldXm1A== 2020-04-02T23:24:15.368 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.6] 2020-04-02T23:24:15.368 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQAHdIZek6eDGRAARxtgXL1i4Gh40Kth3JrNcw== 2020-04-02T23:24:15.368 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.7] 2020-04-02T23:24:15.368 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQAKdIZeWDx7ABAAPp62TmNKPwTa/Bhnre4meA== 2020-04-02T23:24:15.368 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr.y] 2020-04-02T23:24:15.369 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQD9c4ZewXQoNBAA8+VwXTsZFkuFMBZpHg0caQ== 2020-04-02T23:24:15.369 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a] 2020-04-02T23:24:15.369 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQD+c4ZeadRfCxAAffkJVfyYxiNUxoOJaKfzfQ== 2020-04-02T23:24:15.369 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.0] 2020-04-02T23:24:15.369 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQAOdIZeYDrWIRAAWtuwJ8R1xM/9XFsmNh3WfQ== 2020-04-02T23:24:15.369 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.1] 2020-04-02T23:24:15.369 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQARdIZedE+KCBAABIUaPQsUEPugzo2hCAhQYA== 2020-04-02T23:24:15.370 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.2] 2020-04-02T23:24:15.370 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQATdIZeEj2IKxAA43Tu8oN2eiWSLgwzf6l8Dg== 2020-04-02T23:24:15.370 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.3] 2020-04-02T23:24:15.370 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQAWdIZeKHFzEhAAfuIZyoJnxyMnkRd7+mI/QA== 2020-04-02T23:24:15.370 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2020-04-02T23:24:15.370 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQD+c4ZeRfPyGBAAl0lsCmILGz6G/KIJ6U6j6w== 2020-04-02T23:24:15.391 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.x] 2020-04-02T23:24:15.392 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQD9c4ZeXEIDLRAACmoNziugnglUag7RiVWRaw== 2020-04-02T23:24:15.392 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2020-04-02T23:24:15.392 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQD9c4ZeaanMOhAArLeu5hvPhXpqrQRNqmLITg== 2020-04-02T23:24:15.392 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.4] 2020-04-02T23:24:15.392 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQACdIZe3nVJEBAA5rndk0vyxgUeJt8yHSs5gA== 2020-04-02T23:24:15.393 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.5] 2020-04-02T23:24:15.393 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAEdIZet0/KMhAAu0ITlyBiyLoajwCyldXm1A== 2020-04-02T23:24:15.393 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.6] 2020-04-02T23:24:15.393 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAHdIZek6eDGRAARxtgXL1i4Gh40Kth3JrNcw== 2020-04-02T23:24:15.393 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.7] 2020-04-02T23:24:15.393 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAKdIZeWDx7ABAAPp62TmNKPwTa/Bhnre4meA== 2020-04-02T23:24:15.393 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.y] 2020-04-02T23:24:15.394 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQD9c4ZewXQoNBAA8+VwXTsZFkuFMBZpHg0caQ== 2020-04-02T23:24:15.394 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2020-04-02T23:24:15.394 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQD+c4ZeadRfCxAAffkJVfyYxiNUxoOJaKfzfQ== 2020-04-02T23:24:15.394 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.0] 2020-04-02T23:24:15.394 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAOdIZeYDrWIRAAWtuwJ8R1xM/9XFsmNh3WfQ== 2020-04-02T23:24:15.394 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.1] 2020-04-02T23:24:15.394 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQARdIZedE+KCBAABIUaPQsUEPugzo2hCAhQYA== 2020-04-02T23:24:15.394 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.2] 2020-04-02T23:24:15.395 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQATdIZeEj2IKxAA43Tu8oN2eiWSLgwzf6l8Dg== 2020-04-02T23:24:15.395 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.3] 2020-04-02T23:24:15.395 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQAWdIZeKHFzEhAAfuIZyoJnxyMnkRd7+mI/QA== 2020-04-02T23:24:15.395 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2020-04-02T23:24:15.395 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQD+c4ZeRfPyGBAAl0lsCmILGz6G/KIJ6U6j6w== 2020-04-02T23:24:15.396 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:15.426 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-02T23:24:15.468 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:15.484 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-02T23:24:15.577 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:15.592 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-04-02T23:24:15.634 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:15.649 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-04-02T23:24:15.740 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:15.754 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:24:15.797 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:15.810 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:24:15.899 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:15.913 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:24:15.956 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:15.973 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:24:16.061 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:16.075 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:24:16.117 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:16.134 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:24:16.221 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:16.236 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:24:16.278 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:16.292 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:24:16.380 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:16.394 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-02T23:24:16.436 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:16.449 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-02T23:24:16.538 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:16.552 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-04-02T23:24:16.594 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:16.607 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-04-02T23:24:16.697 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:16.711 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:24:16.753 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:16.766 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:24:16.854 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:16.868 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:24:16.910 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:16.924 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:24:17.011 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:17.025 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:24:17.068 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:17.082 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:24:17.168 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:17.182 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:24:17.224 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:17.237 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-02T23:24:17.325 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:17.339 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-02T23:24:17.381 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:17.394 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-02T23:24:17.483 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-04-02T23:24:17.483 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:17.496 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-04-02T23:24:17.563 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:17.616 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-02T23:24:17.708 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:17.721 INFO:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-04-02T23:24:17.787 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:17.840 INFO:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-04-02T23:24:17.906 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:17.960 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-02T23:24:18.053 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:18.066 INFO:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-04-02T23:24:18.133 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:18.149 INFO:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-04-02T23:24:18.225 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:18.280 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-02T23:24:18.385 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:18.400 INFO:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-04-02T23:24:18.474 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:18.528 INFO:teuthology.orchestra.run.smithi042:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:24:18.570 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:18.583 INFO:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-04-02T23:24:18.637 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-04-02T23:24:18.637 INFO:tasks.ceph.mon.b:Restarting daemon 2020-04-02T23:24:18.638 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:18.691 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-04-02T23:24:18.733 INFO:tasks.ceph.mon.b:Started 2020-04-02T23:24:18.733 INFO:tasks.ceph.mon.c:Restarting daemon 2020-04-02T23:24:18.733 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:18.747 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-04-02T23:24:18.789 INFO:tasks.ceph.mon.c:Started 2020-04-02T23:24:18.789 INFO:tasks.ceph.mon.a:Restarting daemon 2020-04-02T23:24:18.789 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:18.804 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-04-02T23:24:18.846 INFO:tasks.ceph.mon.a:Started 2020-04-02T23:24:18.846 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-04-02T23:24:18.846 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-04-02T23:24:18.847 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:18.862 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-04-02T23:24:18.905 INFO:tasks.ceph.mgr.x:Started 2020-04-02T23:24:18.906 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-04-02T23:24:18.906 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:18.920 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-04-02T23:24:18.963 INFO:tasks.ceph.mgr.y:Started 2020-04-02T23:24:18.963 INFO:tasks.ceph:Setting crush tunables to default 2020-04-02T23:24:18.964 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:18.978 INFO:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd crush tunables default 2020-04-02T23:24:24.010 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.130+0000 7fc7e8260700 1 Processor -- start 2020-04-02T23:24:24.010 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.130+0000 7fc7e8260700 1 -- start start 2020-04-02T23:24:24.010 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.131+0000 7fc7e8260700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7e00a3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:24.010 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.131+0000 7fc7e8260700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7e0080190 0x7fc7e0148b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:24.010 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.131+0000 7fc7e8260700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e00a55c0 con 0x7fc7e0148690 2020-04-02T23:24:24.010 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.131+0000 7fc7e8260700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e0080600 con 0x7fc7e00ab230 2020-04-02T23:24:24.011 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.131+0000 7fc7e8260700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e00a68c0 con 0x7fc7e0080190 2020-04-02T23:24:24.011 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.131+0000 7fc7e67fd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7e00a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.011 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.131+0000 7fc7e67fd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7e00a3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39146/0 (socket says 172.21.15.42:39146) 2020-04-02T23:24:24.011 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.131+0000 7fc7e67fd700 1 -- 172.21.15.42:0/2923638022 learned_addr learned my addr 172.21.15.42:0/2923638022 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:24.011 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.131+0000 7fc7e67fd700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 msgr2=0x7fc7e00a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-04-02T23:24:24.011 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.131+0000 7fc7e67fd700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 msgr2=0x7fc7e00a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:24:24.011 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.131+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7e00a3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:24:24.012 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.131+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7e00a3440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:24:24.012 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.131+0000 7fc7e6ffe700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.84:3300/0 conn(0x7fc7e0080190 0x7fc7e0148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.012 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.131+0000 7fc7e6ffe700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.84:3300/0 conn(0x7fc7e0080190 msgr2=0x7fc7e0148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-04-02T23:24:24.012 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.131+0000 7fc7e6ffe700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.84:3300/0 conn(0x7fc7e0080190 msgr2=0x7fc7e0148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:24:24.013 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.131+0000 7fc7e6ffe700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.84:3300/0 conn(0x7fc7e0080190 0x7fc7e0148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:24:24.013 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.131+0000 7fc7e6ffe700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.84:3300/0 conn(0x7fc7e0080190 0x7fc7e0148b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:24:24.013 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.332+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7e00a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.013 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.332+0000 7fc7e67fd700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 msgr2=0x7fc7e00a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-04-02T23:24:24.013 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.332+0000 7fc7e67fd700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 msgr2=0x7fc7e00a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:24:24.014 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.332+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7e00a3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:24:24.014 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.332+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7e00a3440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-02T23:24:24.014 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.332+0000 7fc7e6ffe700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.84:3300/0 conn(0x7fc7e0080190 0x7fc7e0148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.014 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.332+0000 7fc7e6ffe700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.84:3300/0 conn(0x7fc7e0080190 msgr2=0x7fc7e0148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-04-02T23:24:24.015 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.332+0000 7fc7e6ffe700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.84:3300/0 conn(0x7fc7e0080190 msgr2=0x7fc7e0148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:24:24.015 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.332+0000 7fc7e6ffe700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.84:3300/0 conn(0x7fc7e0080190 0x7fc7e0148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:24:24.015 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.332+0000 7fc7e6ffe700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.84:3300/0 conn(0x7fc7e0080190 0x7fc7e0148b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-02T23:24:24.015 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.733+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7e00a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.015 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.733+0000 7fc7e6ffe700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.84:3300/0 conn(0x7fc7e0080190 0x7fc7e0148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.015 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.733+0000 7fc7e67fd700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 msgr2=0x7fc7e00a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-04-02T23:24:24.016 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.733+0000 7fc7e67fd700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 msgr2=0x7fc7e00a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:24:24.016 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.733+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7e00a3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:24:24.016 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.733+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7e00a3440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-04-02T23:24:24.016 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.733+0000 7fc7e6ffe700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.84:3300/0 conn(0x7fc7e0080190 msgr2=0x7fc7e0148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-04-02T23:24:24.016 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.733+0000 7fc7e6ffe700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.84:3300/0 conn(0x7fc7e0080190 msgr2=0x7fc7e0148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:24:24.016 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.733+0000 7fc7e6ffe700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.84:3300/0 conn(0x7fc7e0080190 0x7fc7e0148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:24:24.017 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:19.733+0000 7fc7e6ffe700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.84:3300/0 conn(0x7fc7e0080190 0x7fc7e0148b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-04-02T23:24:24.017 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.131+0000 7fc7d7fff700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.84:3300/0 conn(0x7fc7e0080190 msgr2=0x7fc7e0148b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:24:24.017 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.131+0000 7fc7d7fff700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.84:3300/0 conn(0x7fc7e0080190 0x7fc7e0148b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:24.017 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.131+0000 7fc7d7fff700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 msgr2=0x7fc7e00a3440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:24:24.017 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.131+0000 7fc7d7fff700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7e00a3440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:24.017 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.131+0000 7fc7d7fff700 1 -- 172.21.15.42:0/2923638022 >> v1:172.21.15.84:6789/0 conn(0x7fc7e0148690 legacy=0x7fc7e007fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:24.017 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.131+0000 7fc7d7fff700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:24.017 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.131+0000 7fc7d7fff700 1 -- 172.21.15.42:0/2923638022 --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e00a6b60 con 0x7fc7c4003390 2020-04-02T23:24:24.018 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.131+0000 7fc7d7fff700 1 -- 172.21.15.42:0/2923638022 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0080600 con 0x7fc7c4006fc0 2020-04-02T23:24:24.018 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.131+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.018 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.131+0000 7fc7e5ffc700 1 -- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 msgr2=0x7fc7c4009440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-04-02T23:24:24.018 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.131+0000 7fc7e5ffc700 1 -- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 msgr2=0x7fc7c4009440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:24:24.018 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.131+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:24:24.018 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.131+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:24:24.018 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.332+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.019 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.332+0000 7fc7e5ffc700 1 -- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 msgr2=0x7fc7c4009440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-04-02T23:24:24.019 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.332+0000 7fc7e5ffc700 1 -- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 msgr2=0x7fc7c4009440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:24:24.019 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.332+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:24:24.019 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.332+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-02T23:24:24.019 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.733+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.019 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.733+0000 7fc7e5ffc700 1 -- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 msgr2=0x7fc7c4009440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-04-02T23:24:24.019 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.733+0000 7fc7e5ffc700 1 -- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 msgr2=0x7fc7c4009440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:24:24.020 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.733+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:24:24.020 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:20.733+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-04-02T23:24:24.020 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:21.535+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.020 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:21.535+0000 7fc7e5ffc700 1 -- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 msgr2=0x7fc7c4009440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-04-02T23:24:24.020 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:21.535+0000 7fc7e5ffc700 1 -- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 msgr2=0x7fc7c4009440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:24:24.020 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:21.535+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:24:24.020 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:21.535+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-04-02T23:24:24.021 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.131+0000 7fc7d7fff700 1 -- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 msgr2=0x7fc7c4009440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:24:24.021 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.131+0000 7fc7d7fff700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:24.021 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.131+0000 7fc7d7fff700 1 -- 172.21.15.42:0/2923638022 >> v1:172.21.15.42:6789/0 conn(0x7fc7c4003390 legacy=0x7fc7c40057f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:24.021 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.131+0000 7fc7d7fff700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:24.021 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.131+0000 7fc7d7fff700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7c4009c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:24.021 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.131+0000 7fc7e6ffe700 1 -- 172.21.15.42:0/2923638022 reap_dead start 2020-04-02T23:24:24.021 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.131+0000 7fc7d7fff700 1 -- 172.21.15.42:0/2923638022 --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c400ac10 con 0x7fc7e0148690 2020-04-02T23:24:24.022 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.131+0000 7fc7d7fff700 1 -- 172.21.15.42:0/2923638022 --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e0080600 con 0x7fc7e00ab230 2020-04-02T23:24:24.022 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.131+0000 7fc7d7fff700 1 -- 172.21.15.42:0/2923638022 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e00a68c0 con 0x7fc7c4006fc0 2020-04-02T23:24:24.022 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.131+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7c4009c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.022 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.131+0000 7fc7e5ffc700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 msgr2=0x7fc7c4009c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-04-02T23:24:24.022 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.131+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.022 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.131+0000 7fc7e5ffc700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 msgr2=0x7fc7c4009c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:24:24.022 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.132+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7c4009c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:24:24.023 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.132+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7c4009c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:24:24.023 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.132+0000 7fc7e67fd700 1 -- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 msgr2=0x7fc7c4009440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-04-02T23:24:24.023 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.132+0000 7fc7e67fd700 1 -- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 msgr2=0x7fc7c4009440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:24:24.023 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.132+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:24:24.023 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.132+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-04-02T23:24:24.023 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.333+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7c4009c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.023 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.333+0000 7fc7e5ffc700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 msgr2=0x7fc7c4009c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-04-02T23:24:24.023 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.333+0000 7fc7e5ffc700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 msgr2=0x7fc7c4009c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:24:24.024 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.333+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7c4009c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:24:24.024 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.333+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.024 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.333+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7c4009c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-02T23:24:24.024 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.333+0000 7fc7e67fd700 1 -- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 msgr2=0x7fc7c4009440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-04-02T23:24:24.024 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.333+0000 7fc7e67fd700 1 -- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 msgr2=0x7fc7c4009440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:24:24.024 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.333+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:24:24.024 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.333+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-04-02T23:24:24.025 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.734+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7c4009c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.025 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.734+0000 7fc7e5ffc700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 msgr2=0x7fc7c4009c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-04-02T23:24:24.025 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.734+0000 7fc7e5ffc700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 msgr2=0x7fc7c4009c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:24:24.025 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.734+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7c4009c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:24:24.025 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.734+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7c4009c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-04-02T23:24:24.025 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.734+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.025 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.734+0000 7fc7e67fd700 1 -- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 msgr2=0x7fc7c4009440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-04-02T23:24:24.026 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.734+0000 7fc7e67fd700 1 -- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 msgr2=0x7fc7c4009440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-04-02T23:24:24.026 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.734+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-04-02T23:24:24.026 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.734+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-04-02T23:24:24.026 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.996+0000 7fc7e57fb700 1 -- 172.21.15.42:0/2923638022 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752648327 0 0) 0x7fc7c400ac10 con 0x7fc7e0148690 2020-04-02T23:24:24.026 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.996+0000 7fc7e57fb700 1 -- 172.21.15.42:0/2923638022 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7cc003230 con 0x7fc7e0148690 2020-04-02T23:24:24.026 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.997+0000 7fc7e57fb700 1 -- 172.21.15.42:0/2923638022 <== mon.1 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 533904258 0 0) 0x7fc7cc003230 con 0x7fc7e0148690 2020-04-02T23:24:24.026 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.997+0000 7fc7e57fb700 1 -- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 msgr2=0x7fc7c4009440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:24:24.027 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.997+0000 7fc7e57fb700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7c4009440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:24.027 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.997+0000 7fc7e57fb700 1 -- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 msgr2=0x7fc7c4009c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:24:24.027 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.997+0000 7fc7e57fb700 1 --2- 172.21.15.42:0/2923638022 >> v2:172.21.15.42:3300/0 conn(0x7fc7e00ab230 0x7fc7c4009c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:24.027 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.997+0000 7fc7e57fb700 1 -- 172.21.15.42:0/2923638022 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c400a8f0 con 0x7fc7e0148690 2020-04-02T23:24:24.027 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.997+0000 7fc7e57fb700 1 -- 172.21.15.42:0/2923638022 <== mon.1 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7fc7d8001640 con 0x7fc7e0148690 2020-04-02T23:24:24.027 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.998+0000 7fc7e57fb700 1 -- 172.21.15.42:0/2923638022 >> v1:172.21.15.84:6789/0 conn(0x7fc7e0148690 legacy=0x7fc7c400a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:24.027 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.998+0000 7fc7e57fb700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7cc003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:24.027 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.998+0000 7fc7e57fb700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7cc003b80 0x7fc7cc003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:24.028 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.998+0000 7fc7e57fb700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7cc004520 0x7fc7cc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:24.028 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.998+0000 7fc7e57fb700 1 -- 172.21.15.42:0/2923638022 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0080600 con 0x7fc7cc004520 2020-04-02T23:24:24.028 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.998+0000 7fc7e57fb700 1 -- 172.21.15.42:0/2923638022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e00a68c0 con 0x7fc7cc003b80 2020-04-02T23:24:24.028 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.998+0000 7fc7e57fb700 1 -- 172.21.15.42:0/2923638022 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc004fb0 con 0x7fc7c4006fc0 2020-04-02T23:24:24.028 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.998+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7cc003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.028 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.998+0000 7fc7e6ffe700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7cc004520 0x7fc7cc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.028 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.998+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7cc003b80 0x7fc7cc003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.029 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.998+0000 7fc7e6ffe700 1 -- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 msgr2=0x7fc7cc003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:24.029 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.998+0000 7fc7e6ffe700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7cc003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:24.029 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.998+0000 7fc7e6ffe700 1 -- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7cc003b80 msgr2=0x7fc7cc003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:24.029 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.998+0000 7fc7e6ffe700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7cc003b80 0x7fc7cc003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:24.029 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.998+0000 7fc7e6ffe700 1 -- 172.21.15.42:0/2923638022 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7cc003230 con 0x7fc7cc004520 2020-04-02T23:24:24.029 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.998+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7cc003b80 0x7fc7cc003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:24:24.029 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.998+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7c4006fc0 0x7fc7cc003720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:24.030 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.998+0000 7fc7e6ffe700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7cc004520 0x7fc7cc004980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc7d8000b20 tx=0x7fc7e00ab800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:24.030 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.998+0000 7fc7e6ffe700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7cc004520 0x7fc7cc004980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc7d8000b20 tx=0x7fc7e00ab800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:24.030 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:23.999+0000 7fc7e6ffe700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7cc004520 0x7fc7cc004980 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7fc7d8000b20 tx=0x7fc7e00ab800).ready entity=mon.0 client_cookie=371611a5b769c7ca server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:24.030 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.000+0000 7fc7e6ffe700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7cc004520 0x7fc7cc004980 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fc7d8000b20 tx=0x7fc7e00ab800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:24.030 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.000+0000 7fc7e57fb700 1 -- 172.21.15.42:0/2923638022 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7d8007350 con 0x7fc7cc004520 2020-04-02T23:24:24.030 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.000+0000 7fc7e6ffe700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7cc004520 0x7fc7cc004980 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fc7d8000b20 tx=0x7fc7e00ab800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:24.030 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.000+0000 7fc7e57fb700 1 -- 172.21.15.42:0/2923638022 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d80074b0 con 0x7fc7cc004520 2020-04-02T23:24:24.031 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.000+0000 7fc7e6ffe700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7cc004520 0x7fc7cc004980 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fc7d8000b20 tx=0x7fc7e00ab800).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:24.031 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.000+0000 7fc7e57fb700 1 -- 172.21.15.42:0/2923638022 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7d8007810 con 0x7fc7cc004520 2020-04-02T23:24:24.031 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.000+0000 7fc7e8260700 1 -- 172.21.15.42:0/2923638022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7cc004520 msgr2=0x7fc7cc004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:24.031 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.000+0000 7fc7e8260700 1 --2- 172.21.15.42:0/2923638022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7cc004520 0x7fc7cc004980 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7fc7d8000b20 tx=0x7fc7e00ab800).stop 2020-04-02T23:24:24.031 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.000+0000 7fc7e6ffe700 1 -- 172.21.15.42:0/2923638022 reap_dead start 2020-04-02T23:24:24.031 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.001+0000 7fc7e8260700 1 -- 172.21.15.42:0/2923638022 shutdown_connections 2020-04-02T23:24:24.031 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.001+0000 7fc7e8260700 1 -- 172.21.15.42:0/2923638022 >> 172.21.15.42:0/2923638022 conn(0x7fc7e009dc40 msgr2=0x7fc7e00aa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:24.032 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.001+0000 7fc7e8260700 1 -- 172.21.15.42:0/2923638022 shutdown_connections 2020-04-02T23:24:24.032 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.001+0000 7fc7e8260700 1 -- 172.21.15.42:0/2923638022 wait complete. 2020-04-02T23:24:24.032 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.004+0000 7fc7e8260700 1 Processor -- start 2020-04-02T23:24:24.032 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.004+0000 7fc7e8260700 1 -- start start 2020-04-02T23:24:24.033 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.004+0000 7fc7e8260700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc7e0070fa0 0x7fc7e0066240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:24.033 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.004+0000 7fc7e8260700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7e0071380 0x7fc7e0132870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:24.033 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.004+0000 7fc7e8260700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e005bc60 con 0x7fc7e0135e40 2020-04-02T23:24:24.033 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.004+0000 7fc7e8260700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e0070250 con 0x7fc7e0070fa0 2020-04-02T23:24:24.033 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.004+0000 7fc7e8260700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0065b00 con 0x7fc7e0071380 2020-04-02T23:24:24.033 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.004+0000 7fc7e67fd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc7e0070fa0 0x7fc7e0066240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.033 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.004+0000 7fc7e67fd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc7e0070fa0 0x7fc7e0066240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39230/0 (socket says 172.21.15.42:39230) 2020-04-02T23:24:24.034 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.004+0000 7fc7e67fd700 1 -- 172.21.15.42:0/2182885205 learned_addr learned my addr 172.21.15.42:0/2182885205 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:24.034 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.004+0000 7fc7e5ffc700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7e0071380 0x7fc7e0132870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:24.035 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.005+0000 7fc7d6ffd700 1 -- 172.21.15.42:0/2182885205 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450664671 0 0) 0x7fc7e005bc60 con 0x7fc7e0135e40 2020-04-02T23:24:24.035 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.005+0000 7fc7d6ffd700 1 -- 172.21.15.42:0/2182885205 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7c8002fe0 con 0x7fc7e0135e40 2020-04-02T23:24:24.035 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.005+0000 7fc7e67fd700 1 -- 172.21.15.42:0/2182885205 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7e0071380 msgr2=0x7fc7e0132870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:24.035 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.005+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2182885205 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7e0071380 0x7fc7e0132870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:24.035 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.005+0000 7fc7e67fd700 1 -- 172.21.15.42:0/2182885205 >> v1:172.21.15.84:6789/0 conn(0x7fc7e0135e40 legacy=0x7fc7e01362d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:24.036 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.005+0000 7fc7e67fd700 1 -- 172.21.15.42:0/2182885205 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e0066e10 con 0x7fc7e0070fa0 2020-04-02T23:24:24.036 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.005+0000 7fc7e5ffc700 1 --2- 172.21.15.42:0/2182885205 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7e0071380 0x7fc7e0132870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:24.036 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.005+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2182885205 >> v2:172.21.15.42:3300/0 conn(0x7fc7e0070fa0 0x7fc7e0066240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc7e006fda0 tx=0x7fc7e00680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:24.036 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.005+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2182885205 >> v2:172.21.15.42:3300/0 conn(0x7fc7e0070fa0 0x7fc7e0066240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc7e006fda0 tx=0x7fc7e00680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:24.036 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.005+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2182885205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7e0070fa0 0x7fc7e0066240 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fc7e006fda0 tx=0x7fc7e00680a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:24.036 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.005+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2182885205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7e0070fa0 0x7fc7e0066240 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fc7e006fda0 tx=0x7fc7e00680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:24.037 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.005+0000 7fc7d6ffd700 1 -- 172.21.15.42:0/2182885205 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7dc005e90 con 0x7fc7e0070fa0 2020-04-02T23:24:24.037 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.005+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2182885205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7e0070fa0 0x7fc7e0066240 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fc7e006fda0 tx=0x7fc7e00680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:24.037 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.005+0000 7fc7e8260700 1 -- 172.21.15.42:0/2182885205 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e0065da0 con 0x7fc7e0070fa0 2020-04-02T23:24:24.037 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.005+0000 7fc7d6ffd700 1 -- 172.21.15.42:0/2182885205 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc007160 con 0x7fc7e0070fa0 2020-04-02T23:24:24.037 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.005+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2182885205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7e0070fa0 0x7fc7e0066240 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fc7e006fda0 tx=0x7fc7e00680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:24.037 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.005+0000 7fc7d6ffd700 1 -- 172.21.15.42:0/2182885205 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7dc0074c0 con 0x7fc7e0070fa0 2020-04-02T23:24:24.037 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.005+0000 7fc7e8260700 1 -- 172.21.15.42:0/2182885205 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e0064d70 con 0x7fc7e0070fa0 2020-04-02T23:24:24.037 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.006+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2182885205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7e0070fa0 0x7fc7e0066240 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fc7e006fda0 tx=0x7fc7e00680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:24.038 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.006+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2182885205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7e0070fa0 0x7fc7e0066240 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fc7e006fda0 tx=0x7fc7e00680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:24.038 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.006+0000 7fc7d6ffd700 1 -- 172.21.15.42:0/2182885205 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) v1 ==== 360+0+0 (secure 0 0 0) 0x7fc7dc00b250 con 0x7fc7e0070fa0 2020-04-02T23:24:24.038 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.006+0000 7fc7d6ffd700 1 -- 172.21.15.42:0/2182885205 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fc7dc008df0 con 0x7fc7e0070fa0 2020-04-02T23:24:24.038 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.007+0000 7fc7e8260700 1 -- 172.21.15.42:0/2182885205 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e0056c50 con 0x7fc7e0070fa0 2020-04-02T23:24:24.039 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.011+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2182885205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7e0070fa0 0x7fc7e0066240 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fc7e006fda0 tx=0x7fc7e00680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:24.039 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.011+0000 7fc7d6ffd700 1 -- 172.21.15.42:0/2182885205 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67700 (secure 0 0 0) 0x7fc7dc012bd0 con 0x7fc7e0070fa0 2020-04-02T23:24:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.093+0000 7fc7e8260700 1 -- 172.21.15.42:0/2182885205 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc7e00a5f50 con 0x7fc7e0070fa0 2020-04-02T23:24:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.096+0000 7fc7e67fd700 1 --2- 172.21.15.42:0/2182885205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7e0070fa0 0x7fc7e0066240 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7fc7e006fda0 tx=0x7fc7e00680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:24.098 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.096+0000 7fc7d6ffd700 1 -- 172.21.15.42:0/2182885205 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc7dc012d70 con 0x7fc7e0070fa0 2020-04-02T23:24:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.097+0000 7fc7e8260700 1 -- 172.21.15.42:0/2182885205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7e0070fa0 msgr2=0x7fc7e0066240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.097+0000 7fc7e8260700 1 --2- 172.21.15.42:0/2182885205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7e0070fa0 0x7fc7e0066240 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7fc7e006fda0 tx=0x7fc7e00680a0).stop 2020-04-02T23:24:24.099 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.097+0000 7fc7e8260700 1 -- 172.21.15.42:0/2182885205 shutdown_connections 2020-04-02T23:24:24.100 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.097+0000 7fc7e8260700 1 --2- 172.21.15.42:0/2182885205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7e0070fa0 0x7fc7e0066240 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:24.100 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.097+0000 7fc7e8260700 1 --2- 172.21.15.42:0/2182885205 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc7e0071380 0x7fc7e0132870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:24.100 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.097+0000 7fc7e8260700 1 -- 172.21.15.42:0/2182885205 >> 172.21.15.42:0/2182885205 conn(0x7fc7e009dc40 msgr2=0x7fc7e00a7240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:24.100 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.097+0000 7fc7e8260700 1 -- 172.21.15.42:0/2182885205 shutdown_connections 2020-04-02T23:24:24.100 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:24.097+0000 7fc7e8260700 1 -- 172.21.15.42:0/2182885205 wait complete. 2020-04-02T23:24:24.101 INFO:teuthology.orchestra.run.smithi042.stderr:adjusted tunables profile to default 2020-04-02T23:24:24.109 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-04-02T23:24:24.110 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:24.125 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-02T23:24:24.179 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.MKEqUsXoQ6 2020-04-02T23:24:24.179 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:24.236 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.MKEqUsXoQ6 2020-04-02T23:24:24.304 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:24.358 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.MKEqUsXoQ6 2020-04-02T23:24:24.483 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.MKEqUsXoQ6 is 37B 2020-04-02T23:24:24.530 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:24.544 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.MKEqUsXoQ6 2020-04-02T23:24:24.596 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:24.649 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-02T23:24:24.705 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.Qc2fbTaVvb 2020-04-02T23:24:24.706 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:24.759 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.Qc2fbTaVvb 2020-04-02T23:24:24.827 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:24.881 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.Qc2fbTaVvb 2020-04-02T23:24:25.039 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.Qc2fbTaVvb is 37B 2020-04-02T23:24:25.086 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:25.100 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.Qc2fbTaVvb 2020-04-02T23:24:25.153 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:25.211 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-02T23:24:25.274 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.fRbyyWYOHw 2020-04-02T23:24:25.275 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:25.330 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.fRbyyWYOHw 2020-04-02T23:24:25.397 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:25.451 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.fRbyyWYOHw 2020-04-02T23:24:25.578 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.fRbyyWYOHw is 37B 2020-04-02T23:24:25.644 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:25.661 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.fRbyyWYOHw 2020-04-02T23:24:25.715 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:25.768 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-02T23:24:25.822 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.XyTwR464rD 2020-04-02T23:24:25.822 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:25.875 INFO:teuthology.orchestra.run.smithi084:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.XyTwR464rD 2020-04-02T23:24:25.944 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:25.997 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.XyTwR464rD 2020-04-02T23:24:26.124 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.XyTwR464rD is 37B 2020-04-02T23:24:26.171 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:26.184 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.XyTwR464rD 2020-04-02T23:24:26.238 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:26.251 INFO:teuthology.orchestra.run.smithi042:> mktemp 2020-04-02T23:24:26.307 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.F8pjIUB91u 2020-04-02T23:24:26.307 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:26.366 INFO:teuthology.orchestra.run.smithi042:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.F8pjIUB91u 2020-04-02T23:24:26.440 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:26.494 INFO:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.F8pjIUB91u 2020-04-02T23:24:26.621 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.F8pjIUB91u is 37B 2020-04-02T23:24:26.668 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:26.682 INFO:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.F8pjIUB91u 2020-04-02T23:24:26.737 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:26.791 INFO:teuthology.orchestra.run.smithi042:> mktemp 2020-04-02T23:24:26.845 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.bMD7vlbSQq 2020-04-02T23:24:26.845 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:26.898 INFO:teuthology.orchestra.run.smithi042:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.bMD7vlbSQq 2020-04-02T23:24:26.971 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:27.024 INFO:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.bMD7vlbSQq 2020-04-02T23:24:27.155 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.bMD7vlbSQq is 37B 2020-04-02T23:24:27.203 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:27.232 INFO:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.bMD7vlbSQq 2020-04-02T23:24:27.285 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:27.339 INFO:teuthology.orchestra.run.smithi042:> mktemp 2020-04-02T23:24:27.393 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.irbKkiLLkB 2020-04-02T23:24:27.394 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:27.447 INFO:teuthology.orchestra.run.smithi042:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.irbKkiLLkB 2020-04-02T23:24:27.518 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:27.571 INFO:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.irbKkiLLkB 2020-04-02T23:24:27.699 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.irbKkiLLkB is 37B 2020-04-02T23:24:27.748 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:27.761 INFO:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.irbKkiLLkB 2020-04-02T23:24:27.815 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:27.868 INFO:teuthology.orchestra.run.smithi042:> mktemp 2020-04-02T23:24:27.922 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.Nu3fMK1xDg 2020-04-02T23:24:27.922 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:27.975 INFO:teuthology.orchestra.run.smithi042:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.Nu3fMK1xDg 2020-04-02T23:24:28.047 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:28.101 INFO:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.Nu3fMK1xDg 2020-04-02T23:24:28.229 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.Nu3fMK1xDg is 37B 2020-04-02T23:24:28.278 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:28.291 INFO:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.Nu3fMK1xDg 2020-04-02T23:24:28.345 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:28.398 INFO:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 976aac36-1cf8-408b-bf56-9f0eefe43b06 0 2020-04-02T23:24:28.553 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.548+0000 7f1af3480700 1 Processor -- start 2020-04-02T23:24:28.554 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.548+0000 7f1af3480700 1 -- start start 2020-04-02T23:24:28.554 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.549+0000 7f1af3480700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1aec0ab230 0x7f1aec0a3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:28.554 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.549+0000 7f1af3480700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1aec080190 0x7f1aec148b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:28.555 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.549+0000 7f1af3480700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aec0a55c0 con 0x7f1aec148690 2020-04-02T23:24:28.555 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.549+0000 7f1af3480700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aec080600 con 0x7f1aec080190 2020-04-02T23:24:28.556 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.549+0000 7f1af3480700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aec0a68c0 con 0x7f1aec0ab230 2020-04-02T23:24:28.556 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.549+0000 7f1af221e700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1aec080190 0x7f1aec148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:28.556 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.549+0000 7f1af221e700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1aec080190 0x7f1aec148b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39242/0 (socket says 172.21.15.42:39242) 2020-04-02T23:24:28.556 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.549+0000 7f1af221e700 1 -- 172.21.15.42:0/2406987394 learned_addr learned my addr 172.21.15.42:0/2406987394 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:28.556 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.549+0000 7f1af1a1d700 1 --2- 172.21.15.42:0/2406987394 >> v2:172.21.15.84:3300/0 conn(0x7f1aec0ab230 0x7f1aec0a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:28.556 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.549+0000 7f1af221e700 1 -- 172.21.15.42:0/2406987394 >> v2:172.21.15.84:3300/0 conn(0x7f1aec0ab230 msgr2=0x7f1aec0a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:28.556 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.549+0000 7f1af221e700 1 --2- 172.21.15.42:0/2406987394 >> v2:172.21.15.84:3300/0 conn(0x7f1aec0ab230 0x7f1aec0a3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:28.557 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.549+0000 7f1af221e700 1 -- 172.21.15.42:0/2406987394 >> v1:172.21.15.84:6789/0 conn(0x7f1aec148690 legacy=0x7f1aec07fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:28.557 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.549+0000 7f1af221e700 1 -- 172.21.15.42:0/2406987394 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec0a6b60 con 0x7f1aec080190 2020-04-02T23:24:28.557 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.549+0000 7f1af1a1d700 1 --2- 172.21.15.42:0/2406987394 >> v2:172.21.15.84:3300/0 conn(0x7f1aec0ab230 0x7f1aec0a3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:24:28.557 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.549+0000 7f1af221e700 1 --2- 172.21.15.42:0/2406987394 >> v2:172.21.15.42:3300/0 conn(0x7f1aec080190 0x7f1aec148b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1ae40032b0 tx=0x7f1ae4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.557 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.549+0000 7f1af221e700 1 --2- 172.21.15.42:0/2406987394 >> v2:172.21.15.42:3300/0 conn(0x7f1aec080190 0x7f1aec148b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1ae40032b0 tx=0x7f1ae4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.557 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.549+0000 7f1af221e700 1 --2- 172.21.15.42:0/2406987394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1aec080190 0x7f1aec148b20 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7f1ae40032b0 tx=0x7f1ae4007dc0).ready entity=mon.0 client_cookie=1af949d35cd6eef5 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:28.557 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.550+0000 7f1af221e700 1 --2- 172.21.15.42:0/2406987394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1aec080190 0x7f1aec148b20 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f1ae40032b0 tx=0x7f1ae4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.558 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.550+0000 7f1af0a1b700 1 -- 172.21.15.42:0/2406987394 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ae400a160 con 0x7f1aec080190 2020-04-02T23:24:28.558 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.550+0000 7f1af221e700 1 --2- 172.21.15.42:0/2406987394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1aec080190 0x7f1aec148b20 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f1ae40032b0 tx=0x7f1ae4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.558 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.550+0000 7f1af221e700 1 --2- 172.21.15.42:0/2406987394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1aec080190 0x7f1aec148b20 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f1ae40032b0 tx=0x7f1ae4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.558 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.550+0000 7f1af0a1b700 1 -- 172.21.15.42:0/2406987394 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae400a2c0 con 0x7f1aec080190 2020-04-02T23:24:28.559 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.550+0000 7f1af0a1b700 1 -- 172.21.15.42:0/2406987394 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ae400a6a0 con 0x7f1aec080190 2020-04-02T23:24:28.559 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.550+0000 7f1af3480700 1 -- 172.21.15.42:0/2406987394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1aec080190 msgr2=0x7f1aec148b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:28.559 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.550+0000 7f1af3480700 1 --2- 172.21.15.42:0/2406987394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1aec080190 0x7f1aec148b20 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7f1ae40032b0 tx=0x7f1ae4007dc0).stop 2020-04-02T23:24:28.559 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.550+0000 7f1af3480700 1 -- 172.21.15.42:0/2406987394 shutdown_connections 2020-04-02T23:24:28.559 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.550+0000 7f1af3480700 1 --2- 172.21.15.42:0/2406987394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1aec080190 0x7f1aec148b20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:28.560 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.550+0000 7f1af3480700 1 --2- 172.21.15.42:0/2406987394 >> v2:172.21.15.84:3300/0 conn(0x7f1aec0ab230 0x7f1aec0a3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:28.560 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.550+0000 7f1af3480700 1 -- 172.21.15.42:0/2406987394 >> 172.21.15.42:0/2406987394 conn(0x7f1aec09dc40 msgr2=0x7f1aec0aa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:28.560 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.550+0000 7f1af3480700 1 -- 172.21.15.42:0/2406987394 shutdown_connections 2020-04-02T23:24:28.560 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.550+0000 7f1af3480700 1 -- 172.21.15.42:0/2406987394 wait complete. 2020-04-02T23:24:28.560 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.551+0000 7f1af3480700 1 Processor -- start 2020-04-02T23:24:28.560 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.551+0000 7f1af3480700 1 -- start start 2020-04-02T23:24:28.564 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.552+0000 7f1af3480700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1aec0ab230 0x7f1aec0a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:28.564 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.552+0000 7f1af3480700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1aec148690 0x7f1aec063350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:28.564 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.552+0000 7f1af3480700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aec062ba0 con 0x7f1aec080190 2020-04-02T23:24:28.564 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.552+0000 7f1af3480700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aec061f70 con 0x7f1aec0ab230 2020-04-02T23:24:28.564 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.552+0000 7f1af3480700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec0637b0 con 0x7f1aec148690 2020-04-02T23:24:28.564 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.552+0000 7f1af121c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1aec0ab230 0x7f1aec0a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:28.565 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.552+0000 7f1af221e700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1aec148690 0x7f1aec063350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:28.565 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.552+0000 7f1af1a1d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1aec080190 0x7f1aec09f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:53046/0 (socket says 172.21.15.42:53046) 2020-04-02T23:24:28.565 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.552+0000 7f1af1a1d700 1 -- 172.21.15.42:0/3879859067 learned_addr learned my addr 172.21.15.42:0/3879859067 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:28.565 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.553+0000 7f1af121c700 1 -- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1aec148690 msgr2=0x7f1aec063350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:28.565 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.553+0000 7f1af121c700 1 --2- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1aec148690 0x7f1aec063350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.553+0000 7f1af121c700 1 -- 172.21.15.42:0/3879859067 >> v1:172.21.15.84:6789/0 conn(0x7f1aec080190 legacy=0x7f1aec09f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.553+0000 7f1ae27fc700 1 -- 172.21.15.42:0/3879859067 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246176381 0 0) 0x7f1aec062ba0 con 0x7f1aec080190 2020-04-02T23:24:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.553+0000 7f1af121c700 1 -- 172.21.15.42:0/3879859067 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec0a0c70 con 0x7f1aec0ab230 2020-04-02T23:24:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.553+0000 7f1af121c700 1 --2- 172.21.15.42:0/3879859067 >> v2:172.21.15.84:3300/0 conn(0x7f1aec0ab230 0x7f1aec0a13b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1aec0a82c0 tx=0x7f1adc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.553+0000 7f1af121c700 1 --2- 172.21.15.42:0/3879859067 >> v2:172.21.15.84:3300/0 conn(0x7f1aec0ab230 0x7f1aec0a13b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1aec0a82c0 tx=0x7f1adc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.553+0000 7f1af121c700 1 --2- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec0ab230 0x7f1aec0a13b0 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7f1aec0a82c0 tx=0x7f1adc010880).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:28.567 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.553+0000 7f1af121c700 1 --2- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec0ab230 0x7f1aec0a13b0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f1aec0a82c0 tx=0x7f1adc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.567 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.553+0000 7f1ae27fc700 1 -- 172.21.15.42:0/3879859067 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1adc006bc0 con 0x7f1aec0ab230 2020-04-02T23:24:28.567 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.553+0000 7f1af121c700 1 --2- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec0ab230 0x7f1aec0a13b0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f1aec0a82c0 tx=0x7f1adc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.567 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.553+0000 7f1ae27fc700 1 -- 172.21.15.42:0/3879859067 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1adc006d60 con 0x7f1aec0ab230 2020-04-02T23:24:28.567 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.553+0000 7f1af121c700 1 --2- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec0ab230 0x7f1aec0a13b0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f1aec0a82c0 tx=0x7f1adc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.567 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.553+0000 7f1af3480700 1 -- 172.21.15.42:0/3879859067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aec0a0f10 con 0x7f1aec0ab230 2020-04-02T23:24:28.567 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.553+0000 7f1ae27fc700 1 -- 172.21.15.42:0/3879859067 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1adc0110a0 con 0x7f1aec0ab230 2020-04-02T23:24:28.567 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.553+0000 7f1af3480700 1 -- 172.21.15.42:0/3879859067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aec060fd0 con 0x7f1aec0ab230 2020-04-02T23:24:28.568 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.554+0000 7f1af121c700 1 --2- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec0ab230 0x7f1aec0a13b0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f1aec0a82c0 tx=0x7f1adc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.568 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.554+0000 7f1ae27fc700 1 -- 172.21.15.42:0/3879859067 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 3) v1 ==== 59405+0+0 (secure 0 0 0) 0x7f1adc011320 con 0x7f1aec0ab230 2020-04-02T23:24:28.568 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.554+0000 7f1af121c700 1 --2- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec0ab230 0x7f1aec0a13b0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f1aec0a82c0 tx=0x7f1adc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.568 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.554+0000 7f1af3480700 1 -- 172.21.15.42:0/3879859067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aec0a0180 con 0x7f1aec0ab230 2020-04-02T23:24:28.568 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.554+0000 7f1ae27fc700 1 --2- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1ad404d350 0x7f1ad404f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:28.568 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.554+0000 7f1ae27fc700 1 -- 172.21.15.42:0/3879859067 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1130+0+0 (secure 0 0 0) 0x7f1adc060de0 con 0x7f1aec0ab230 2020-04-02T23:24:28.568 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.554+0000 7f1af1a1d700 1 --2- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1ad404d350 0x7f1ad404f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:28.569 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.555+0000 7f1af1a1d700 1 --2- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1ad404d350 0x7f1ad404f810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1ae8007a40 tx=0x7f1aec0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.569 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.555+0000 7f1af1a1d700 1 --2- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1ad404d350 0x7f1ad404f810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1ae8007a40 tx=0x7f1aec0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.569 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.555+0000 7f1af1a1d700 1 --2- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1ad404d350 0x7f1ad404f810 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7f1ae8007a40 tx=0x7f1aec0680a0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:28.569 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.558+0000 7f1af121c700 1 --2- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec0ab230 0x7f1aec0a13b0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f1aec0a82c0 tx=0x7f1adc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.571 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.558+0000 7f1ae27fc700 1 -- 172.21.15.42:0/3879859067 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f1adc03c540 con 0x7f1aec0ab230 2020-04-02T23:24:28.724 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.722+0000 7f1af3480700 1 -- 172.21.15.42:0/3879859067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd new", "uuid": "976aac36-1cf8-408b-bf56-9f0eefe43b06", "id": 0} v 0) v1 -- 0x7f1aec056c50 con 0x7f1aec0ab230 2020-04-02T23:24:28.729 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.726+0000 7f1af121c700 1 --2- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec0ab230 0x7f1aec0a13b0 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7f1aec0a82c0 tx=0x7f1adc010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.729 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.727+0000 7f1ae27fc700 1 -- 172.21.15.42:0/3879859067 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "976aac36-1cf8-408b-bf56-9f0eefe43b06", "id": 0}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1adc03fb60 con 0x7f1aec0ab230 2020-04-02T23:24:28.729 INFO:teuthology.orchestra.run.smithi042.stdout:0 2020-04-02T23:24:28.731 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.728+0000 7f1af3480700 1 -- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1ad404d350 msgr2=0x7f1ad404f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:28.731 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.728+0000 7f1af3480700 1 --2- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1ad404d350 0x7f1ad404f810 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7f1ae8007a40 tx=0x7f1aec0680a0).stop 2020-04-02T23:24:28.731 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.728+0000 7f1af3480700 1 -- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec0ab230 msgr2=0x7f1aec0a13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:28.731 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.728+0000 7f1af3480700 1 --2- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec0ab230 0x7f1aec0a13b0 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7f1aec0a82c0 tx=0x7f1adc010880).stop 2020-04-02T23:24:28.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.728+0000 7f1af3480700 1 -- 172.21.15.42:0/3879859067 shutdown_connections 2020-04-02T23:24:28.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.728+0000 7f1af3480700 1 --2- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1ad404d350 0x7f1ad404f810 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:28.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.728+0000 7f1af3480700 1 --2- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1aec148690 0x7f1aec063350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:28.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.728+0000 7f1af3480700 1 --2- 172.21.15.42:0/3879859067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1aec0ab230 0x7f1aec0a13b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:28.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.728+0000 7f1af3480700 1 -- 172.21.15.42:0/3879859067 >> 172.21.15.42:0/3879859067 conn(0x7f1aec09dc40 msgr2=0x7f1aec123d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:28.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.728+0000 7f1af3480700 1 -- 172.21.15.42:0/3879859067 shutdown_connections 2020-04-02T23:24:28.733 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.728+0000 7f1af3480700 1 -- 172.21.15.42:0/3879859067 wait complete. 2020-04-02T23:24:28.741 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:28.755 INFO:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 22c1e489-ab99-4205-ba9d-fbfc144d2a8d 1 2020-04-02T23:24:28.916 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.907+0000 7f132741b700 1 Processor -- start 2020-04-02T23:24:28.916 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.907+0000 7f132741b700 1 -- start start 2020-04-02T23:24:28.916 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.908+0000 7f132741b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1320148da0 0x7f13200a3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:28.917 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.908+0000 7f132741b700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f132007fa80 0x7f132007ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:28.918 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.908+0000 7f132741b700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13200a55c0 con 0x7f13200ab230 2020-04-02T23:24:28.918 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.908+0000 7f132741b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13200a68c0 con 0x7f1320148da0 2020-04-02T23:24:28.919 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.908+0000 7f132741b700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13200a6b60 con 0x7f132007fa80 2020-04-02T23:24:28.919 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.908+0000 7f13259b8700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f13200ab230 0x7f1320148690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:58676/0 (socket says 172.21.15.42:58676) 2020-04-02T23:24:28.919 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.908+0000 7f13259b8700 1 -- 172.21.15.42:0/651820375 learned_addr learned my addr 172.21.15.42:0/651820375 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:28.919 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.908+0000 7f13261b9700 1 --2- 172.21.15.42:0/651820375 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f132007fa80 0x7f132007ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:28.919 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.908+0000 7f13251b7700 1 --2- 172.21.15.42:0/651820375 >> v2:172.21.15.84:3300/0 conn(0x7f1320148da0 0x7f13200a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:28.919 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.908+0000 7f13249b6700 1 -- 172.21.15.42:0/651820375 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46295494 0 0) 0x7f13200a55c0 con 0x7f13200ab230 2020-04-02T23:24:28.920 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.908+0000 7f13249b6700 1 -- 172.21.15.42:0/651820375 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f130c003230 con 0x7f13200ab230 2020-04-02T23:24:28.920 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.908+0000 7f13249b6700 1 -- 172.21.15.42:0/651820375 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2958500437 0 0) 0x7f130c003230 con 0x7f13200ab230 2020-04-02T23:24:28.921 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.908+0000 7f13261b9700 1 -- 172.21.15.42:0/651820375 >> v2:172.21.15.84:3300/0 conn(0x7f1320148da0 msgr2=0x7f13200a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:28.921 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.908+0000 7f13261b9700 1 --2- 172.21.15.42:0/651820375 >> v2:172.21.15.84:3300/0 conn(0x7f1320148da0 0x7f13200a3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:28.921 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.908+0000 7f13261b9700 1 -- 172.21.15.42:0/651820375 >> v1:172.21.15.42:6789/0 conn(0x7f13200ab230 legacy=0x7f1320148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:28.921 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.908+0000 7f13261b9700 1 -- 172.21.15.42:0/651820375 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13200a6380 con 0x7f132007fa80 2020-04-02T23:24:28.921 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.908+0000 7f13251b7700 1 --2- 172.21.15.42:0/651820375 >> v2:172.21.15.84:3300/0 conn(0x7f1320148da0 0x7f13200a3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:28.921 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.908+0000 7f13261b9700 1 --2- 172.21.15.42:0/651820375 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f132007fa80 0x7f132007ff30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f131c0019f0 tx=0x7f1318007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.922 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.908+0000 7f13261b9700 1 --2- 172.21.15.42:0/651820375 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f132007fa80 0x7f132007ff30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f131c0019f0 tx=0x7f1318007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.922 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.908+0000 7f13261b9700 1 --2- 172.21.15.42:0/651820375 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f132007fa80 0x7f132007ff30 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f131c0019f0 tx=0x7f1318007dc0).ready entity=mon.2 client_cookie=1670760788e84d56 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:28.923 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.909+0000 7f13261b9700 1 --2- 172.21.15.42:0/651820375 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f132007fa80 0x7f132007ff30 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f131c0019f0 tx=0x7f1318007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.923 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.909+0000 7f13249b6700 1 -- 172.21.15.42:0/651820375 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f131c001850 con 0x7f132007fa80 2020-04-02T23:24:28.923 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.909+0000 7f13261b9700 1 --2- 172.21.15.42:0/651820375 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f132007fa80 0x7f132007ff30 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f131c0019f0 tx=0x7f1318007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.923 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.909+0000 7f13261b9700 1 --2- 172.21.15.42:0/651820375 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f132007fa80 0x7f132007ff30 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f131c0019f0 tx=0x7f1318007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.923 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.909+0000 7f13249b6700 1 -- 172.21.15.42:0/651820375 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1318010a10 con 0x7f132007fa80 2020-04-02T23:24:28.923 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.909+0000 7f13249b6700 1 -- 172.21.15.42:0/651820375 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1318010d70 con 0x7f132007fa80 2020-04-02T23:24:28.923 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.909+0000 7f132741b700 1 -- 172.21.15.42:0/651820375 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f132007fa80 msgr2=0x7f132007ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:28.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.909+0000 7f132741b700 1 --2- 172.21.15.42:0/651820375 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f132007fa80 0x7f132007ff30 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f131c0019f0 tx=0x7f1318007dc0).stop 2020-04-02T23:24:28.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.909+0000 7f132741b700 1 -- 172.21.15.42:0/651820375 shutdown_connections 2020-04-02T23:24:28.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.909+0000 7f132741b700 1 --2- 172.21.15.42:0/651820375 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f132007fa80 0x7f132007ff30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:28.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.909+0000 7f132741b700 1 --2- 172.21.15.42:0/651820375 >> v2:172.21.15.84:3300/0 conn(0x7f1320148da0 0x7f13200a3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:28.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.909+0000 7f132741b700 1 -- 172.21.15.42:0/651820375 >> 172.21.15.42:0/651820375 conn(0x7f132009dc40 msgr2=0x7f13200aa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:28.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.909+0000 7f132741b700 1 -- 172.21.15.42:0/651820375 shutdown_connections 2020-04-02T23:24:28.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.909+0000 7f132741b700 1 -- 172.21.15.42:0/651820375 wait complete. 2020-04-02T23:24:28.925 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.910+0000 7f132741b700 1 Processor -- start 2020-04-02T23:24:28.925 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.910+0000 7f132741b700 1 -- start start 2020-04-02T23:24:28.925 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.911+0000 7f132741b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f132007fa80 0x7f1320064220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:28.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.911+0000 7f132741b700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1320062530 con 0x7f1320148da0 2020-04-02T23:24:28.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.911+0000 7f132741b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13201325f0 con 0x7f13200ab230 2020-04-02T23:24:28.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.911+0000 7f132741b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1320125370 con 0x7f132007fa80 2020-04-02T23:24:28.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.911+0000 7f13261b9700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f1320148da0 0x7f13200614a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:58686/0 (socket says 172.21.15.42:58686) 2020-04-02T23:24:28.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.911+0000 7f13261b9700 1 -- 172.21.15.42:0/322212310 learned_addr learned my addr 172.21.15.42:0/322212310 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:28.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.911+0000 7f13259b8700 1 --2- 172.21.15.42:0/322212310 >> v2:172.21.15.84:3300/0 conn(0x7f132007fa80 0x7f1320064220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:28.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.911+0000 7f13127fc700 1 -- 172.21.15.42:0/322212310 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676787229 0 0) 0x7f1320062530 con 0x7f1320148da0 2020-04-02T23:24:28.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.911+0000 7f13127fc700 1 -- 172.21.15.42:0/322212310 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1308003230 con 0x7f1320148da0 2020-04-02T23:24:28.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.911+0000 7f13259b8700 1 -- 172.21.15.42:0/322212310 >> v1:172.21.15.84:6789/0 conn(0x7f13200ab230 legacy=0x7f1320131ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:28.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.911+0000 7f13259b8700 1 -- 172.21.15.42:0/322212310 >> v1:172.21.15.42:6789/0 conn(0x7f1320148da0 legacy=0x7f13200614a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:28.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.911+0000 7f13127fc700 1 -- 172.21.15.42:0/322212310 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2279168361 0 0) 0x7f1308003230 con 0x7f1320148da0 2020-04-02T23:24:28.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.912+0000 7f13259b8700 1 -- 172.21.15.42:0/322212310 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1320066e10 con 0x7f132007fa80 2020-04-02T23:24:28.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.912+0000 7f13259b8700 1 --2- 172.21.15.42:0/322212310 >> v2:172.21.15.84:3300/0 conn(0x7f132007fa80 0x7f1320064220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1318010dd0 tx=0x7f13200680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.912+0000 7f13259b8700 1 --2- 172.21.15.42:0/322212310 >> v2:172.21.15.84:3300/0 conn(0x7f132007fa80 0x7f1320064220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1318010dd0 tx=0x7f13200680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.912+0000 7f13259b8700 1 --2- 172.21.15.42:0/322212310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f132007fa80 0x7f1320064220 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7f1318010dd0 tx=0x7f13200680a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:28.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.912+0000 7f13259b8700 1 --2- 172.21.15.42:0/322212310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f132007fa80 0x7f1320064220 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f1318010dd0 tx=0x7f13200680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.912+0000 7f13127fc700 1 -- 172.21.15.42:0/322212310 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1318010c30 con 0x7f132007fa80 2020-04-02T23:24:28.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.912+0000 7f13259b8700 1 --2- 172.21.15.42:0/322212310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f132007fa80 0x7f1320064220 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f1318010dd0 tx=0x7f13200680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.912+0000 7f13127fc700 1 -- 172.21.15.42:0/322212310 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131c00c7f0 con 0x7f132007fa80 2020-04-02T23:24:28.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.912+0000 7f13259b8700 1 --2- 172.21.15.42:0/322212310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f132007fa80 0x7f1320064220 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f1318010dd0 tx=0x7f13200680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.912+0000 7f132741b700 1 -- 172.21.15.42:0/322212310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1320062290 con 0x7f132007fa80 2020-04-02T23:24:28.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.912+0000 7f13127fc700 1 -- 172.21.15.42:0/322212310 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f131c00cb90 con 0x7f132007fa80 2020-04-02T23:24:28.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.912+0000 7f132741b700 1 -- 172.21.15.42:0/322212310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13200a4b40 con 0x7f132007fa80 2020-04-02T23:24:28.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.912+0000 7f13259b8700 1 --2- 172.21.15.42:0/322212310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f132007fa80 0x7f1320064220 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f1318010dd0 tx=0x7f13200680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.913+0000 7f13127fc700 1 -- 172.21.15.42:0/322212310 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 3) v1 ==== 59405+0+0 (secure 0 0 0) 0x7f131c0054b0 con 0x7f132007fa80 2020-04-02T23:24:28.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.913+0000 7f13259b8700 1 --2- 172.21.15.42:0/322212310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f132007fa80 0x7f1320064220 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f1318010dd0 tx=0x7f13200680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.913+0000 7f13127fc700 1 --2- 172.21.15.42:0/322212310 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f130804d7a0 0x7f130804fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:28.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.913+0000 7f132741b700 1 -- 172.21.15.42:0/322212310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1320056c50 con 0x7f132007fa80 2020-04-02T23:24:28.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.913+0000 7f13127fc700 1 -- 172.21.15.42:0/322212310 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1269+0+0 (secure 0 0 0) 0x7f131c060770 con 0x7f132007fa80 2020-04-02T23:24:28.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.913+0000 7f13251b7700 1 --2- 172.21.15.42:0/322212310 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f130804d7a0 0x7f130804fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:28.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.914+0000 7f13251b7700 1 --2- 172.21.15.42:0/322212310 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f130804d7a0 0x7f130804fc60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f13200a2fd0 tx=0x7f131400c9a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.932 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.914+0000 7f13251b7700 1 --2- 172.21.15.42:0/322212310 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f130804d7a0 0x7f130804fc60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f13200a2fd0 tx=0x7f131400c9a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.932 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.914+0000 7f13251b7700 1 --2- 172.21.15.42:0/322212310 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f130804d7a0 0x7f130804fc60 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f13200a2fd0 tx=0x7f131400c9a0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:28.933 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.917+0000 7f13259b8700 1 --2- 172.21.15.42:0/322212310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f132007fa80 0x7f1320064220 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f1318010dd0 tx=0x7f13200680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:28.933 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:28.917+0000 7f13127fc700 1 -- 172.21.15.42:0/322212310 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f131c03bed0 con 0x7f132007fa80 2020-04-02T23:24:29.084 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.082+0000 7f132741b700 1 -- 172.21.15.42:0/322212310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd new", "uuid": "22c1e489-ab99-4205-ba9d-fbfc144d2a8d", "id": 1} v 0) v1 -- 0x7f13200a55a0 con 0x7f132007fa80 2020-04-02T23:24:29.088 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.086+0000 7f13259b8700 1 --2- 172.21.15.42:0/322212310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f132007fa80 0x7f1320064220 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f1318010dd0 tx=0x7f13200680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.088 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.086+0000 7f13127fc700 1 -- 172.21.15.42:0/322212310 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "22c1e489-ab99-4205-ba9d-fbfc144d2a8d", "id": 1}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f131c0100b0 con 0x7f132007fa80 2020-04-02T23:24:29.088 INFO:teuthology.orchestra.run.smithi042.stdout:1 2020-04-02T23:24:29.090 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.087+0000 7f132741b700 1 -- 172.21.15.42:0/322212310 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f130804d7a0 msgr2=0x7f130804fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:29.090 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.087+0000 7f132741b700 1 --2- 172.21.15.42:0/322212310 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f130804d7a0 0x7f130804fc60 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f13200a2fd0 tx=0x7f131400c9a0).stop 2020-04-02T23:24:29.090 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.087+0000 7f132741b700 1 -- 172.21.15.42:0/322212310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f132007fa80 msgr2=0x7f1320064220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:29.090 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.087+0000 7f132741b700 1 --2- 172.21.15.42:0/322212310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f132007fa80 0x7f1320064220 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7f1318010dd0 tx=0x7f13200680a0).stop 2020-04-02T23:24:29.090 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.088+0000 7f132741b700 1 -- 172.21.15.42:0/322212310 shutdown_connections 2020-04-02T23:24:29.091 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.088+0000 7f132741b700 1 --2- 172.21.15.42:0/322212310 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f130804d7a0 0x7f130804fc60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:29.091 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.088+0000 7f132741b700 1 --2- 172.21.15.42:0/322212310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f132007fa80 0x7f1320064220 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:29.091 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.088+0000 7f132741b700 1 -- 172.21.15.42:0/322212310 >> 172.21.15.42:0/322212310 conn(0x7f132009dc40 msgr2=0x7f1320069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:29.091 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.088+0000 7f132741b700 1 -- 172.21.15.42:0/322212310 shutdown_connections 2020-04-02T23:24:29.091 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.088+0000 7f132741b700 1 -- 172.21.15.42:0/322212310 wait complete. 2020-04-02T23:24:29.100 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:29.113 INFO:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new f0b18b09-93c0-4286-8d15-746611ba53cd 2 2020-04-02T23:24:29.272 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.263+0000 7fb1413d2700 1 Processor -- start 2020-04-02T23:24:29.272 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.263+0000 7fb1413d2700 1 -- start start 2020-04-02T23:24:29.272 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.263+0000 7fb1413d2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb13c148da0 0x7fb13c0a3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:29.275 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.263+0000 7fb1413d2700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb13c07fa80 0x7fb13c07ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:29.275 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.263+0000 7fb1413d2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb13c0a55c0 con 0x7fb13c0ab230 2020-04-02T23:24:29.275 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.263+0000 7fb1413d2700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13c0a68c0 con 0x7fb13c07fa80 2020-04-02T23:24:29.276 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.263+0000 7fb1413d2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13c0a6b60 con 0x7fb13c148da0 2020-04-02T23:24:29.276 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.263+0000 7fb13bfff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb13c07fa80 0x7fb13c07ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:29.276 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.263+0000 7fb13bfff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb13c07fa80 0x7fb13c07ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39268/0 (socket says 172.21.15.42:39268) 2020-04-02T23:24:29.276 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.263+0000 7fb13bfff700 1 -- 172.21.15.42:0/1732422131 learned_addr learned my addr 172.21.15.42:0/1732422131 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:29.276 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.264+0000 7fb13affd700 1 --2- 172.21.15.42:0/1732422131 >> v2:172.21.15.84:3300/0 conn(0x7fb13c148da0 0x7fb13c0a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:29.276 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.264+0000 7fb13bfff700 1 -- 172.21.15.42:0/1732422131 >> v2:172.21.15.84:3300/0 conn(0x7fb13c148da0 msgr2=0x7fb13c0a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:29.277 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.264+0000 7fb13bfff700 1 --2- 172.21.15.42:0/1732422131 >> v2:172.21.15.84:3300/0 conn(0x7fb13c148da0 0x7fb13c0a3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:29.277 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.264+0000 7fb13bfff700 1 -- 172.21.15.42:0/1732422131 >> v1:172.21.15.84:6789/0 conn(0x7fb13c0ab230 legacy=0x7fb13c148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:29.277 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.264+0000 7fb13bfff700 1 -- 172.21.15.42:0/1732422131 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c0a6380 con 0x7fb13c07fa80 2020-04-02T23:24:29.277 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.264+0000 7fb13bfff700 1 --2- 172.21.15.42:0/1732422131 >> v2:172.21.15.42:3300/0 conn(0x7fb13c07fa80 0x7fb13c07ff00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb1340032b0 tx=0x7fb134007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.277 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.264+0000 7fb13bfff700 1 --2- 172.21.15.42:0/1732422131 >> v2:172.21.15.42:3300/0 conn(0x7fb13c07fa80 0x7fb13c07ff00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb1340032b0 tx=0x7fb134007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.277 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.264+0000 7fb13bfff700 1 --2- 172.21.15.42:0/1732422131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb13c07fa80 0x7fb13c07ff00 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7fb1340032b0 tx=0x7fb134007dc0).ready entity=mon.0 client_cookie=e51dffa914831f01 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:29.277 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.264+0000 7fb13bfff700 1 --2- 172.21.15.42:0/1732422131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb13c07fa80 0x7fb13c07ff00 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fb1340032b0 tx=0x7fb134007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.278 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.264+0000 7fb13a7fc700 1 -- 172.21.15.42:0/1732422131 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb13400a160 con 0x7fb13c07fa80 2020-04-02T23:24:29.278 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.264+0000 7fb13bfff700 1 --2- 172.21.15.42:0/1732422131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb13c07fa80 0x7fb13c07ff00 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fb1340032b0 tx=0x7fb134007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.278 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.264+0000 7fb13bfff700 1 --2- 172.21.15.42:0/1732422131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb13c07fa80 0x7fb13c07ff00 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fb1340032b0 tx=0x7fb134007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.278 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.264+0000 7fb13a7fc700 1 -- 172.21.15.42:0/1732422131 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13400a2c0 con 0x7fb13c07fa80 2020-04-02T23:24:29.279 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.264+0000 7fb13a7fc700 1 -- 172.21.15.42:0/1732422131 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb13400a6e0 con 0x7fb13c07fa80 2020-04-02T23:24:29.280 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.264+0000 7fb1413d2700 1 -- 172.21.15.42:0/1732422131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb13c07fa80 msgr2=0x7fb13c07ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:29.280 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.264+0000 7fb1413d2700 1 --2- 172.21.15.42:0/1732422131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb13c07fa80 0x7fb13c07ff00 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7fb1340032b0 tx=0x7fb134007dc0).stop 2020-04-02T23:24:29.280 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.265+0000 7fb1413d2700 1 -- 172.21.15.42:0/1732422131 shutdown_connections 2020-04-02T23:24:29.280 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.265+0000 7fb1413d2700 1 --2- 172.21.15.42:0/1732422131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb13c07fa80 0x7fb13c07ff00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:29.280 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.265+0000 7fb1413d2700 1 --2- 172.21.15.42:0/1732422131 >> v2:172.21.15.84:3300/0 conn(0x7fb13c148da0 0x7fb13c0a3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:29.280 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.265+0000 7fb1413d2700 1 -- 172.21.15.42:0/1732422131 >> 172.21.15.42:0/1732422131 conn(0x7fb13c09dc40 msgr2=0x7fb13c0aa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:29.281 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.265+0000 7fb1413d2700 1 -- 172.21.15.42:0/1732422131 shutdown_connections 2020-04-02T23:24:29.281 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.265+0000 7fb1413d2700 1 -- 172.21.15.42:0/1732422131 wait complete. 2020-04-02T23:24:29.282 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.266+0000 7fb1413d2700 1 Processor -- start 2020-04-02T23:24:29.282 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.266+0000 7fb1413d2700 1 -- start start 2020-04-02T23:24:29.282 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.266+0000 7fb1413d2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb13c0ab230 0x7fb13c061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:29.282 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.266+0000 7fb1413d2700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb13c061aa0 con 0x7fb13c148da0 2020-04-02T23:24:29.282 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.266+0000 7fb1413d2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb13c0a0aa0 con 0x7fb13c07fa80 2020-04-02T23:24:29.282 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.266+0000 7fb1413d2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13c0a0d40 con 0x7fb13c0ab230 2020-04-02T23:24:29.283 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.267+0000 7fb13bfff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb13c148da0 0x7fb13c09f9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:58702/0 (socket says 172.21.15.42:58702) 2020-04-02T23:24:29.283 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.267+0000 7fb13bfff700 1 -- 172.21.15.42:0/2443796088 learned_addr learned my addr 172.21.15.42:0/2443796088 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:29.283 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.267+0000 7fb13affd700 1 --2- 172.21.15.42:0/2443796088 >> v2:172.21.15.84:3300/0 conn(0x7fb13c0ab230 0x7fb13c061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:29.283 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.267+0000 7fb123fff700 1 -- 172.21.15.42:0/2443796088 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957642137 0 0) 0x7fb13c061aa0 con 0x7fb13c148da0 2020-04-02T23:24:29.283 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.267+0000 7fb123fff700 1 -- 172.21.15.42:0/2443796088 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb11c003230 con 0x7fb13c148da0 2020-04-02T23:24:29.283 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.267+0000 7fb13affd700 1 -- 172.21.15.42:0/2443796088 >> v1:172.21.15.84:6789/0 conn(0x7fb13c07fa80 legacy=0x7fb13c130470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:29.283 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.267+0000 7fb13affd700 1 -- 172.21.15.42:0/2443796088 >> v1:172.21.15.42:6789/0 conn(0x7fb13c148da0 legacy=0x7fb13c09f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:29.284 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.267+0000 7fb123fff700 1 -- 172.21.15.42:0/2443796088 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965827496 0 0) 0x7fb13c0a0aa0 con 0x7fb13c07fa80 2020-04-02T23:24:29.284 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.267+0000 7fb13affd700 1 -- 172.21.15.42:0/2443796088 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c0a0fe0 con 0x7fb13c0ab230 2020-04-02T23:24:29.284 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.267+0000 7fb13affd700 1 --2- 172.21.15.42:0/2443796088 >> v2:172.21.15.84:3300/0 conn(0x7fb13c0ab230 0x7fb13c061640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb134011f40 tx=0x7fb12c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.284 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.267+0000 7fb13affd700 1 --2- 172.21.15.42:0/2443796088 >> v2:172.21.15.84:3300/0 conn(0x7fb13c0ab230 0x7fb13c061640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb134011f40 tx=0x7fb12c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.285 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.267+0000 7fb13affd700 1 --2- 172.21.15.42:0/2443796088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb13c0ab230 0x7fb13c061640 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7fb134011f40 tx=0x7fb12c010b80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:29.285 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.267+0000 7fb13affd700 1 --2- 172.21.15.42:0/2443796088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb13c0ab230 0x7fb13c061640 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fb134011f40 tx=0x7fb12c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.285 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.267+0000 7fb123fff700 1 -- 172.21.15.42:0/2443796088 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb134011da0 con 0x7fb13c0ab230 2020-04-02T23:24:29.285 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.267+0000 7fb13affd700 1 --2- 172.21.15.42:0/2443796088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb13c0ab230 0x7fb13c061640 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fb134011f40 tx=0x7fb12c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.286 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.267+0000 7fb13affd700 1 --2- 172.21.15.42:0/2443796088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb13c0ab230 0x7fb13c061640 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fb134011f40 tx=0x7fb12c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.286 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.267+0000 7fb123fff700 1 -- 172.21.15.42:0/2443796088 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c005ca0 con 0x7fb13c0ab230 2020-04-02T23:24:29.286 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.267+0000 7fb1413d2700 1 -- 172.21.15.42:0/2443796088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13c0a1480 con 0x7fb13c0ab230 2020-04-02T23:24:29.286 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.267+0000 7fb123fff700 1 -- 172.21.15.42:0/2443796088 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb12c007160 con 0x7fb13c0ab230 2020-04-02T23:24:29.286 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.267+0000 7fb1413d2700 1 -- 172.21.15.42:0/2443796088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13c066e30 con 0x7fb13c0ab230 2020-04-02T23:24:29.286 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.268+0000 7fb13affd700 1 --2- 172.21.15.42:0/2443796088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb13c0ab230 0x7fb13c061640 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fb134011f40 tx=0x7fb12c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.286 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.268+0000 7fb1413d2700 1 -- 172.21.15.42:0/2443796088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb13c0a1170 con 0x7fb13c0ab230 2020-04-02T23:24:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.269+0000 7fb123fff700 1 -- 172.21.15.42:0/2443796088 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 3) v1 ==== 59405+0+0 (secure 0 0 0) 0x7fb12c007360 con 0x7fb13c0ab230 2020-04-02T23:24:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.269+0000 7fb13affd700 1 --2- 172.21.15.42:0/2443796088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb13c0ab230 0x7fb13c061640 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fb134011f40 tx=0x7fb12c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.269+0000 7fb123fff700 1 --2- 172.21.15.42:0/2443796088 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb11c04f990 0x7fb11c051e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.269+0000 7fb123fff700 1 -- 172.21.15.42:0/2443796088 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1384+0+0 (secure 0 0 0) 0x7fb12c060b60 con 0x7fb13c0ab230 2020-04-02T23:24:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.269+0000 7fb13b7fe700 1 --2- 172.21.15.42:0/2443796088 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb11c04f990 0x7fb11c051e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.269+0000 7fb13b7fe700 1 --2- 172.21.15.42:0/2443796088 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb11c04f990 0x7fb11c051e50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb1300021c0 tx=0x7fb13c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.269+0000 7fb13b7fe700 1 --2- 172.21.15.42:0/2443796088 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb11c04f990 0x7fb11c051e50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb1300021c0 tx=0x7fb13c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.287 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.269+0000 7fb13b7fe700 1 --2- 172.21.15.42:0/2443796088 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb11c04f990 0x7fb11c051e50 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7fb1300021c0 tx=0x7fb13c0680a0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:29.288 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.273+0000 7fb13affd700 1 --2- 172.21.15.42:0/2443796088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb13c0ab230 0x7fb13c061640 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fb134011f40 tx=0x7fb12c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.288 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.273+0000 7fb123fff700 1 -- 172.21.15.42:0/2443796088 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fb12c032da0 con 0x7fb13c0ab230 2020-04-02T23:24:29.437 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.435+0000 7fb1413d2700 1 -- 172.21.15.42:0/2443796088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f0b18b09-93c0-4286-8d15-746611ba53cd", "id": 2} v 0) v1 -- 0x7fb13c056c50 con 0x7fb13c0ab230 2020-04-02T23:24:29.442 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.439+0000 7fb13affd700 1 --2- 172.21.15.42:0/2443796088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb13c0ab230 0x7fb13c061640 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fb134011f40 tx=0x7fb12c010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.442 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.439+0000 7fb123fff700 1 -- 172.21.15.42:0/2443796088 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f0b18b09-93c0-4286-8d15-746611ba53cd", "id": 2}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb12c00a0f0 con 0x7fb13c0ab230 2020-04-02T23:24:29.442 INFO:teuthology.orchestra.run.smithi042.stdout:2 2020-04-02T23:24:29.443 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.441+0000 7fb1413d2700 1 -- 172.21.15.42:0/2443796088 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb11c04f990 msgr2=0x7fb11c051e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:29.444 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.441+0000 7fb1413d2700 1 --2- 172.21.15.42:0/2443796088 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb11c04f990 0x7fb11c051e50 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7fb1300021c0 tx=0x7fb13c0680a0).stop 2020-04-02T23:24:29.444 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.441+0000 7fb1413d2700 1 -- 172.21.15.42:0/2443796088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb13c0ab230 msgr2=0x7fb13c061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:29.444 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.441+0000 7fb1413d2700 1 --2- 172.21.15.42:0/2443796088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb13c0ab230 0x7fb13c061640 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7fb134011f40 tx=0x7fb12c010b80).stop 2020-04-02T23:24:29.444 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.441+0000 7fb1413d2700 1 -- 172.21.15.42:0/2443796088 shutdown_connections 2020-04-02T23:24:29.444 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.441+0000 7fb1413d2700 1 --2- 172.21.15.42:0/2443796088 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb11c04f990 0x7fb11c051e50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:29.444 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.441+0000 7fb1413d2700 1 --2- 172.21.15.42:0/2443796088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb13c0ab230 0x7fb13c061640 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:29.445 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.441+0000 7fb1413d2700 1 -- 172.21.15.42:0/2443796088 >> 172.21.15.42:0/2443796088 conn(0x7fb13c09dc40 msgr2=0x7fb13c0a7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:29.445 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.441+0000 7fb1413d2700 1 -- 172.21.15.42:0/2443796088 shutdown_connections 2020-04-02T23:24:29.445 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.441+0000 7fb1413d2700 1 -- 172.21.15.42:0/2443796088 wait complete. 2020-04-02T23:24:29.453 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:29.467 INFO:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 989d4a69-9abe-44de-95f2-6c7cbbe07471 3 2020-04-02T23:24:29.625 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.616+0000 7f11d016c700 1 Processor -- start 2020-04-02T23:24:29.626 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.616+0000 7f11d016c700 1 -- start start 2020-04-02T23:24:29.626 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.617+0000 7f11d016c700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f11c8148da0 0x7f11c80a3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:29.626 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.617+0000 7f11d016c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f11c807fa80 0x7f11c807fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:29.626 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.617+0000 7f11d016c700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c80a55c0 con 0x7f11c80ab230 2020-04-02T23:24:29.626 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.617+0000 7f11d016c700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c80a68c0 con 0x7f11c807fa80 2020-04-02T23:24:29.626 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.617+0000 7f11d016c700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c80a6b60 con 0x7f11c8148da0 2020-04-02T23:24:29.627 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.617+0000 7f11cef0a700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f11c807fa80 0x7f11c807fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:29.627 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.617+0000 7f11cef0a700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f11c807fa80 0x7f11c807fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39282/0 (socket says 172.21.15.42:39282) 2020-04-02T23:24:29.627 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.617+0000 7f11ce709700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f11c80ab230 0x7f11c8148690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:58706/0 (socket says 172.21.15.42:58706) 2020-04-02T23:24:29.627 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.617+0000 7f11cef0a700 1 -- 172.21.15.42:0/3468961818 learned_addr learned my addr 172.21.15.42:0/3468961818 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:29.627 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.617+0000 7f11cdf08700 1 --2- 172.21.15.42:0/3468961818 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f11c8148da0 0x7f11c80a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:29.631 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.617+0000 7f11cef0a700 1 -- 172.21.15.42:0/3468961818 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f11c8148da0 msgr2=0x7f11c80a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:29.631 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.617+0000 7f11cef0a700 1 --2- 172.21.15.42:0/3468961818 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f11c8148da0 0x7f11c80a3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:29.631 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.617+0000 7f11cef0a700 1 -- 172.21.15.42:0/3468961818 >> v1:172.21.15.42:6789/0 conn(0x7f11c80ab230 legacy=0x7f11c8148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:29.631 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.617+0000 7f11cef0a700 1 -- 172.21.15.42:0/3468961818 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c80a6380 con 0x7f11c807fa80 2020-04-02T23:24:29.631 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.617+0000 7f11cd707700 1 -- 172.21.15.42:0/3468961818 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463961327 0 0) 0x7f11c80a55c0 con 0x7f11c80ab230 2020-04-02T23:24:29.631 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.617+0000 7f11cef0a700 1 --2- 172.21.15.42:0/3468961818 >> v2:172.21.15.42:3300/0 conn(0x7f11c807fa80 0x7f11c807fef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f11c00032b0 tx=0x7f11c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.632 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.618+0000 7f11cef0a700 1 --2- 172.21.15.42:0/3468961818 >> v2:172.21.15.42:3300/0 conn(0x7f11c807fa80 0x7f11c807fef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f11c00032b0 tx=0x7f11c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.632 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.618+0000 7f11cef0a700 1 --2- 172.21.15.42:0/3468961818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c807fa80 0x7f11c807fef0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f11c00032b0 tx=0x7f11c0007dc0).ready entity=mon.0 client_cookie=3201bbc0d794bf62 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:29.632 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.618+0000 7f11cef0a700 1 --2- 172.21.15.42:0/3468961818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c807fa80 0x7f11c807fef0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f11c00032b0 tx=0x7f11c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.632 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.618+0000 7f11cd707700 1 -- 172.21.15.42:0/3468961818 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11c000a160 con 0x7f11c807fa80 2020-04-02T23:24:29.632 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.618+0000 7f11cef0a700 1 --2- 172.21.15.42:0/3468961818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c807fa80 0x7f11c807fef0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f11c00032b0 tx=0x7f11c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.632 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.618+0000 7f11cd707700 1 -- 172.21.15.42:0/3468961818 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c000a2c0 con 0x7f11c807fa80 2020-04-02T23:24:29.633 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.618+0000 7f11cef0a700 1 --2- 172.21.15.42:0/3468961818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c807fa80 0x7f11c807fef0 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f11c00032b0 tx=0x7f11c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.633 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.618+0000 7f11cd707700 1 -- 172.21.15.42:0/3468961818 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11c000a6a0 con 0x7f11c807fa80 2020-04-02T23:24:29.633 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.618+0000 7f11d016c700 1 -- 172.21.15.42:0/3468961818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c807fa80 msgr2=0x7f11c807fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:29.633 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.618+0000 7f11d016c700 1 --2- 172.21.15.42:0/3468961818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c807fa80 0x7f11c807fef0 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f11c00032b0 tx=0x7f11c0007dc0).stop 2020-04-02T23:24:29.633 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.618+0000 7f11d016c700 1 -- 172.21.15.42:0/3468961818 shutdown_connections 2020-04-02T23:24:29.633 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.618+0000 7f11d016c700 1 --2- 172.21.15.42:0/3468961818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c807fa80 0x7f11c807fef0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:29.633 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.618+0000 7f11d016c700 1 --2- 172.21.15.42:0/3468961818 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f11c8148da0 0x7f11c80a3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:29.634 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.618+0000 7f11d016c700 1 -- 172.21.15.42:0/3468961818 >> 172.21.15.42:0/3468961818 conn(0x7f11c809dc40 msgr2=0x7f11c80aa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:29.634 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.618+0000 7f11d016c700 1 -- 172.21.15.42:0/3468961818 shutdown_connections 2020-04-02T23:24:29.634 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.618+0000 7f11d016c700 1 -- 172.21.15.42:0/3468961818 wait complete. 2020-04-02T23:24:29.634 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.619+0000 7f11d016c700 1 Processor -- start 2020-04-02T23:24:29.634 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.619+0000 7f11d016c700 1 -- start start 2020-04-02T23:24:29.634 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.620+0000 7f11d016c700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f11c807fa80 0x7f11c81344d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:29.634 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.620+0000 7f11d016c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f11c8148da0 0x7f11c8134930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:29.635 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.620+0000 7f11d016c700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c8133d90 con 0x7f11c80ab230 2020-04-02T23:24:29.635 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.620+0000 7f11d016c700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c8134030 con 0x7f11c8148da0 2020-04-02T23:24:29.635 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.620+0000 7f11d016c700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c8137e40 con 0x7f11c807fa80 2020-04-02T23:24:29.635 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.620+0000 7f11cef0a700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f11c8148da0 0x7f11c8134930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:29.635 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.620+0000 7f11cdf08700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f11c80ab230 0x7f11c8137730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:58714/0 (socket says 172.21.15.42:58714) 2020-04-02T23:24:29.635 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.620+0000 7f11cdf08700 1 -- 172.21.15.42:0/321557605 learned_addr learned my addr 172.21.15.42:0/321557605 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:29.635 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.620+0000 7f11ce709700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f11c807fa80 0x7f11c81344d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:29.636 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.620+0000 7f11cef0a700 1 -- 172.21.15.42:0/321557605 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f11c807fa80 msgr2=0x7f11c81344d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:29.636 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.620+0000 7f11cef0a700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f11c807fa80 0x7f11c81344d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:29.636 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.620+0000 7f11cef0a700 1 -- 172.21.15.42:0/321557605 >> v1:172.21.15.42:6789/0 conn(0x7f11c80ab230 legacy=0x7f11c8137730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:29.636 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.620+0000 7f11beffd700 1 -- 172.21.15.42:0/321557605 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300847493 0 0) 0x7f11c8133d90 con 0x7f11c80ab230 2020-04-02T23:24:29.636 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.620+0000 7f11cef0a700 1 -- 172.21.15.42:0/321557605 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c80a3bd0 con 0x7f11c8148da0 2020-04-02T23:24:29.653 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.620+0000 7f11ce709700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f11c807fa80 0x7f11c81344d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:24:29.653 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.620+0000 7f11cef0a700 1 --2- 172.21.15.42:0/321557605 >> v2:172.21.15.42:3300/0 conn(0x7f11c8148da0 0x7f11c8134930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f11c00032b0 tx=0x7f11c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.653 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.620+0000 7f11cef0a700 1 --2- 172.21.15.42:0/321557605 >> v2:172.21.15.42:3300/0 conn(0x7f11c8148da0 0x7f11c8134930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f11c00032b0 tx=0x7f11c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.653 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.620+0000 7f11cef0a700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c8148da0 0x7f11c8134930 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f11c00032b0 tx=0x7f11c0007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:29.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.621+0000 7f11cef0a700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c8148da0 0x7f11c8134930 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f11c00032b0 tx=0x7f11c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.621+0000 7f11beffd700 1 -- 172.21.15.42:0/321557605 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11c0005c30 con 0x7f11c8148da0 2020-04-02T23:24:29.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.621+0000 7f11cef0a700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c8148da0 0x7f11c8134930 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f11c00032b0 tx=0x7f11c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.621+0000 7f11cef0a700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c8148da0 0x7f11c8134930 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f11c00032b0 tx=0x7f11c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.621+0000 7f11beffd700 1 -- 172.21.15.42:0/321557605 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c0005d90 con 0x7f11c8148da0 2020-04-02T23:24:29.655 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.621+0000 7f11d016c700 1 -- 172.21.15.42:0/321557605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c80653e0 con 0x7f11c8148da0 2020-04-02T23:24:29.655 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.621+0000 7f11beffd700 1 -- 172.21.15.42:0/321557605 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11c0007340 con 0x7f11c8148da0 2020-04-02T23:24:29.655 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.621+0000 7f11d016c700 1 -- 172.21.15.42:0/321557605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c80aa890 con 0x7f11c8148da0 2020-04-02T23:24:29.655 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.621+0000 7f11cef0a700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c8148da0 0x7f11c8134930 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f11c00032b0 tx=0x7f11c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.656 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.622+0000 7f11d016c700 1 -- 172.21.15.42:0/321557605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c8056c50 con 0x7f11c8148da0 2020-04-02T23:24:29.656 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.622+0000 7f11beffd700 1 -- 172.21.15.42:0/321557605 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 3) v1 ==== 59405+0+0 (secure 0 0 0) 0x7f11c00074a0 con 0x7f11c8148da0 2020-04-02T23:24:29.656 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.622+0000 7f11cef0a700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c8148da0 0x7f11c8134930 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f11c00032b0 tx=0x7f11c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.656 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.622+0000 7f11beffd700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f11b004d3a0 0x7f11b004f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:29.656 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.622+0000 7f11beffd700 1 -- 172.21.15.42:0/321557605 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1499+0+0 (secure 0 0 0) 0x7f11c0061b20 con 0x7f11c8148da0 2020-04-02T23:24:29.656 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.622+0000 7f11ce709700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f11b004d3a0 0x7f11b004f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:29.656 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.623+0000 7f11ce709700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f11b004d3a0 0x7f11b004f860 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f11c4000b80 tx=0x7f11c80680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.657 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.623+0000 7f11ce709700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f11b004d3a0 0x7f11b004f860 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f11c4000b80 tx=0x7f11c80680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.657 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.623+0000 7f11ce709700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f11b004d3a0 0x7f11b004f860 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7f11c4000b80 tx=0x7f11c80680a0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:29.657 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.626+0000 7f11cef0a700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c8148da0 0x7f11c8134930 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f11c00032b0 tx=0x7f11c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.657 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.626+0000 7f11beffd700 1 -- 172.21.15.42:0/321557605 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f11c003d420 con 0x7f11c8148da0 2020-04-02T23:24:29.791 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.789+0000 7f11d016c700 1 -- 172.21.15.42:0/321557605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd new", "uuid": "989d4a69-9abe-44de-95f2-6c7cbbe07471", "id": 3} v 0) v1 -- 0x7f11c8134170 con 0x7f11c8148da0 2020-04-02T23:24:29.794 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.792+0000 7f11cef0a700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c8148da0 0x7f11c8134930 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f11c00032b0 tx=0x7f11c0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.795 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.792+0000 7f11beffd700 1 -- 172.21.15.42:0/321557605 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "989d4a69-9abe-44de-95f2-6c7cbbe07471", "id": 3}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f11c0040a40 con 0x7f11c8148da0 2020-04-02T23:24:29.795 INFO:teuthology.orchestra.run.smithi042.stdout:3 2020-04-02T23:24:29.796 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.794+0000 7f11d016c700 1 -- 172.21.15.42:0/321557605 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f11b004d3a0 msgr2=0x7f11b004f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:29.797 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.794+0000 7f11d016c700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f11b004d3a0 0x7f11b004f860 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7f11c4000b80 tx=0x7f11c80680a0).stop 2020-04-02T23:24:29.797 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.794+0000 7f11d016c700 1 -- 172.21.15.42:0/321557605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c8148da0 msgr2=0x7f11c8134930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:29.797 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.794+0000 7f11d016c700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c8148da0 0x7f11c8134930 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f11c00032b0 tx=0x7f11c0007dc0).stop 2020-04-02T23:24:29.797 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.794+0000 7f11d016c700 1 -- 172.21.15.42:0/321557605 shutdown_connections 2020-04-02T23:24:29.797 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.794+0000 7f11d016c700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11c8148da0 0x7f11c8134930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:29.797 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.794+0000 7f11d016c700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f11b004d3a0 0x7f11b004f860 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:29.797 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.794+0000 7f11d016c700 1 --2- 172.21.15.42:0/321557605 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f11c807fa80 0x7f11c81344d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:29.798 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.794+0000 7f11d016c700 1 -- 172.21.15.42:0/321557605 >> 172.21.15.42:0/321557605 conn(0x7f11c809dc40 msgr2=0x7f11c807fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:29.798 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.794+0000 7f11d016c700 1 -- 172.21.15.42:0/321557605 shutdown_connections 2020-04-02T23:24:29.798 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.794+0000 7f11d016c700 1 -- 172.21.15.42:0/321557605 wait complete. 2020-04-02T23:24:29.806 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:29.820 INFO:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new b1a2ce60-ae80-4f8a-97a3-4fbb1399fdfe 4 2020-04-02T23:24:29.975 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.969+0000 7f52d0c05700 1 Processor -- start 2020-04-02T23:24:29.975 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.969+0000 7f52d0c05700 1 -- start start 2020-04-02T23:24:29.975 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.970+0000 7f52d0c05700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f52cc148da0 0x7f52cc0a3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:29.975 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.970+0000 7f52d0c05700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52cc07fa80 0x7f52cc07ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:29.975 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.970+0000 7f52d0c05700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52cc0a55c0 con 0x7f52cc0ab230 2020-04-02T23:24:29.975 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.970+0000 7f52d0c05700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52cc0a68c0 con 0x7f52cc148da0 2020-04-02T23:24:29.976 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.970+0000 7f52d0c05700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc0a6b60 con 0x7f52cc07fa80 2020-04-02T23:24:29.976 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.970+0000 7f52cb59e700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52cc07fa80 0x7f52cc07ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:29.976 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.970+0000 7f52ca59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f52cc148da0 0x7f52cc0a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:29.976 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.970+0000 7f52cb59e700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52cc07fa80 0x7f52cc07ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.42:59050/0 (socket says 172.21.15.42:59050) 2020-04-02T23:24:29.976 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.970+0000 7f52ca59c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f52cc148da0 0x7f52cc0a3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.42:33786/0 (socket says 172.21.15.42:33786) 2020-04-02T23:24:29.976 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.970+0000 7f52cb59e700 1 -- 172.21.15.42:0/3489015893 learned_addr learned my addr 172.21.15.42:0/3489015893 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:29.976 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.970+0000 7f52cad9d700 1 --1- 172.21.15.42:0/3489015893 >> v1:172.21.15.84:6789/0 conn(0x7f52cc0ab230 0x7f52cc148690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:53096/0 (socket says 172.21.15.42:53096) 2020-04-02T23:24:29.977 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.970+0000 7f52cb59e700 1 -- 172.21.15.42:0/3489015893 >> v2:172.21.15.84:3300/0 conn(0x7f52cc148da0 msgr2=0x7f52cc0a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:29.977 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.970+0000 7f52cb59e700 1 --2- 172.21.15.42:0/3489015893 >> v2:172.21.15.84:3300/0 conn(0x7f52cc148da0 0x7f52cc0a3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:29.977 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.970+0000 7f52cb59e700 1 -- 172.21.15.42:0/3489015893 >> v1:172.21.15.84:6789/0 conn(0x7f52cc0ab230 legacy=0x7f52cc148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:29.977 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.970+0000 7f52cb59e700 1 -- 172.21.15.42:0/3489015893 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc0a6380 con 0x7f52cc07fa80 2020-04-02T23:24:29.977 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.970+0000 7f52ca59c700 1 --2- 172.21.15.42:0/3489015893 >> v2:172.21.15.84:3300/0 conn(0x7f52cc148da0 0x7f52cc0a3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:29.977 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.971+0000 7f52cb59e700 1 --2- 172.21.15.42:0/3489015893 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52cc07fa80 0x7f52cc07ff30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f52c40032b0 tx=0x7f52c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.977 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.971+0000 7f52cb59e700 1 --2- 172.21.15.42:0/3489015893 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52cc07fa80 0x7f52cc07ff30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f52c40032b0 tx=0x7f52c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.978 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.971+0000 7f52cb59e700 1 --2- 172.21.15.42:0/3489015893 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52cc07fa80 0x7f52cc07ff30 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7f52c40032b0 tx=0x7f52c4007dc0).ready entity=mon.2 client_cookie=fd8dc58f57176033 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:29.978 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.971+0000 7f52cb59e700 1 --2- 172.21.15.42:0/3489015893 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52cc07fa80 0x7f52cc07ff30 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f52c40032b0 tx=0x7f52c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.978 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.971+0000 7f52cb59e700 1 --2- 172.21.15.42:0/3489015893 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52cc07fa80 0x7f52cc07ff30 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f52c40032b0 tx=0x7f52c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.978 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.971+0000 7f52c9d9b700 1 -- 172.21.15.42:0/3489015893 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c400a160 con 0x7f52cc07fa80 2020-04-02T23:24:29.978 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.971+0000 7f52cb59e700 1 --2- 172.21.15.42:0/3489015893 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52cc07fa80 0x7f52cc07ff30 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f52c40032b0 tx=0x7f52c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.978 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.971+0000 7f52c9d9b700 1 -- 172.21.15.42:0/3489015893 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c400a2c0 con 0x7f52cc07fa80 2020-04-02T23:24:29.978 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.971+0000 7f52c9d9b700 1 -- 172.21.15.42:0/3489015893 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c400a6e0 con 0x7f52cc07fa80 2020-04-02T23:24:29.978 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.971+0000 7f52d0c05700 1 -- 172.21.15.42:0/3489015893 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52cc07fa80 msgr2=0x7f52cc07ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:29.979 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.971+0000 7f52d0c05700 1 --2- 172.21.15.42:0/3489015893 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52cc07fa80 0x7f52cc07ff30 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7f52c40032b0 tx=0x7f52c4007dc0).stop 2020-04-02T23:24:29.979 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.971+0000 7f52d0c05700 1 -- 172.21.15.42:0/3489015893 shutdown_connections 2020-04-02T23:24:29.979 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.971+0000 7f52d0c05700 1 --2- 172.21.15.42:0/3489015893 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52cc07fa80 0x7f52cc07ff30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:29.979 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.971+0000 7f52d0c05700 1 --2- 172.21.15.42:0/3489015893 >> v2:172.21.15.84:3300/0 conn(0x7f52cc148da0 0x7f52cc0a3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:29.979 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.971+0000 7f52d0c05700 1 -- 172.21.15.42:0/3489015893 >> 172.21.15.42:0/3489015893 conn(0x7f52cc09dc40 msgr2=0x7f52cc0aa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:29.979 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.971+0000 7f52d0c05700 1 -- 172.21.15.42:0/3489015893 shutdown_connections 2020-04-02T23:24:29.979 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.971+0000 7f52d0c05700 1 -- 172.21.15.42:0/3489015893 wait complete. 2020-04-02T23:24:29.980 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.972+0000 7f52d0c05700 1 Processor -- start 2020-04-02T23:24:29.980 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.973+0000 7f52d0c05700 1 -- start start 2020-04-02T23:24:29.983 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.973+0000 7f52d0c05700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f52cc148da0 0x7f52cc064040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:29.983 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.973+0000 7f52d0c05700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52cc127ba0 con 0x7f52cc0ab230 2020-04-02T23:24:29.983 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.973+0000 7f52d0c05700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52cc1310e0 con 0x7f52cc07fa80 2020-04-02T23:24:29.983 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.973+0000 7f52d0c05700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52cc0a60b0 con 0x7f52cc148da0 2020-04-02T23:24:29.983 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.973+0000 7f52ca59c700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f52cc0ab230 0x7f52cc123500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:58726/0 (socket says 172.21.15.42:58726) 2020-04-02T23:24:29.984 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.973+0000 7f52ca59c700 1 -- 172.21.15.42:0/1871299944 learned_addr learned my addr 172.21.15.42:0/1871299944 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:29.984 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.973+0000 7f52cb59e700 1 --2- 172.21.15.42:0/1871299944 >> v2:172.21.15.84:3300/0 conn(0x7f52cc148da0 0x7f52cc064040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:29.984 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.973+0000 7f52bb7fe700 1 -- 172.21.15.42:0/1871299944 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283183461 0 0) 0x7f52cc127ba0 con 0x7f52cc0ab230 2020-04-02T23:24:29.984 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.973+0000 7f52bb7fe700 1 -- 172.21.15.42:0/1871299944 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52b0003230 con 0x7f52cc0ab230 2020-04-02T23:24:29.984 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.974+0000 7f52bb7fe700 1 -- 172.21.15.42:0/1871299944 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398960791 0 0) 0x7f52cc1310e0 con 0x7f52cc07fa80 2020-04-02T23:24:29.984 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.974+0000 7f52bb7fe700 1 -- 172.21.15.42:0/1871299944 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52cc127ba0 con 0x7f52cc07fa80 2020-04-02T23:24:29.984 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.974+0000 7f52cb59e700 1 -- 172.21.15.42:0/1871299944 >> v1:172.21.15.84:6789/0 conn(0x7f52cc07fa80 legacy=0x7f52cc09f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:29.985 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.974+0000 7f52cb59e700 1 -- 172.21.15.42:0/1871299944 >> v1:172.21.15.42:6789/0 conn(0x7f52cc0ab230 legacy=0x7f52cc123500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:29.985 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.974+0000 7f52cb59e700 1 -- 172.21.15.42:0/1871299944 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc131380 con 0x7f52cc148da0 2020-04-02T23:24:29.985 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.974+0000 7f52cb59e700 1 --2- 172.21.15.42:0/1871299944 >> v2:172.21.15.84:3300/0 conn(0x7f52cc148da0 0x7f52cc064040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52c40032b0 tx=0x7f52c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.985 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.974+0000 7f52cb59e700 1 --2- 172.21.15.42:0/1871299944 >> v2:172.21.15.84:3300/0 conn(0x7f52cc148da0 0x7f52cc064040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52c40032b0 tx=0x7f52c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.985 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.974+0000 7f52cb59e700 1 --2- 172.21.15.42:0/1871299944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52cc148da0 0x7f52cc064040 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f52c40032b0 tx=0x7f52c4007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:29.985 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.974+0000 7f52cb59e700 1 --2- 172.21.15.42:0/1871299944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52cc148da0 0x7f52cc064040 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f52c40032b0 tx=0x7f52c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.985 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.974+0000 7f52bb7fe700 1 -- 172.21.15.42:0/1871299944 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c4005c30 con 0x7f52cc148da0 2020-04-02T23:24:29.985 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.974+0000 7f52cb59e700 1 --2- 172.21.15.42:0/1871299944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52cc148da0 0x7f52cc064040 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f52c40032b0 tx=0x7f52c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.986 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.974+0000 7f52cb59e700 1 --2- 172.21.15.42:0/1871299944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52cc148da0 0x7f52cc064040 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f52c40032b0 tx=0x7f52c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.986 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.974+0000 7f52bb7fe700 1 -- 172.21.15.42:0/1871299944 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c4005d90 con 0x7f52cc148da0 2020-04-02T23:24:29.986 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.974+0000 7f52d0c05700 1 -- 172.21.15.42:0/1871299944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52cc131620 con 0x7f52cc148da0 2020-04-02T23:24:29.986 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.974+0000 7f52bb7fe700 1 -- 172.21.15.42:0/1871299944 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c4007340 con 0x7f52cc148da0 2020-04-02T23:24:29.986 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.974+0000 7f52d0c05700 1 -- 172.21.15.42:0/1871299944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52cc066d10 con 0x7f52cc148da0 2020-04-02T23:24:29.986 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.975+0000 7f52cb59e700 1 --2- 172.21.15.42:0/1871299944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52cc148da0 0x7f52cc064040 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f52c40032b0 tx=0x7f52c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.987 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.975+0000 7f52cb59e700 1 --2- 172.21.15.42:0/1871299944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52cc148da0 0x7f52cc064040 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f52c40032b0 tx=0x7f52c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.987 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.975+0000 7f52bb7fe700 1 -- 172.21.15.42:0/1871299944 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 3) v1 ==== 59405+0+0 (secure 0 0 0) 0x7f52c40074f0 con 0x7f52cc148da0 2020-04-02T23:24:29.987 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.975+0000 7f52d0c05700 1 -- 172.21.15.42:0/1871299944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52cc130f50 con 0x7f52cc148da0 2020-04-02T23:24:29.987 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.975+0000 7f52bb7fe700 1 --2- 172.21.15.42:0/1871299944 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f52b004d930 0x7f52b004fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:29.987 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.975+0000 7f52bb7fe700 1 -- 172.21.15.42:0/1871299944 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1614+0+0 (secure 0 0 0) 0x7f52c40a5910 con 0x7f52cc148da0 2020-04-02T23:24:29.988 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.975+0000 7f52cad9d700 1 --2- 172.21.15.42:0/1871299944 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f52b004d930 0x7f52b004fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:29.993 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.976+0000 7f52cad9d700 1 --2- 172.21.15.42:0/1871299944 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f52b004d930 0x7f52b004fdf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52bc000ee0 tx=0x7f52cc0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.993 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.976+0000 7f52cad9d700 1 --2- 172.21.15.42:0/1871299944 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f52b004d930 0x7f52b004fdf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52bc000ee0 tx=0x7f52cc0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.993 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.976+0000 7f52cad9d700 1 --2- 172.21.15.42:0/1871299944 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f52b004d930 0x7f52b004fdf0 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f52bc000ee0 tx=0x7f52cc0680a0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:29.993 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.979+0000 7f52cb59e700 1 --2- 172.21.15.42:0/1871299944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52cc148da0 0x7f52cc064040 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f52c40032b0 tx=0x7f52c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:29.994 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:29.979+0000 7f52bb7fe700 1 -- 172.21.15.42:0/1871299944 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f52c40811f0 con 0x7f52cc148da0 2020-04-02T23:24:30.084 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.082+0000 7f52cb59e700 1 --2- 172.21.15.42:0/1871299944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52cc148da0 0x7f52cc064040 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f52c40032b0 tx=0x7f52c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.084 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.082+0000 7f52bb7fe700 1 -- 172.21.15.42:0/1871299944 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f52c40815c0 con 0x7f52cc148da0 2020-04-02T23:24:30.146 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.144+0000 7f52d0c05700 1 -- 172.21.15.42:0/1871299944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b1a2ce60-ae80-4f8a-97a3-4fbb1399fdfe", "id": 4} v 0) v1 -- 0x7f52cc056c50 con 0x7f52cc148da0 2020-04-02T23:24:30.150 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.148+0000 7f52cb59e700 1 --2- 172.21.15.42:0/1871299944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52cc148da0 0x7f52cc064040 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f52c40032b0 tx=0x7f52c4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.150 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.148+0000 7f52bb7fe700 1 -- 172.21.15.42:0/1871299944 <== mon.1 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b1a2ce60-ae80-4f8a-97a3-4fbb1399fdfe", "id": 4}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f52c405f550 con 0x7f52cc148da0 2020-04-02T23:24:30.150 INFO:teuthology.orchestra.run.smithi042.stdout:4 2020-04-02T23:24:30.152 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.149+0000 7f52d0c05700 1 -- 172.21.15.42:0/1871299944 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f52b004d930 msgr2=0x7f52b004fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:30.152 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.149+0000 7f52d0c05700 1 --2- 172.21.15.42:0/1871299944 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f52b004d930 0x7f52b004fdf0 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f52bc000ee0 tx=0x7f52cc0680a0).stop 2020-04-02T23:24:30.152 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.149+0000 7f52d0c05700 1 -- 172.21.15.42:0/1871299944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52cc148da0 msgr2=0x7f52cc064040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:30.152 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.149+0000 7f52d0c05700 1 --2- 172.21.15.42:0/1871299944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52cc148da0 0x7f52cc064040 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f52c40032b0 tx=0x7f52c4007dc0).stop 2020-04-02T23:24:30.152 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.149+0000 7f52d0c05700 1 -- 172.21.15.42:0/1871299944 shutdown_connections 2020-04-02T23:24:30.152 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.149+0000 7f52d0c05700 1 --2- 172.21.15.42:0/1871299944 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f52b004d930 0x7f52b004fdf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:30.153 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.149+0000 7f52d0c05700 1 --2- 172.21.15.42:0/1871299944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52cc148da0 0x7f52cc064040 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:30.153 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.149+0000 7f52d0c05700 1 -- 172.21.15.42:0/1871299944 >> 172.21.15.42:0/1871299944 conn(0x7f52cc09dc40 msgr2=0x7f52cc069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:30.153 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.149+0000 7f52d0c05700 1 -- 172.21.15.42:0/1871299944 shutdown_connections 2020-04-02T23:24:30.153 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.149+0000 7f52d0c05700 1 -- 172.21.15.42:0/1871299944 wait complete. 2020-04-02T23:24:30.161 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:30.175 INFO:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 396b36e5-7226-4e8e-aa8a-749cb5cec101 5 2020-04-02T23:24:30.330 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.325+0000 7f6f4308e700 1 Processor -- start 2020-04-02T23:24:30.330 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.325+0000 7f6f4308e700 1 -- start start 2020-04-02T23:24:30.331 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f4308e700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6f3c148da0 0x7f6f3c0a3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:30.331 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f4308e700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6f3c07fa80 0x7f6f3c07fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:30.331 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f4308e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3c0a55c0 con 0x7f6f3c0ab230 2020-04-02T23:24:30.331 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f4308e700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3c0a68c0 con 0x7f6f3c07fa80 2020-04-02T23:24:30.331 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f4308e700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c0a6b60 con 0x7f6f3c148da0 2020-04-02T23:24:30.331 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f41e2c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6f3c07fa80 0x7f6f3c07fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:30.332 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f41e2c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6f3c07fa80 0x7f6f3c07fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39308/0 (socket says 172.21.15.42:39308) 2020-04-02T23:24:30.332 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f41e2c700 1 -- 172.21.15.42:0/3373224802 learned_addr learned my addr 172.21.15.42:0/3373224802 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:30.332 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f40e2a700 1 --2- 172.21.15.42:0/3373224802 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6f3c148da0 0x7f6f3c0a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:30.332 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f41e2c700 1 -- 172.21.15.42:0/3373224802 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6f3c148da0 msgr2=0x7f6f3c0a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:30.332 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/3373224802 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6f3c148da0 0x7f6f3c0a3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:30.332 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f41e2c700 1 -- 172.21.15.42:0/3373224802 >> v1:172.21.15.84:6789/0 conn(0x7f6f3c0ab230 legacy=0x7f6f3c148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:30.333 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f41e2c700 1 -- 172.21.15.42:0/3373224802 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c0a6380 con 0x7f6f3c07fa80 2020-04-02T23:24:30.333 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/3373224802 >> v2:172.21.15.42:3300/0 conn(0x7f6f3c07fa80 0x7f6f3c07fef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6f34002f30 tx=0x7f6f34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.333 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/3373224802 >> v2:172.21.15.42:3300/0 conn(0x7f6f3c07fa80 0x7f6f3c07fef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6f34002f30 tx=0x7f6f34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.333 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/3373224802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f3c07fa80 0x7f6f3c07fef0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f6f34002f30 tx=0x7f6f34007a40).ready entity=mon.0 client_cookie=def81a67e93e4f43 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:30.333 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/3373224802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f3c07fa80 0x7f6f3c07fef0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f6f34002f30 tx=0x7f6f34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.334 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/3373224802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f3c07fa80 0x7f6f3c07fef0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f6f34002f30 tx=0x7f6f34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.334 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f33fff700 1 -- 172.21.15.42:0/3373224802 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f34011720 con 0x7f6f3c07fa80 2020-04-02T23:24:30.334 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/3373224802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f3c07fa80 0x7f6f3c07fef0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f6f34002f30 tx=0x7f6f34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.334 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f33fff700 1 -- 172.21.15.42:0/3373224802 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f34011880 con 0x7f6f3c07fa80 2020-04-02T23:24:30.334 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f33fff700 1 -- 172.21.15.42:0/3373224802 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f34011ca0 con 0x7f6f3c07fa80 2020-04-02T23:24:30.335 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f4308e700 1 -- 172.21.15.42:0/3373224802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f3c07fa80 msgr2=0x7f6f3c07fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:30.335 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.326+0000 7f6f4308e700 1 --2- 172.21.15.42:0/3373224802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f3c07fa80 0x7f6f3c07fef0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f6f34002f30 tx=0x7f6f34007a40).stop 2020-04-02T23:24:30.335 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.327+0000 7f6f4308e700 1 -- 172.21.15.42:0/3373224802 shutdown_connections 2020-04-02T23:24:30.335 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.327+0000 7f6f4308e700 1 --2- 172.21.15.42:0/3373224802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f3c07fa80 0x7f6f3c07fef0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:30.335 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.327+0000 7f6f4308e700 1 --2- 172.21.15.42:0/3373224802 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6f3c148da0 0x7f6f3c0a3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:30.335 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.327+0000 7f6f4308e700 1 -- 172.21.15.42:0/3373224802 >> 172.21.15.42:0/3373224802 conn(0x7f6f3c09dc40 msgr2=0x7f6f3c0aa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:30.335 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.327+0000 7f6f4308e700 1 -- 172.21.15.42:0/3373224802 shutdown_connections 2020-04-02T23:24:30.336 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.327+0000 7f6f4308e700 1 -- 172.21.15.42:0/3373224802 wait complete. 2020-04-02T23:24:30.336 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.328+0000 7f6f4308e700 1 Processor -- start 2020-04-02T23:24:30.336 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.328+0000 7f6f4308e700 1 -- start start 2020-04-02T23:24:30.341 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.329+0000 7f6f4308e700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6f3c07fa80 0x7f6f3c122d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:30.341 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.329+0000 7f6f4308e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6f3c148da0 0x7f6f3c0a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:30.341 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.329+0000 7f6f4308e700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3c0a6040 con 0x7f6f3c0ab230 2020-04-02T23:24:30.342 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.329+0000 7f6f4308e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3c1231e0 con 0x7f6f3c148da0 2020-04-02T23:24:30.342 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.329+0000 7f6f4308e700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c0a78f0 con 0x7f6f3c07fa80 2020-04-02T23:24:30.342 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.329+0000 7f6f40e2a700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f6f3c0ab230 0x7f6f3c120990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:58738/0 (socket says 172.21.15.42:58738) 2020-04-02T23:24:30.342 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.329+0000 7f6f40e2a700 1 -- 172.21.15.42:0/1708181383 learned_addr learned my addr 172.21.15.42:0/1708181383 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:30.342 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.329+0000 7f6f4162b700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6f3c07fa80 0x7f6f3c122d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:30.342 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.329+0000 7f6f31ffb700 1 -- 172.21.15.42:0/1708181383 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260036496 0 0) 0x7f6f3c0a6040 con 0x7f6f3c0ab230 2020-04-02T23:24:30.343 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.329+0000 7f6f31ffb700 1 -- 172.21.15.42:0/1708181383 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f1c003230 con 0x7f6f3c0ab230 2020-04-02T23:24:30.343 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.329+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/1708181383 >> v2:172.21.15.84:3300/0 conn(0x7f6f3c148da0 0x7f6f3c0a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:30.343 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.329+0000 7f6f31ffb700 1 -- 172.21.15.42:0/1708181383 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 336521730 0 0) 0x7f6f1c003230 con 0x7f6f3c0ab230 2020-04-02T23:24:30.343 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f31ffb700 1 -- 172.21.15.42:0/1708181383 --> v1:172.21.15.42:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6f3c0a6040 con 0x7f6f3c0ab230 2020-04-02T23:24:30.343 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f31ffb700 1 -- 172.21.15.42:0/1708181383 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7f6f38002940 con 0x7f6f3c0ab230 2020-04-02T23:24:30.343 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f31ffb700 1 -- 172.21.15.42:0/1708181383 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6f3c07fa80 msgr2=0x7f6f3c122d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:30.343 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f31ffb700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6f3c07fa80 0x7f6f3c122d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:30.344 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f31ffb700 1 -- 172.21.15.42:0/1708181383 >> v2:172.21.15.84:3300/0 conn(0x7f6f3c148da0 msgr2=0x7f6f3c0a0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:30.344 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f31ffb700 1 --2- 172.21.15.42:0/1708181383 >> v2:172.21.15.84:3300/0 conn(0x7f6f3c148da0 0x7f6f3c0a0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:30.344 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f31ffb700 1 -- 172.21.15.42:0/1708181383 >> v1:172.21.15.42:6789/0 conn(0x7f6f3c0ab230 legacy=0x7f6f3c120990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:30.344 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f31ffb700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c0037f0 0x7f6f1c003c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:30.344 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f31ffb700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6f1c0044d0 0x7f6f1c004910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:30.345 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f31ffb700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1c004d70 0x7f6f1c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:30.345 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f31ffb700 1 -- 172.21.15.42:0/1708181383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c1231e0 con 0x7f6f1c004d70 2020-04-02T23:24:30.345 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f31ffb700 1 -- 172.21.15.42:0/1708181383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c0a78f0 con 0x7f6f1c0037f0 2020-04-02T23:24:30.345 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f31ffb700 1 -- 172.21.15.42:0/1708181383 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c005220 con 0x7f6f1c0044d0 2020-04-02T23:24:30.345 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f4162b700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6f3c07fa80 0x7f6f3c122d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:30.345 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/1708181383 >> v2:172.21.15.84:3300/0 conn(0x7f6f3c148da0 0x7f6f3c0a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:30.346 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1c004d70 0x7f6f1c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:30.346 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f40e2a700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6f1c0044d0 0x7f6f1c004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:30.346 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f4162b700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c0037f0 0x7f6f1c003c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:30.346 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f41e2c700 1 -- 172.21.15.42:0/1708181383 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6f1c0044d0 msgr2=0x7f6f1c004910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:30.346 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6f1c0044d0 0x7f6f1c004910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:30.346 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f41e2c700 1 -- 172.21.15.42:0/1708181383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c0037f0 msgr2=0x7f6f1c003c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:30.346 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c0037f0 0x7f6f1c003c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:30.347 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f41e2c700 1 -- 172.21.15.42:0/1708181383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c0a7b90 con 0x7f6f1c004d70 2020-04-02T23:24:30.347 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f4308e700 1 -- 172.21.15.42:0/1708181383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3c0a7e30 con 0x7f6f1c004d70 2020-04-02T23:24:30.347 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1c004d70 0x7f6f1c00b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f34002f30 tx=0x7f6f34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.347 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f4308e700 1 -- 172.21.15.42:0/1708181383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3c1210a0 con 0x7f6f1c004d70 2020-04-02T23:24:30.347 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1c004d70 0x7f6f1c00b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f34002f30 tx=0x7f6f34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.347 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1c004d70 0x7f6f1c00b720 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f6f34002f30 tx=0x7f6f34007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:30.347 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1c004d70 0x7f6f1c00b720 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f6f34002f30 tx=0x7f6f34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.348 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f31ffb700 1 -- 172.21.15.42:0/1708181383 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f34007340 con 0x7f6f1c004d70 2020-04-02T23:24:30.348 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1c004d70 0x7f6f1c00b720 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f6f34002f30 tx=0x7f6f34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.348 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1c004d70 0x7f6f1c00b720 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f6f34002f30 tx=0x7f6f34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.348 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f31ffb700 1 -- 172.21.15.42:0/1708181383 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f340074e0 con 0x7f6f1c004d70 2020-04-02T23:24:30.348 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.330+0000 7f6f31ffb700 1 -- 172.21.15.42:0/1708181383 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f340058b0 con 0x7f6f1c004d70 2020-04-02T23:24:30.348 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.331+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1c004d70 0x7f6f1c00b720 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f6f34002f30 tx=0x7f6f34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.348 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.331+0000 7f6f4308e700 1 -- 172.21.15.42:0/1708181383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f14003340 con 0x7f6f1c004d70 2020-04-02T23:24:30.349 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.331+0000 7f6f31ffb700 1 -- 172.21.15.42:0/1708181383 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f6f34005a10 con 0x7f6f1c004d70 2020-04-02T23:24:30.349 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.331+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1c004d70 0x7f6f1c00b720 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f6f34002f30 tx=0x7f6f34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.349 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.332+0000 7f6f31ffb700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f6f1c055c80 0x7f6f1c058140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:30.349 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.332+0000 7f6f31ffb700 1 -- 172.21.15.42:0/1708181383 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1729+0+0 (secure 0 0 0) 0x7f6f340619a0 con 0x7f6f1c004d70 2020-04-02T23:24:30.349 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.332+0000 7f6f4162b700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f6f1c055c80 0x7f6f1c058140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:30.349 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.332+0000 7f6f4162b700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f6f1c055c80 0x7f6f1c058140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f3c09e250 tx=0x7f6f3c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.350 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.332+0000 7f6f4162b700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f6f1c055c80 0x7f6f1c058140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f3c09e250 tx=0x7f6f3c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.350 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.332+0000 7f6f4162b700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f6f1c055c80 0x7f6f1c058140 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7f6f3c09e250 tx=0x7f6f3c0680a0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:30.350 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.335+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1c004d70 0x7f6f1c00b720 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f6f34002f30 tx=0x7f6f34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.350 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.335+0000 7f6f31ffb700 1 -- 172.21.15.42:0/1708181383 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f6f3403d1c0 con 0x7f6f1c004d70 2020-04-02T23:24:30.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.498+0000 7f6f4308e700 1 -- 172.21.15.42:0/1708181383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd new", "uuid": "396b36e5-7226-4e8e-aa8a-749cb5cec101", "id": 5} v 0) v1 -- 0x7f6f14002220 con 0x7f6f1c004d70 2020-04-02T23:24:30.503 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.500+0000 7f6f41e2c700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1c004d70 0x7f6f1c00b720 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f6f34002f30 tx=0x7f6f34007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.503 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.500+0000 7f6f31ffb700 1 -- 172.21.15.42:0/1708181383 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "396b36e5-7226-4e8e-aa8a-749cb5cec101", "id": 5}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6f340407e0 con 0x7f6f1c004d70 2020-04-02T23:24:30.503 INFO:teuthology.orchestra.run.smithi042.stdout:5 2020-04-02T23:24:30.504 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.502+0000 7f6f4308e700 1 -- 172.21.15.42:0/1708181383 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f6f1c055c80 msgr2=0x7f6f1c058140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:30.504 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.502+0000 7f6f4308e700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f6f1c055c80 0x7f6f1c058140 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7f6f3c09e250 tx=0x7f6f3c0680a0).stop 2020-04-02T23:24:30.505 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.502+0000 7f6f4308e700 1 -- 172.21.15.42:0/1708181383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1c004d70 msgr2=0x7f6f1c00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:30.505 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.502+0000 7f6f4308e700 1 --2- 172.21.15.42:0/1708181383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1c004d70 0x7f6f1c00b720 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f6f34002f30 tx=0x7f6f34007a40).stop 2020-04-02T23:24:30.505 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.502+0000 7f6f41e2c700 1 -- 172.21.15.42:0/1708181383 reap_dead start 2020-04-02T23:24:30.505 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.502+0000 7f6f41e2c700 1 -- 172.21.15.42:0/1708181383 reap_dead start 2020-04-02T23:24:30.505 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.502+0000 7f6f4308e700 1 -- 172.21.15.42:0/1708181383 shutdown_connections 2020-04-02T23:24:30.505 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.502+0000 7f6f4308e700 1 -- 172.21.15.42:0/1708181383 >> 172.21.15.42:0/1708181383 conn(0x7f6f3c09dc40 msgr2=0x7f6f3c07f370 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:30.506 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.502+0000 7f6f4308e700 1 -- 172.21.15.42:0/1708181383 shutdown_connections 2020-04-02T23:24:30.506 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.502+0000 7f6f4308e700 1 -- 172.21.15.42:0/1708181383 wait complete. 2020-04-02T23:24:30.514 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:30.528 INFO:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 884bb915-28c3-463d-8046-e2908f6e8e96 6 2020-04-02T23:24:30.683 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.678+0000 7fa865c9a700 1 Processor -- start 2020-04-02T23:24:30.683 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.678+0000 7fa865c9a700 1 -- start start 2020-04-02T23:24:30.683 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.678+0000 7fa865c9a700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa860024ce0 0x7fa8600a7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:30.683 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.678+0000 7fa865c9a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa860025860 0x7fa86005f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:30.684 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.678+0000 7fa865c9a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa86009e870 con 0x7fa8600a7740 2020-04-02T23:24:30.684 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.678+0000 7fa865c9a700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa86009eb10 con 0x7fa860024ce0 2020-04-02T23:24:30.684 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.678+0000 7fa865c9a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8600250c0 con 0x7fa860025860 2020-04-02T23:24:30.684 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.678+0000 7fa865499700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa860024ce0 0x7fa8600a7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:30.684 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.679+0000 7fa865499700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa860024ce0 0x7fa8600a7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39326/0 (socket says 172.21.15.42:39326) 2020-04-02T23:24:30.684 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.679+0000 7fa865499700 1 -- 172.21.15.42:0/510121859 learned_addr learned my addr 172.21.15.42:0/510121859 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:30.685 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.679+0000 7fa866efc700 1 --2- 172.21.15.42:0/510121859 >> v2:172.21.15.84:3300/0 conn(0x7fa860025860 0x7fa86005f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:30.685 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.679+0000 7fa865499700 1 -- 172.21.15.42:0/510121859 >> v2:172.21.15.84:3300/0 conn(0x7fa860025860 msgr2=0x7fa86005f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:30.685 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.679+0000 7fa865499700 1 --2- 172.21.15.42:0/510121859 >> v2:172.21.15.84:3300/0 conn(0x7fa860025860 0x7fa86005f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:30.685 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.679+0000 7fa865499700 1 -- 172.21.15.42:0/510121859 >> v1:172.21.15.84:6789/0 conn(0x7fa8600a7740 legacy=0x7fa86005efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:30.685 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.679+0000 7fa865499700 1 -- 172.21.15.42:0/510121859 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa860025cb0 con 0x7fa860024ce0 2020-04-02T23:24:30.685 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.679+0000 7fa865499700 1 --2- 172.21.15.42:0/510121859 >> v2:172.21.15.42:3300/0 conn(0x7fa860024ce0 0x7fa8600a7280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa85c002f30 tx=0x7fa85c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.679+0000 7fa865499700 1 --2- 172.21.15.42:0/510121859 >> v2:172.21.15.42:3300/0 conn(0x7fa860024ce0 0x7fa8600a7280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa85c002f30 tx=0x7fa85c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.679+0000 7fa865499700 1 --2- 172.21.15.42:0/510121859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa860024ce0 0x7fa8600a7280 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fa85c002f30 tx=0x7fa85c007a40).ready entity=mon.0 client_cookie=38cb433aee295d9c server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.679+0000 7fa865499700 1 --2- 172.21.15.42:0/510121859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa860024ce0 0x7fa8600a7280 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fa85c002f30 tx=0x7fa85c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.679+0000 7fa865499700 1 --2- 172.21.15.42:0/510121859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa860024ce0 0x7fa8600a7280 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fa85c002f30 tx=0x7fa85c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.679+0000 7fa857fff700 1 -- 172.21.15.42:0/510121859 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa85c011670 con 0x7fa860024ce0 2020-04-02T23:24:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.679+0000 7fa865499700 1 --2- 172.21.15.42:0/510121859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa860024ce0 0x7fa8600a7280 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fa85c002f30 tx=0x7fa85c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.679+0000 7fa857fff700 1 -- 172.21.15.42:0/510121859 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85c0117d0 con 0x7fa860024ce0 2020-04-02T23:24:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.679+0000 7fa857fff700 1 -- 172.21.15.42:0/510121859 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa85c011bb0 con 0x7fa860024ce0 2020-04-02T23:24:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.679+0000 7fa865c9a700 1 -- 172.21.15.42:0/510121859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa860024ce0 msgr2=0x7fa8600a7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.679+0000 7fa865c9a700 1 --2- 172.21.15.42:0/510121859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa860024ce0 0x7fa8600a7280 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fa85c002f30 tx=0x7fa85c007a40).stop 2020-04-02T23:24:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.680+0000 7fa865c9a700 1 -- 172.21.15.42:0/510121859 shutdown_connections 2020-04-02T23:24:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.680+0000 7fa865c9a700 1 --2- 172.21.15.42:0/510121859 >> v2:172.21.15.84:3300/0 conn(0x7fa860025860 0x7fa86005f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.680+0000 7fa865c9a700 1 --2- 172.21.15.42:0/510121859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa860024ce0 0x7fa8600a7280 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.680+0000 7fa865c9a700 1 -- 172.21.15.42:0/510121859 >> 172.21.15.42:0/510121859 conn(0x7fa8600abbf0 msgr2=0x7fa8600ac000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:30.688 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.680+0000 7fa865c9a700 1 -- 172.21.15.42:0/510121859 shutdown_connections 2020-04-02T23:24:30.688 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.680+0000 7fa865c9a700 1 -- 172.21.15.42:0/510121859 wait complete. 2020-04-02T23:24:30.688 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.681+0000 7fa865c9a700 1 Processor -- start 2020-04-02T23:24:30.688 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.681+0000 7fa865c9a700 1 -- start start 2020-04-02T23:24:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa865c9a700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa860025860 0x7fa8600a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa865c9a700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa860062510 con 0x7fa860024ce0 2020-04-02T23:24:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa865c9a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa860062770 con 0x7fa8600a7740 2020-04-02T23:24:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa865c9a700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa860080020 con 0x7fa860025860 2020-04-02T23:24:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa865499700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa860024ce0 0x7fa8600a1250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:58754/0 (socket says 172.21.15.42:58754) 2020-04-02T23:24:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa865499700 1 -- 172.21.15.42:0/3973698808 learned_addr learned my addr 172.21.15.42:0/3973698808 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa864c98700 1 --2- 172.21.15.42:0/3973698808 >> v2:172.21.15.42:3300/0 conn(0x7fa860025860 0x7fa8600a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa855ffb700 1 -- 172.21.15.42:0/3973698808 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379187898 0 0) 0x7fa860062510 con 0x7fa860024ce0 2020-04-02T23:24:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa855ffb700 1 -- 172.21.15.42:0/3973698808 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa840003230 con 0x7fa860024ce0 2020-04-02T23:24:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa864c98700 1 -- 172.21.15.42:0/3973698808 >> v1:172.21.15.84:6789/0 conn(0x7fa8600a7740 legacy=0x7fa86013f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa855ffb700 1 -- 172.21.15.42:0/3973698808 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192577995 0 0) 0x7fa860062770 con 0x7fa8600a7740 2020-04-02T23:24:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa864c98700 1 -- 172.21.15.42:0/3973698808 >> v1:172.21.15.42:6789/0 conn(0x7fa860024ce0 legacy=0x7fa8600a1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa864c98700 1 -- 172.21.15.42:0/3973698808 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86005f840 con 0x7fa860025860 2020-04-02T23:24:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa864c98700 1 --2- 172.21.15.42:0/3973698808 >> v2:172.21.15.42:3300/0 conn(0x7fa860025860 0x7fa8600a0b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa860061130 tx=0x7fa8500108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa864c98700 1 --2- 172.21.15.42:0/3973698808 >> v2:172.21.15.42:3300/0 conn(0x7fa860025860 0x7fa8600a0b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa860061130 tx=0x7fa8500108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa864c98700 1 --2- 172.21.15.42:0/3973698808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa860025860 0x7fa8600a0b80 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7fa860061130 tx=0x7fa8500108e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa864c98700 1 --2- 172.21.15.42:0/3973698808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa860025860 0x7fa8600a0b80 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fa860061130 tx=0x7fa8500108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa855ffb700 1 -- 172.21.15.42:0/3973698808 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa85000cc00 con 0x7fa860025860 2020-04-02T23:24:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa864c98700 1 --2- 172.21.15.42:0/3973698808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa860025860 0x7fa8600a0b80 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fa860061130 tx=0x7fa8500108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa864c98700 1 --2- 172.21.15.42:0/3973698808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa860025860 0x7fa8600a0b80 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fa860061130 tx=0x7fa8500108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.695 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa855ffb700 1 -- 172.21.15.42:0/3973698808 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85000cd60 con 0x7fa860025860 2020-04-02T23:24:30.695 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa865c9a700 1 -- 172.21.15.42:0/3973698808 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8600a1960 con 0x7fa860025860 2020-04-02T23:24:30.695 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa855ffb700 1 -- 172.21.15.42:0/3973698808 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8500110c0 con 0x7fa860025860 2020-04-02T23:24:30.695 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.682+0000 7fa865c9a700 1 -- 172.21.15.42:0/3973698808 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa86005f570 con 0x7fa860025860 2020-04-02T23:24:30.695 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.683+0000 7fa864c98700 1 --2- 172.21.15.42:0/3973698808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa860025860 0x7fa8600a0b80 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fa860061130 tx=0x7fa8500108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.695 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.683+0000 7fa865c9a700 1 -- 172.21.15.42:0/3973698808 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa860056c50 con 0x7fa860025860 2020-04-02T23:24:30.696 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.683+0000 7fa855ffb700 1 -- 172.21.15.42:0/3973698808 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa8500064e0 con 0x7fa860025860 2020-04-02T23:24:30.696 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.683+0000 7fa864c98700 1 --2- 172.21.15.42:0/3973698808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa860025860 0x7fa8600a0b80 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fa860061130 tx=0x7fa8500108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.696 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.684+0000 7fa855ffb700 1 --2- 172.21.15.42:0/3973698808 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa84004d8a0 0x7fa84004fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:30.696 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.684+0000 7fa855ffb700 1 -- 172.21.15.42:0/3973698808 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1844+0+0 (secure 0 0 0) 0x7fa850060990 con 0x7fa860025860 2020-04-02T23:24:30.696 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.684+0000 7fa865499700 1 --2- 172.21.15.42:0/3973698808 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa84004d8a0 0x7fa84004fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:30.696 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.684+0000 7fa865499700 1 --2- 172.21.15.42:0/3973698808 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa84004d8a0 0x7fa84004fd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa85c0082e0 tx=0x7fa85c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.697 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.684+0000 7fa865499700 1 --2- 172.21.15.42:0/3973698808 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa84004d8a0 0x7fa84004fd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa85c0082e0 tx=0x7fa85c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.697 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.684+0000 7fa865499700 1 --2- 172.21.15.42:0/3973698808 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa84004d8a0 0x7fa84004fd60 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7fa85c0082e0 tx=0x7fa85c007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:30.697 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.687+0000 7fa864c98700 1 --2- 172.21.15.42:0/3973698808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa860025860 0x7fa8600a0b80 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fa860061130 tx=0x7fa8500108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.697 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.687+0000 7fa855ffb700 1 -- 172.21.15.42:0/3973698808 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fa85003c150 con 0x7fa860025860 2020-04-02T23:24:30.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.849+0000 7fa865c9a700 1 -- 172.21.15.42:0/3973698808 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd new", "uuid": "884bb915-28c3-463d-8046-e2908f6e8e96", "id": 6} v 0) v1 -- 0x7fa8600692b0 con 0x7fa860025860 2020-04-02T23:24:30.854 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.852+0000 7fa864c98700 1 --2- 172.21.15.42:0/3973698808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa860025860 0x7fa8600a0b80 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fa860061130 tx=0x7fa8500108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:30.854 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.852+0000 7fa855ffb700 1 -- 172.21.15.42:0/3973698808 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "884bb915-28c3-463d-8046-e2908f6e8e96", "id": 6}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa85003f770 con 0x7fa860025860 2020-04-02T23:24:30.854 INFO:teuthology.orchestra.run.smithi042.stdout:6 2020-04-02T23:24:30.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.853+0000 7fa865c9a700 1 -- 172.21.15.42:0/3973698808 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa84004d8a0 msgr2=0x7fa84004fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:30.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.853+0000 7fa865c9a700 1 --2- 172.21.15.42:0/3973698808 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa84004d8a0 0x7fa84004fd60 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7fa85c0082e0 tx=0x7fa85c007a40).stop 2020-04-02T23:24:30.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.853+0000 7fa865c9a700 1 -- 172.21.15.42:0/3973698808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa860025860 msgr2=0x7fa8600a0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:30.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.853+0000 7fa865c9a700 1 --2- 172.21.15.42:0/3973698808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa860025860 0x7fa8600a0b80 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7fa860061130 tx=0x7fa8500108e0).stop 2020-04-02T23:24:30.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.853+0000 7fa865c9a700 1 -- 172.21.15.42:0/3973698808 shutdown_connections 2020-04-02T23:24:30.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.853+0000 7fa865c9a700 1 --2- 172.21.15.42:0/3973698808 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa84004d8a0 0x7fa84004fd60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:30.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.853+0000 7fa865c9a700 1 --2- 172.21.15.42:0/3973698808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa860025860 0x7fa8600a0b80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:30.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.853+0000 7fa865c9a700 1 -- 172.21.15.42:0/3973698808 >> 172.21.15.42:0/3973698808 conn(0x7fa8600abbf0 msgr2=0x7fa860128280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:30.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.853+0000 7fa865c9a700 1 -- 172.21.15.42:0/3973698808 shutdown_connections 2020-04-02T23:24:30.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:30.853+0000 7fa865c9a700 1 -- 172.21.15.42:0/3973698808 wait complete. 2020-04-02T23:24:30.865 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:30.879 INFO:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 70e90d1d-f081-4de5-af4b-e987c159e597 7 2020-04-02T23:24:31.037 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.029+0000 7f2cc412b700 1 Processor -- start 2020-04-02T23:24:31.038 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.029+0000 7f2cc412b700 1 -- start start 2020-04-02T23:24:31.038 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.029+0000 7f2cc412b700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2cbc148da0 0x7f2cbc0a3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:31.038 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.029+0000 7f2cc412b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2cbc07fa80 0x7f2cbc07fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:31.038 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.029+0000 7f2cc412b700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cbc0a55c0 con 0x7f2cbc0ab230 2020-04-02T23:24:31.038 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.029+0000 7f2cc412b700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cbc0a68c0 con 0x7f2cbc07fa80 2020-04-02T23:24:31.038 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.029+0000 7f2cc412b700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc0a6b60 con 0x7f2cbc148da0 2020-04-02T23:24:31.039 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.030+0000 7f2cc2ec9700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2cbc07fa80 0x7f2cbc07fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:31.039 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.030+0000 7f2cc26c8700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f2cbc0ab230 0x7f2cbc148690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:58762/0 (socket says 172.21.15.42:58762) 2020-04-02T23:24:31.039 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.030+0000 7f2cc26c8700 1 -- 172.21.15.42:0/1081785061 learned_addr learned my addr 172.21.15.42:0/1081785061 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:31.039 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.030+0000 7f2cc1ec7700 1 --2- 172.21.15.42:0/1081785061 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2cbc148da0 0x7f2cbc0a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:31.039 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.030+0000 7f2cc2ec9700 1 -- 172.21.15.42:0/1081785061 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2cbc148da0 msgr2=0x7f2cbc0a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:31.039 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.030+0000 7f2cc2ec9700 1 --2- 172.21.15.42:0/1081785061 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2cbc148da0 0x7f2cbc0a3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:31.040 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.030+0000 7f2cc2ec9700 1 -- 172.21.15.42:0/1081785061 >> v1:172.21.15.42:6789/0 conn(0x7f2cbc0ab230 legacy=0x7f2cbc148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:31.040 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.030+0000 7f2cc16c6700 1 -- 172.21.15.42:0/1081785061 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881936367 0 0) 0x7f2cbc0a55c0 con 0x7f2cbc0ab230 2020-04-02T23:24:31.040 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.030+0000 7f2cc2ec9700 1 -- 172.21.15.42:0/1081785061 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cbc0a6380 con 0x7f2cbc07fa80 2020-04-02T23:24:31.040 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.030+0000 7f2cc2ec9700 1 --2- 172.21.15.42:0/1081785061 >> v2:172.21.15.42:3300/0 conn(0x7f2cbc07fa80 0x7f2cbc07fef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2cb40032b0 tx=0x7f2cb4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:31.040 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.030+0000 7f2cc2ec9700 1 --2- 172.21.15.42:0/1081785061 >> v2:172.21.15.42:3300/0 conn(0x7f2cbc07fa80 0x7f2cbc07fef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2cb40032b0 tx=0x7f2cb4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:31.040 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.030+0000 7f2cc2ec9700 1 --2- 172.21.15.42:0/1081785061 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cbc07fa80 0x7f2cbc07fef0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f2cb40032b0 tx=0x7f2cb4007dc0).ready entity=mon.0 client_cookie=4be3366bb4881203 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:31.040 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.030+0000 7f2cc2ec9700 1 --2- 172.21.15.42:0/1081785061 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cbc07fa80 0x7f2cbc07fef0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f2cb40032b0 tx=0x7f2cb4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:31.041 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.030+0000 7f2cc16c6700 1 -- 172.21.15.42:0/1081785061 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cb400a160 con 0x7f2cbc07fa80 2020-04-02T23:24:31.041 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.030+0000 7f2cc2ec9700 1 --2- 172.21.15.42:0/1081785061 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cbc07fa80 0x7f2cbc07fef0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f2cb40032b0 tx=0x7f2cb4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:31.041 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.030+0000 7f2cc2ec9700 1 --2- 172.21.15.42:0/1081785061 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cbc07fa80 0x7f2cbc07fef0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f2cb40032b0 tx=0x7f2cb4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:31.041 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.030+0000 7f2cc16c6700 1 -- 172.21.15.42:0/1081785061 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb400a2c0 con 0x7f2cbc07fa80 2020-04-02T23:24:31.041 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.030+0000 7f2cc16c6700 1 -- 172.21.15.42:0/1081785061 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cb400a6a0 con 0x7f2cbc07fa80 2020-04-02T23:24:31.041 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.030+0000 7f2cc412b700 1 -- 172.21.15.42:0/1081785061 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cbc07fa80 msgr2=0x7f2cbc07fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:31.041 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.030+0000 7f2cc412b700 1 --2- 172.21.15.42:0/1081785061 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cbc07fa80 0x7f2cbc07fef0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f2cb40032b0 tx=0x7f2cb4007dc0).stop 2020-04-02T23:24:31.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.031+0000 7f2cc412b700 1 -- 172.21.15.42:0/1081785061 shutdown_connections 2020-04-02T23:24:31.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.031+0000 7f2cc412b700 1 --2- 172.21.15.42:0/1081785061 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cbc07fa80 0x7f2cbc07fef0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:31.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.031+0000 7f2cc412b700 1 --2- 172.21.15.42:0/1081785061 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2cbc148da0 0x7f2cbc0a3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:31.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.031+0000 7f2cc412b700 1 -- 172.21.15.42:0/1081785061 >> 172.21.15.42:0/1081785061 conn(0x7f2cbc09dc40 msgr2=0x7f2cbc0aa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:31.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.031+0000 7f2cc412b700 1 -- 172.21.15.42:0/1081785061 shutdown_connections 2020-04-02T23:24:31.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.031+0000 7f2cc412b700 1 -- 172.21.15.42:0/1081785061 wait complete. 2020-04-02T23:24:31.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.032+0000 7f2cc412b700 1 Processor -- start 2020-04-02T23:24:31.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.032+0000 7f2cc412b700 1 -- start start 2020-04-02T23:24:31.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.032+0000 7f2cc412b700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2cbc07fa80 0x7f2cbc12a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:31.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.032+0000 7f2cc412b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2cbc0ab230 0x7f2cbc12a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:31.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.032+0000 7f2cc412b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2cbc148da0 0x7f2cbc1493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:31.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.032+0000 7f2cc412b700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cbc12abf0 con 0x7f2cbc0ab230 2020-04-02T23:24:31.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.032+0000 7f2cc412b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cbc12ae00 con 0x7f2cbc148da0 2020-04-02T23:24:31.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.032+0000 7f2cc412b700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc12b0a0 con 0x7f2cbc07fa80 2020-04-02T23:24:31.044 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.032+0000 7f2cc1ec7700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2cbc0ab230 0x7f2cbc12a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:31.044 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.032+0000 7f2cc1ec7700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2cbc0ab230 0x7f2cbc12a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39346/0 (socket says 172.21.15.42:39346) 2020-04-02T23:24:31.044 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cc1ec7700 1 -- 172.21.15.42:0/2209861062 learned_addr learned my addr 172.21.15.42:0/2209861062 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:31.044 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cc2ec9700 1 --2- 172.21.15.42:0/2209861062 >> v2:172.21.15.84:3300/0 conn(0x7f2cbc148da0 0x7f2cbc1493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:31.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cc26c8700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2cbc07fa80 0x7f2cbc12a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:31.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cc1ec7700 1 -- 172.21.15.42:0/2209861062 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2cbc07fa80 msgr2=0x7f2cbc12a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:31.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cc1ec7700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2cbc07fa80 0x7f2cbc12a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:31.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cc1ec7700 1 -- 172.21.15.42:0/2209861062 >> v2:172.21.15.84:3300/0 conn(0x7f2cbc148da0 msgr2=0x7f2cbc1493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:31.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cc1ec7700 1 --2- 172.21.15.42:0/2209861062 >> v2:172.21.15.84:3300/0 conn(0x7f2cbc148da0 0x7f2cbc1493e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:31.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cc1ec7700 1 -- 172.21.15.42:0/2209861062 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cbc07f600 con 0x7f2cbc0ab230 2020-04-02T23:24:31.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cc26c8700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2cbc07fa80 0x7f2cbc12a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:24:31.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cc2ec9700 1 --2- 172.21.15.42:0/2209861062 >> v2:172.21.15.84:3300/0 conn(0x7f2cbc148da0 0x7f2cbc1493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:24:31.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cc1ec7700 1 --2- 172.21.15.42:0/2209861062 >> v2:172.21.15.42:3300/0 conn(0x7f2cbc0ab230 0x7f2cbc12a640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2cac002f30 tx=0x7f2cac012f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:31.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cc1ec7700 1 --2- 172.21.15.42:0/2209861062 >> v2:172.21.15.42:3300/0 conn(0x7f2cbc0ab230 0x7f2cbc12a640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2cac002f30 tx=0x7f2cac012f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:31.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cc1ec7700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cbc0ab230 0x7f2cbc12a640 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f2cac002f30 tx=0x7f2cac012f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:31.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cc1ec7700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cbc0ab230 0x7f2cbc12a640 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f2cac002f30 tx=0x7f2cac012f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:31.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cc1ec7700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cbc0ab230 0x7f2cbc12a640 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f2cac002f30 tx=0x7f2cac012f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:31.047 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cb2ffd700 1 -- 172.21.15.42:0/2209861062 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cac014d80 con 0x7f2cbc0ab230 2020-04-02T23:24:31.047 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cc1ec7700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cbc0ab230 0x7f2cbc12a640 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f2cac002f30 tx=0x7f2cac012f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:31.047 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cb2ffd700 1 -- 172.21.15.42:0/2209861062 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cac0091a0 con 0x7f2cbc0ab230 2020-04-02T23:24:31.047 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cc412b700 1 -- 172.21.15.42:0/2209861062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cbc14e460 con 0x7f2cbc0ab230 2020-04-02T23:24:31.047 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cb2ffd700 1 -- 172.21.15.42:0/2209861062 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cac009540 con 0x7f2cbc0ab230 2020-04-02T23:24:31.048 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.033+0000 7f2cc412b700 1 -- 172.21.15.42:0/2209861062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cbc14e710 con 0x7f2cbc0ab230 2020-04-02T23:24:31.048 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.034+0000 7f2cc1ec7700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cbc0ab230 0x7f2cbc12a640 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f2cac002f30 tx=0x7f2cac012f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:31.048 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.034+0000 7f2cb2ffd700 1 -- 172.21.15.42:0/2209861062 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f2cac007170 con 0x7f2cbc0ab230 2020-04-02T23:24:31.048 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.034+0000 7f2cc1ec7700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cbc0ab230 0x7f2cbc12a640 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f2cac002f30 tx=0x7f2cac012f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:31.048 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.034+0000 7f2cc412b700 1 -- 172.21.15.42:0/2209861062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cbc056c50 con 0x7f2cbc0ab230 2020-04-02T23:24:31.048 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.034+0000 7f2cb2ffd700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f2ca404d600 0x7f2ca404fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:31.049 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.034+0000 7f2cb2ffd700 1 -- 172.21.15.42:0/2209861062 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1959+0+0 (secure 0 0 0) 0x7f2cac0633b0 con 0x7f2cbc0ab230 2020-04-02T23:24:31.049 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.035+0000 7f2cc26c8700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f2ca404d600 0x7f2ca404fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:31.049 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.035+0000 7f2cc26c8700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f2ca404d600 0x7f2ca404fac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2cb8000b80 tx=0x7f2cbc0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:31.049 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.035+0000 7f2cc26c8700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f2ca404d600 0x7f2ca404fac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2cb8000b80 tx=0x7f2cbc0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:31.049 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.035+0000 7f2cc26c8700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f2ca404d600 0x7f2ca404fac0 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7f2cb8000b80 tx=0x7f2cbc0680a0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:31.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.038+0000 7f2cc1ec7700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cbc0ab230 0x7f2cbc12a640 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f2cac002f30 tx=0x7f2cac012f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:31.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.038+0000 7f2cb2ffd700 1 -- 172.21.15.42:0/2209861062 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f2cac03eb70 con 0x7f2cbc0ab230 2020-04-02T23:24:31.205 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.201+0000 7f2cc412b700 1 -- 172.21.15.42:0/2209861062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd new", "uuid": "70e90d1d-f081-4de5-af4b-e987c159e597", "id": 7} v 0) v1 -- 0x7f2cbc05a600 con 0x7f2cbc0ab230 2020-04-02T23:24:31.206 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.204+0000 7f2cc1ec7700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cbc0ab230 0x7f2cbc12a640 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f2cac002f30 tx=0x7f2cac012f10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:31.206 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.204+0000 7f2cb2ffd700 1 -- 172.21.15.42:0/2209861062 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "70e90d1d-f081-4de5-af4b-e987c159e597", "id": 7}]=0 v11) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2cac042190 con 0x7f2cbc0ab230 2020-04-02T23:24:31.207 INFO:teuthology.orchestra.run.smithi042.stdout:7 2020-04-02T23:24:31.210 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.206+0000 7f2cc412b700 1 -- 172.21.15.42:0/2209861062 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f2ca404d600 msgr2=0x7f2ca404fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:31.211 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.206+0000 7f2cc412b700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f2ca404d600 0x7f2ca404fac0 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7f2cb8000b80 tx=0x7f2cbc0680a0).stop 2020-04-02T23:24:31.211 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.206+0000 7f2cc412b700 1 -- 172.21.15.42:0/2209861062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cbc0ab230 msgr2=0x7f2cbc12a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:31.211 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.206+0000 7f2cc412b700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cbc0ab230 0x7f2cbc12a640 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f2cac002f30 tx=0x7f2cac012f10).stop 2020-04-02T23:24:31.211 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.206+0000 7f2cc412b700 1 -- 172.21.15.42:0/2209861062 shutdown_connections 2020-04-02T23:24:31.211 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.206+0000 7f2cc412b700 1 --2- 172.21.15.42:0/2209861062 >> v2:172.21.15.84:3300/0 conn(0x7f2cbc148da0 0x7f2cbc1493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:31.212 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.206+0000 7f2cc412b700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f2ca404d600 0x7f2ca404fac0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:31.212 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.206+0000 7f2cc412b700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2cbc07fa80 0x7f2cbc12a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:31.212 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.206+0000 7f2cc412b700 1 --2- 172.21.15.42:0/2209861062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cbc0ab230 0x7f2cbc12a640 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:31.212 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.206+0000 7f2cc412b700 1 -- 172.21.15.42:0/2209861062 >> 172.21.15.42:0/2209861062 conn(0x7f2cbc09dc40 msgr2=0x7f2cbc0a4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:31.212 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.206+0000 7f2cc412b700 1 -- 172.21.15.42:0/2209861062 shutdown_connections 2020-04-02T23:24:31.213 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:31.206+0000 7f2cc412b700 1 -- 172.21.15.42:0/2209861062 wait complete. 2020-04-02T23:24:31.218 INFO:tasks.ceph.osd.4:Restarting daemon 2020-04-02T23:24:31.218 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:31.234 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-04-02T23:24:31.277 INFO:tasks.ceph.osd.4:Started 2020-04-02T23:24:31.277 INFO:tasks.ceph.osd.5:Restarting daemon 2020-04-02T23:24:31.277 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:31.293 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-04-02T23:24:31.336 INFO:tasks.ceph.osd.5:Started 2020-04-02T23:24:31.336 INFO:tasks.ceph.osd.6:Restarting daemon 2020-04-02T23:24:31.337 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:31.352 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-04-02T23:24:31.394 INFO:tasks.ceph.osd.6:Started 2020-04-02T23:24:31.394 INFO:tasks.ceph.osd.7:Restarting daemon 2020-04-02T23:24:31.395 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:31.411 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-04-02T23:24:31.454 INFO:tasks.ceph.osd.7:Started 2020-04-02T23:24:31.454 INFO:tasks.ceph.osd.0:Restarting daemon 2020-04-02T23:24:31.454 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:31.469 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-04-02T23:24:31.511 INFO:tasks.ceph.osd.0:Started 2020-04-02T23:24:31.511 INFO:tasks.ceph.osd.1:Restarting daemon 2020-04-02T23:24:31.511 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:31.526 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-04-02T23:24:31.568 INFO:tasks.ceph.osd.1:Started 2020-04-02T23:24:31.568 INFO:tasks.ceph.osd.2:Restarting daemon 2020-04-02T23:24:31.568 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:31.583 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-04-02T23:24:31.625 INFO:tasks.ceph.osd.2:Started 2020-04-02T23:24:31.625 INFO:tasks.ceph.osd.3:Restarting daemon 2020-04-02T23:24:31.625 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:31.640 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-04-02T23:24:31.689 INFO:tasks.ceph.osd.3:Started 2020-04-02T23:24:31.689 INFO:tasks.ceph:Waiting for OSDs to come up 2020-04-02T23:24:31.876 INFO:tasks.ceph.osd.4.smithi084.stderr:2020-04-02T23:24:31.874+0000 7f2bb91eeec0 -1 Falling back to public interface 2020-04-02T23:24:31.931 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-02T23:24:31.929+0000 7fe9741e4ec0 -1 Falling back to public interface 2020-04-02T23:24:31.984 INFO:tasks.ceph.osd.6.smithi084.stderr:2020-04-02T23:24:31.982+0000 7fd2de9beec0 -1 Falling back to public interface 2020-04-02T23:24:32.040 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-02T23:24:32.038+0000 7f5cd9282ec0 -1 Falling back to public interface 2020-04-02T23:24:32.113 INFO:tasks.ceph.osd.0.smithi042.stderr:2020-04-02T23:24:32.111+0000 7f3e142f4ec0 -1 Falling back to public interface 2020-04-02T23:24:32.165 INFO:tasks.ceph.osd.1.smithi042.stderr:2020-04-02T23:24:32.163+0000 7f0f60be7ec0 -1 Falling back to public interface 2020-04-02T23:24:32.221 INFO:tasks.ceph.osd.2.smithi042.stderr:2020-04-02T23:24:32.220+0000 7f71b724dec0 -1 Falling back to public interface 2020-04-02T23:24:32.281 INFO:tasks.ceph.osd.3.smithi042.stderr:2020-04-02T23:24:32.278+0000 7f9de3b4eec0 -1 Falling back to public interface 2020-04-02T23:24:32.496 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:32.512 INFO:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-04-02T23:24:32.653 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.648+0000 7f9b1d1a9700 1 Processor -- start 2020-04-02T23:24:32.653 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.648+0000 7f9b1d1a9700 1 -- start start 2020-04-02T23:24:32.653 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1d1a9700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9b180aaa00 0x7f9b180a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:32.654 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1d1a9700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b180a7880 0x7f9b180a7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:32.654 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1d1a9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b180a2c80 con 0x7f9b180a5e80 2020-04-02T23:24:32.654 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1d1a9700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b180a6d40 con 0x7f9b180aaa00 2020-04-02T23:24:32.655 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1d1a9700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b180a5040 con 0x7f9b180a7880 2020-04-02T23:24:32.656 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1759e700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9b180aaa00 0x7f9b180a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:32.656 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1759e700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9b180aaa00 0x7f9b180a5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39376/0 (socket says 172.21.15.42:39376) 2020-04-02T23:24:32.656 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1759e700 1 -- 172.21.15.42:0/3688512881 learned_addr learned my addr 172.21.15.42:0/3688512881 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:32.656 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1c9a8700 1 --2- 172.21.15.42:0/3688512881 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b180a7880 0x7f9b180a7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:32.656 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1759e700 1 -- 172.21.15.42:0/3688512881 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b180a7880 msgr2=0x7f9b180a7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:32.656 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1759e700 1 --2- 172.21.15.42:0/3688512881 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b180a7880 0x7f9b180a7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:32.656 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1759e700 1 -- 172.21.15.42:0/3688512881 >> v1:172.21.15.84:6789/0 conn(0x7f9b180a5e80 legacy=0x7f9b180a7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:32.658 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1759e700 1 -- 172.21.15.42:0/3688512881 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b180a6f90 con 0x7f9b180aaa00 2020-04-02T23:24:32.659 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1759e700 1 --2- 172.21.15.42:0/3688512881 >> v2:172.21.15.42:3300/0 conn(0x7f9b180aaa00 0x7f9b180a5a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9b180a5460 tx=0x7f9b080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:32.659 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1759e700 1 --2- 172.21.15.42:0/3688512881 >> v2:172.21.15.42:3300/0 conn(0x7f9b180aaa00 0x7f9b180a5a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9b180a5460 tx=0x7f9b080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:32.659 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1759e700 1 --2- 172.21.15.42:0/3688512881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b180aaa00 0x7f9b180a5a20 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f9b180a5460 tx=0x7f9b080088e0).ready entity=mon.0 client_cookie=72f33f41b3b08b96 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:32.659 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1759e700 1 --2- 172.21.15.42:0/3688512881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b180aaa00 0x7f9b180a5a20 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f9b180a5460 tx=0x7f9b080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:32.660 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1759e700 1 --2- 172.21.15.42:0/3688512881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b180aaa00 0x7f9b180a5a20 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f9b180a5460 tx=0x7f9b080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:32.660 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b16d9d700 1 -- 172.21.15.42:0/3688512881 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b08011670 con 0x7f9b180aaa00 2020-04-02T23:24:32.660 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1759e700 1 --2- 172.21.15.42:0/3688512881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b180aaa00 0x7f9b180a5a20 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f9b180a5460 tx=0x7f9b080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:32.660 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b16d9d700 1 -- 172.21.15.42:0/3688512881 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b080117d0 con 0x7f9b180aaa00 2020-04-02T23:24:32.660 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b16d9d700 1 -- 172.21.15.42:0/3688512881 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b08011bf0 con 0x7f9b180aaa00 2020-04-02T23:24:32.660 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1d1a9700 1 -- 172.21.15.42:0/3688512881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b180aaa00 msgr2=0x7f9b180a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:32.660 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.649+0000 7f9b1d1a9700 1 --2- 172.21.15.42:0/3688512881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b180aaa00 0x7f9b180a5a20 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f9b180a5460 tx=0x7f9b080088e0).stop 2020-04-02T23:24:32.661 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.650+0000 7f9b1d1a9700 1 -- 172.21.15.42:0/3688512881 shutdown_connections 2020-04-02T23:24:32.661 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.650+0000 7f9b1d1a9700 1 --2- 172.21.15.42:0/3688512881 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b180a7880 0x7f9b180a7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:32.661 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.650+0000 7f9b1d1a9700 1 --2- 172.21.15.42:0/3688512881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b180aaa00 0x7f9b180a5a20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:32.662 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.650+0000 7f9b1d1a9700 1 -- 172.21.15.42:0/3688512881 >> 172.21.15.42:0/3688512881 conn(0x7f9b1805bea0 msgr2=0x7f9b1805c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:32.662 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.650+0000 7f9b1d1a9700 1 -- 172.21.15.42:0/3688512881 shutdown_connections 2020-04-02T23:24:32.662 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.650+0000 7f9b1d1a9700 1 -- 172.21.15.42:0/3688512881 wait complete. 2020-04-02T23:24:32.662 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.651+0000 7f9b1d1a9700 1 Processor -- start 2020-04-02T23:24:32.662 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.651+0000 7f9b1d1a9700 1 -- start start 2020-04-02T23:24:32.665 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b1d1a9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b180a5e80 0x7f9b18062ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:32.666 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b1d1a9700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1807fd20 con 0x7f9b180aaa00 2020-04-02T23:24:32.666 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b1d1a9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b180633c0 con 0x7f9b180a7880 2020-04-02T23:24:32.666 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b1d1a9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b18064be0 con 0x7f9b180a5e80 2020-04-02T23:24:32.666 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b1c9a8700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f9b180aaa00 0x7f9b18066650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:58808/0 (socket says 172.21.15.42:58808) 2020-04-02T23:24:32.672 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b1c9a8700 1 -- 172.21.15.42:0/86330168 learned_addr learned my addr 172.21.15.42:0/86330168 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:32.672 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b1759e700 1 --2- 172.21.15.42:0/86330168 >> v2:172.21.15.84:3300/0 conn(0x7f9b180a5e80 0x7f9b18062ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:32.672 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b14d99700 1 -- 172.21.15.42:0/86330168 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212464933 0 0) 0x7f9b10001210 con 0x7f9b180aaa00 2020-04-02T23:24:32.673 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b14d99700 1 -- 172.21.15.42:0/86330168 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9afc003230 con 0x7f9b180aaa00 2020-04-02T23:24:32.673 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b1759e700 1 -- 172.21.15.42:0/86330168 >> v1:172.21.15.84:6789/0 conn(0x7f9b180a7880 legacy=0x7f9b18134d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:32.673 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b14d99700 1 -- 172.21.15.42:0/86330168 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564461674 0 0) 0x7f9b180633c0 con 0x7f9b180a7880 2020-04-02T23:24:32.673 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b1759e700 1 -- 172.21.15.42:0/86330168 >> v1:172.21.15.42:6789/0 conn(0x7f9b180aaa00 legacy=0x7f9b18066650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:32.673 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b1759e700 1 -- 172.21.15.42:0/86330168 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b18063660 con 0x7f9b180a5e80 2020-04-02T23:24:32.673 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b1759e700 1 --2- 172.21.15.42:0/86330168 >> v2:172.21.15.84:3300/0 conn(0x7f9b180a5e80 0x7f9b18062ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b180a5460 tx=0x7f9b1805cb70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:32.673 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b1759e700 1 --2- 172.21.15.42:0/86330168 >> v2:172.21.15.84:3300/0 conn(0x7f9b180a5e80 0x7f9b18062ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b180a5460 tx=0x7f9b1805cb70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:32.674 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b1759e700 1 --2- 172.21.15.42:0/86330168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b180a5e80 0x7f9b18062ea0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f9b180a5460 tx=0x7f9b1805cb70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:32.674 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b1759e700 1 --2- 172.21.15.42:0/86330168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b180a5e80 0x7f9b18062ea0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f9b180a5460 tx=0x7f9b1805cb70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:32.674 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b14d99700 1 -- 172.21.15.42:0/86330168 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b08011cb0 con 0x7f9b180a5e80 2020-04-02T23:24:32.674 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b1759e700 1 --2- 172.21.15.42:0/86330168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b180a5e80 0x7f9b18062ea0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f9b180a5460 tx=0x7f9b1805cb70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:32.674 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b1759e700 1 --2- 172.21.15.42:0/86330168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b180a5e80 0x7f9b18062ea0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f9b180a5460 tx=0x7f9b1805cb70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:32.674 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b14d99700 1 -- 172.21.15.42:0/86330168 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0800f910 con 0x7f9b180a5e80 2020-04-02T23:24:32.675 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b1d1a9700 1 -- 172.21.15.42:0/86330168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b18064dd0 con 0x7f9b180a5e80 2020-04-02T23:24:32.675 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b14d99700 1 -- 172.21.15.42:0/86330168 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b08005aa0 con 0x7f9b180a5e80 2020-04-02T23:24:32.675 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.652+0000 7f9b1d1a9700 1 -- 172.21.15.42:0/86330168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b18066d60 con 0x7f9b180a5e80 2020-04-02T23:24:32.675 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.653+0000 7f9b1759e700 1 --2- 172.21.15.42:0/86330168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b180a5e80 0x7f9b18062ea0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f9b180a5460 tx=0x7f9b1805cb70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:32.675 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.653+0000 7f9b1d1a9700 1 -- 172.21.15.42:0/86330168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b18056c50 con 0x7f9b180a5e80 2020-04-02T23:24:32.675 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.653+0000 7f9b14d99700 1 -- 172.21.15.42:0/86330168 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f9b08005d10 con 0x7f9b180a5e80 2020-04-02T23:24:32.675 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.653+0000 7f9b1759e700 1 --2- 172.21.15.42:0/86330168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b180a5e80 0x7f9b18062ea0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f9b180a5460 tx=0x7f9b1805cb70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:32.676 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.654+0000 7f9b14d99700 1 --2- 172.21.15.42:0/86330168 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9afc04d8d0 0x7f9afc04fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:32.676 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.654+0000 7f9b14d99700 1 -- 172.21.15.42:0/86330168 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2074+0+0 (secure 0 0 0) 0x7f9b08061230 con 0x7f9b180a5e80 2020-04-02T23:24:32.676 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.654+0000 7f9b0ffff700 1 --2- 172.21.15.42:0/86330168 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9afc04d8d0 0x7f9afc04fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:32.676 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.654+0000 7f9b0ffff700 1 --2- 172.21.15.42:0/86330168 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9afc04d8d0 0x7f9afc04fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b00002230 tx=0x7f9b000027a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:32.676 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.654+0000 7f9b0ffff700 1 --2- 172.21.15.42:0/86330168 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9afc04d8d0 0x7f9afc04fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b00002230 tx=0x7f9b000027a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:32.676 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.654+0000 7f9b0ffff700 1 --2- 172.21.15.42:0/86330168 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9afc04d8d0 0x7f9afc04fd90 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f9b00002230 tx=0x7f9b000027a0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:32.676 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.657+0000 7f9b1759e700 1 --2- 172.21.15.42:0/86330168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b180a5e80 0x7f9b18062ea0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f9b180a5460 tx=0x7f9b1805cb70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:32.677 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.657+0000 7f9b14d99700 1 -- 172.21.15.42:0/86330168 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f9b0803ca50 con 0x7f9b180a5e80 2020-04-02T23:24:32.810 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.806+0000 7f9b1d1a9700 1 -- 172.21.15.42:0/86330168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b18064fd0 con 0x7f9b180a5e80 2020-04-02T23:24:32.810 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.807+0000 7f9b1759e700 1 --2- 172.21.15.42:0/86330168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b180a5e80 0x7f9b18062ea0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f9b180a5460 tx=0x7f9b1805cb70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:32.811 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.807+0000 7f9b14d99700 1 -- 172.21.15.42:0/86330168 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+8274 (secure 0 0 0) 0x7f9b08040070 con 0x7f9b180a5e80 2020-04-02T23:24:32.811 INFO:teuthology.misc.health.smithi042.stdout: 2020-04-02T23:24:32.811 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":11,"fsid":"571c521c-9ca7-4052-ba5b-7a77e18ff12c","created":"2020-04-02T23:24:23.980442+0000","modified":"2020-04-02T23:24:31.202991+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:24:27.091980+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"4","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"976aac36-1cf8-408b-bf56-9f0eefe43b06","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"22c1e489-ab99-4205-ba9d-fbfc144d2a8d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f0b18b09-93c0-4286-8d15-746611ba53cd","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"989d4a69-9abe-44de-95f2-6c7cbbe07471","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b1a2ce60-ae80-4f8a-97a3-4fbb1399fdfe","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"396b36e5-7226-4e8e-aa8a-749cb5cec101","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"884bb915-28c3-463d-8046-e2908f6e8e96","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"70e90d1d-f081-4de5-af4b-e987c159e597","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:24:32.812 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.808+0000 7f9b1d1a9700 1 -- 172.21.15.42:0/86330168 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9afc04d8d0 msgr2=0x7f9afc04fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:32.812 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.808+0000 7f9b1d1a9700 1 --2- 172.21.15.42:0/86330168 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9afc04d8d0 0x7f9afc04fd90 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f9b00002230 tx=0x7f9b000027a0).stop 2020-04-02T23:24:32.812 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.808+0000 7f9b1d1a9700 1 -- 172.21.15.42:0/86330168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b180a5e80 msgr2=0x7f9b18062ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:32.812 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.808+0000 7f9b1d1a9700 1 --2- 172.21.15.42:0/86330168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b180a5e80 0x7f9b18062ea0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f9b180a5460 tx=0x7f9b1805cb70).stop 2020-04-02T23:24:32.812 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.808+0000 7f9b1d1a9700 1 -- 172.21.15.42:0/86330168 shutdown_connections 2020-04-02T23:24:32.813 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.808+0000 7f9b1d1a9700 1 --2- 172.21.15.42:0/86330168 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9afc04d8d0 0x7f9afc04fd90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:32.813 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.808+0000 7f9b1d1a9700 1 --2- 172.21.15.42:0/86330168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b180a5e80 0x7f9b18062ea0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:32.813 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.808+0000 7f9b1d1a9700 1 -- 172.21.15.42:0/86330168 >> 172.21.15.42:0/86330168 conn(0x7f9b1805bea0 msgr2=0x7f9b18069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:32.813 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.808+0000 7f9b1d1a9700 1 -- 172.21.15.42:0/86330168 shutdown_connections 2020-04-02T23:24:32.813 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:32.808+0000 7f9b1d1a9700 1 -- 172.21.15.42:0/86330168 wait complete. 2020-04-02T23:24:32.820 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-04-02T23:24:32.941 INFO:tasks.ceph.osd.4.smithi084.stderr:2020-04-02T23:24:32.939+0000 7f2bb91eeec0 -1 osd.4 0 log_to_monitors {default=true} 2020-04-02T23:24:32.999 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-02T23:24:32.997+0000 7fe9741e4ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-04-02T23:24:33.047 INFO:tasks.ceph.osd.6.smithi084.stderr:2020-04-02T23:24:33.045+0000 7fd2de9beec0 -1 osd.6 0 log_to_monitors {default=true} 2020-04-02T23:24:33.111 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-02T23:24:33.109+0000 7f5cd9282ec0 -1 osd.7 0 log_to_monitors {default=true} 2020-04-02T23:24:33.175 INFO:tasks.ceph.osd.0.smithi042.stderr:2020-04-02T23:24:33.173+0000 7f3e142f4ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-04-02T23:24:33.228 INFO:tasks.ceph.osd.1.smithi042.stderr:2020-04-02T23:24:33.226+0000 7f0f60be7ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-04-02T23:24:33.292 INFO:tasks.ceph.osd.2.smithi042.stderr:2020-04-02T23:24:33.290+0000 7f71b724dec0 -1 osd.2 0 log_to_monitors {default=true} 2020-04-02T23:24:33.348 INFO:tasks.ceph.osd.3.smithi042.stderr:2020-04-02T23:24:33.346+0000 7f9de3b4eec0 -1 osd.3 0 log_to_monitors {default=true} 2020-04-02T23:24:34.100 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-02T23:24:34.098+0000 7fe95c9ae700 -1 osd.5 0 waiting for initial osdmap 2020-04-02T23:24:34.102 INFO:tasks.ceph.osd.4.smithi084.stderr:2020-04-02T23:24:34.100+0000 7f2ba19b8700 -1 osd.4 0 waiting for initial osdmap 2020-04-02T23:24:34.102 INFO:tasks.ceph.osd.6.smithi084.stderr:2020-04-02T23:24:34.099+0000 7fd2c7188700 -1 osd.6 0 waiting for initial osdmap 2020-04-02T23:24:35.098 INFO:tasks.ceph.osd.0.smithi042.stderr:2020-04-02T23:24:35.096+0000 7f3dfcabe700 -1 osd.0 0 waiting for initial osdmap 2020-04-02T23:24:35.099 INFO:tasks.ceph.osd.1.smithi042.stderr:2020-04-02T23:24:35.097+0000 7f0f493b1700 -1 osd.1 0 waiting for initial osdmap 2020-04-02T23:24:35.099 INFO:tasks.ceph.osd.3.smithi042.stderr:2020-04-02T23:24:35.097+0000 7f9dcc318700 -1 osd.3 0 waiting for initial osdmap 2020-04-02T23:24:35.100 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-02T23:24:35.098+0000 7f5cc1a4c700 -1 osd.7 0 waiting for initial osdmap 2020-04-02T23:24:35.104 INFO:tasks.ceph.osd.2.smithi042.stderr:2020-04-02T23:24:35.100+0000 7f719fa17700 -1 osd.2 0 waiting for initial osdmap 2020-04-02T23:24:38.842 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:38.859 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:24:38.902 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:38.919 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:24:39.627 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:39.644 INFO:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-04-02T23:24:39.796 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.791+0000 7f1e82b98700 1 Processor -- start 2020-04-02T23:24:39.796 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.791+0000 7f1e82b98700 1 -- start start 2020-04-02T23:24:39.796 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.792+0000 7f1e82b98700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1e7c0a6130 0x7f1e7c14cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:39.797 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.792+0000 7f1e82b98700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1e7c14d320 0x7f1e7c14f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:39.797 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.792+0000 7f1e82b98700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7c0a2c80 con 0x7f1e7c0aaa00 2020-04-02T23:24:39.797 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.792+0000 7f1e82b98700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7c0a6d40 con 0x7f1e7c0a6130 2020-04-02T23:24:39.797 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.792+0000 7f1e82b98700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7c0a5040 con 0x7f1e7c14d320 2020-04-02T23:24:39.797 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.792+0000 7f1e80934700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1e7c0a6130 0x7f1e7c14cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:39.797 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.792+0000 7f1e80934700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1e7c0a6130 0x7f1e7c14cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39606/0 (socket says 172.21.15.42:39606) 2020-04-02T23:24:39.797 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.792+0000 7f1e80934700 1 -- 172.21.15.42:0/1970373735 learned_addr learned my addr 172.21.15.42:0/1970373735 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:39.798 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.792+0000 7f1e81936700 1 --2- 172.21.15.42:0/1970373735 >> v2:172.21.15.84:3300/0 conn(0x7f1e7c14d320 0x7f1e7c14f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:39.798 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.792+0000 7f1e80934700 1 -- 172.21.15.42:0/1970373735 >> v2:172.21.15.84:3300/0 conn(0x7f1e7c14d320 msgr2=0x7f1e7c14f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:39.798 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.792+0000 7f1e80934700 1 --2- 172.21.15.42:0/1970373735 >> v2:172.21.15.84:3300/0 conn(0x7f1e7c14d320 0x7f1e7c14f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:39.798 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.792+0000 7f1e80934700 1 -- 172.21.15.42:0/1970373735 >> v1:172.21.15.84:6789/0 conn(0x7f1e7c0aaa00 legacy=0x7f1e7c0a5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:39.798 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.792+0000 7f1e80934700 1 -- 172.21.15.42:0/1970373735 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c0a6f90 con 0x7f1e7c0a6130 2020-04-02T23:24:39.798 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.792+0000 7f1e81936700 1 --2- 172.21.15.42:0/1970373735 >> v2:172.21.15.84:3300/0 conn(0x7f1e7c14d320 0x7f1e7c14f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:24:39.798 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.792+0000 7f1e80934700 1 --2- 172.21.15.42:0/1970373735 >> v2:172.21.15.42:3300/0 conn(0x7f1e7c0a6130 0x7f1e7c14cec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1e6c002f30 tx=0x7f1e6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:39.798 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.792+0000 7f1e80934700 1 --2- 172.21.15.42:0/1970373735 >> v2:172.21.15.42:3300/0 conn(0x7f1e7c0a6130 0x7f1e7c14cec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1e6c002f30 tx=0x7f1e6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:39.799 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.792+0000 7f1e80934700 1 --2- 172.21.15.42:0/1970373735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e7c0a6130 0x7f1e7c14cec0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f1e6c002f30 tx=0x7f1e6c007a40).ready entity=mon.0 client_cookie=9ca33cfb4f66bf6a server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:39.799 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.793+0000 7f1e80934700 1 --2- 172.21.15.42:0/1970373735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e7c0a6130 0x7f1e7c14cec0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f1e6c002f30 tx=0x7f1e6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:39.799 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.793+0000 7f1e73fff700 1 -- 172.21.15.42:0/1970373735 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e6c011720 con 0x7f1e7c0a6130 2020-04-02T23:24:39.799 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.793+0000 7f1e80934700 1 --2- 172.21.15.42:0/1970373735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e7c0a6130 0x7f1e7c14cec0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f1e6c002f30 tx=0x7f1e6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:39.799 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.793+0000 7f1e80934700 1 --2- 172.21.15.42:0/1970373735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e7c0a6130 0x7f1e7c14cec0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f1e6c002f30 tx=0x7f1e6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:39.799 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.793+0000 7f1e73fff700 1 -- 172.21.15.42:0/1970373735 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c011880 con 0x7f1e7c0a6130 2020-04-02T23:24:39.799 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.793+0000 7f1e73fff700 1 -- 172.21.15.42:0/1970373735 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e6c011c60 con 0x7f1e7c0a6130 2020-04-02T23:24:39.800 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.793+0000 7f1e82b98700 1 -- 172.21.15.42:0/1970373735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e7c0a6130 msgr2=0x7f1e7c14cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:39.800 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.793+0000 7f1e82b98700 1 --2- 172.21.15.42:0/1970373735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e7c0a6130 0x7f1e7c14cec0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f1e6c002f30 tx=0x7f1e6c007a40).stop 2020-04-02T23:24:39.800 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.793+0000 7f1e82b98700 1 -- 172.21.15.42:0/1970373735 shutdown_connections 2020-04-02T23:24:39.800 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.793+0000 7f1e82b98700 1 --2- 172.21.15.42:0/1970373735 >> v2:172.21.15.84:3300/0 conn(0x7f1e7c14d320 0x7f1e7c14f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:39.800 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.793+0000 7f1e82b98700 1 --2- 172.21.15.42:0/1970373735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e7c0a6130 0x7f1e7c14cec0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:39.800 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.793+0000 7f1e82b98700 1 -- 172.21.15.42:0/1970373735 >> 172.21.15.42:0/1970373735 conn(0x7f1e7c05bea0 msgr2=0x7f1e7c05c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:39.800 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.793+0000 7f1e82b98700 1 -- 172.21.15.42:0/1970373735 shutdown_connections 2020-04-02T23:24:39.801 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.793+0000 7f1e82b98700 1 -- 172.21.15.42:0/1970373735 wait complete. 2020-04-02T23:24:39.804 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.794+0000 7f1e82b98700 1 Processor -- start 2020-04-02T23:24:39.804 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.794+0000 7f1e82b98700 1 -- start start 2020-04-02T23:24:39.804 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.795+0000 7f1e82b98700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1e7c0a6130 0x7f1e7c132bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:39.806 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.795+0000 7f1e82b98700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1e7c14d320 0x7f1e7c07f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:39.806 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.795+0000 7f1e82b98700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7c0a42d0 con 0x7f1e7c0aaa00 2020-04-02T23:24:39.807 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.795+0000 7f1e82b98700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7c065460 con 0x7f1e7c0a6130 2020-04-02T23:24:39.807 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.795+0000 7f1e82b98700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7c065700 con 0x7f1e7c14d320 2020-04-02T23:24:39.807 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.795+0000 7f1e81135700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1e7c0a6130 0x7f1e7c132bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:39.807 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.795+0000 7f1e81135700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1e7c0a6130 0x7f1e7c132bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39610/0 (socket says 172.21.15.42:39610) 2020-04-02T23:24:39.807 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.795+0000 7f1e80934700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f1e7c0aaa00 0x7f1e7c07ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59036/0 (socket says 172.21.15.42:59036) 2020-04-02T23:24:39.807 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.795+0000 7f1e81135700 1 -- 172.21.15.42:0/790478802 learned_addr learned my addr 172.21.15.42:0/790478802 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:39.807 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.795+0000 7f1e81936700 1 --2- 172.21.15.42:0/790478802 >> v2:172.21.15.84:3300/0 conn(0x7f1e7c14d320 0x7f1e7c07f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:39.808 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.796+0000 7f1e81135700 1 -- 172.21.15.42:0/790478802 >> v2:172.21.15.84:3300/0 conn(0x7f1e7c14d320 msgr2=0x7f1e7c07f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:39.808 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.796+0000 7f1e81135700 1 --2- 172.21.15.42:0/790478802 >> v2:172.21.15.84:3300/0 conn(0x7f1e7c14d320 0x7f1e7c07f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:39.808 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.796+0000 7f1e81135700 1 -- 172.21.15.42:0/790478802 >> v1:172.21.15.42:6789/0 conn(0x7f1e7c0aaa00 legacy=0x7f1e7c07ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:39.808 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.796+0000 7f1e81135700 1 -- 172.21.15.42:0/790478802 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c1326f0 con 0x7f1e7c0a6130 2020-04-02T23:24:39.808 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.796+0000 7f1e71ffb700 1 -- 172.21.15.42:0/790478802 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315598127 0 0) 0x7f1e7c0a42d0 con 0x7f1e7c0aaa00 2020-04-02T23:24:39.808 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.796+0000 7f1e81135700 1 --2- 172.21.15.42:0/790478802 >> v2:172.21.15.42:3300/0 conn(0x7f1e7c0a6130 0x7f1e7c132bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1e7c0a5900 tx=0x7f1e7800c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:39.809 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.796+0000 7f1e81135700 1 --2- 172.21.15.42:0/790478802 >> v2:172.21.15.42:3300/0 conn(0x7f1e7c0a6130 0x7f1e7c132bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1e7c0a5900 tx=0x7f1e7800c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:39.809 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.796+0000 7f1e81135700 1 --2- 172.21.15.42:0/790478802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e7c0a6130 0x7f1e7c132bc0 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f1e7c0a5900 tx=0x7f1e7800c460).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:39.809 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.796+0000 7f1e81135700 1 --2- 172.21.15.42:0/790478802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e7c0a6130 0x7f1e7c132bc0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f1e7c0a5900 tx=0x7f1e7800c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:39.809 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.796+0000 7f1e71ffb700 1 -- 172.21.15.42:0/790478802 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e7800cc20 con 0x7f1e7c0a6130 2020-04-02T23:24:39.809 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.796+0000 7f1e81135700 1 --2- 172.21.15.42:0/790478802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e7c0a6130 0x7f1e7c132bc0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f1e7c0a5900 tx=0x7f1e7800c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:39.810 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.796+0000 7f1e81135700 1 --2- 172.21.15.42:0/790478802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e7c0a6130 0x7f1e7c132bc0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f1e7c0a5900 tx=0x7f1e7800c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:39.810 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.796+0000 7f1e71ffb700 1 -- 172.21.15.42:0/790478802 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7800cd80 con 0x7f1e7c0a6130 2020-04-02T23:24:39.810 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.796+0000 7f1e71ffb700 1 -- 172.21.15.42:0/790478802 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e78011170 con 0x7f1e7c0a6130 2020-04-02T23:24:39.810 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.796+0000 7f1e82b98700 1 -- 172.21.15.42:0/790478802 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7c09dec0 con 0x7f1e7c0a6130 2020-04-02T23:24:39.810 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.796+0000 7f1e82b98700 1 -- 172.21.15.42:0/790478802 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7c064f80 con 0x7f1e7c0a6130 2020-04-02T23:24:39.810 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.797+0000 7f1e81135700 1 --2- 172.21.15.42:0/790478802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e7c0a6130 0x7f1e7c132bc0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f1e7c0a5900 tx=0x7f1e7800c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:39.811 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.797+0000 7f1e82b98700 1 -- 172.21.15.42:0/790478802 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7c1328e0 con 0x7f1e7c0a6130 2020-04-02T23:24:39.811 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.797+0000 7f1e71ffb700 1 -- 172.21.15.42:0/790478802 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f1e780064e0 con 0x7f1e7c0a6130 2020-04-02T23:24:39.811 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.797+0000 7f1e81135700 1 --2- 172.21.15.42:0/790478802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e7c0a6130 0x7f1e7c132bc0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f1e7c0a5900 tx=0x7f1e7800c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:39.811 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.797+0000 7f1e71ffb700 1 --2- 172.21.15.42:0/790478802 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1e5c04d4f0 0x7f1e5c04f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:39.812 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.797+0000 7f1e71ffb700 1 -- 172.21.15.42:0/790478802 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f1e78060aa0 con 0x7f1e7c0a6130 2020-04-02T23:24:39.812 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.798+0000 7f1e80934700 1 --2- 172.21.15.42:0/790478802 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1e5c04d4f0 0x7f1e5c04f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:39.812 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.798+0000 7f1e80934700 1 --2- 172.21.15.42:0/790478802 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1e5c04d4f0 0x7f1e5c04f9b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1e6c002ed0 tx=0x7f1e6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:39.812 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.798+0000 7f1e80934700 1 --2- 172.21.15.42:0/790478802 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1e5c04d4f0 0x7f1e5c04f9b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1e6c002ed0 tx=0x7f1e6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:39.812 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.798+0000 7f1e80934700 1 --2- 172.21.15.42:0/790478802 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1e5c04d4f0 0x7f1e5c04f9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f1e6c002ed0 tx=0x7f1e6c007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:39.812 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.801+0000 7f1e81135700 1 --2- 172.21.15.42:0/790478802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e7c0a6130 0x7f1e7c132bc0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f1e7c0a5900 tx=0x7f1e7800c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:39.813 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.801+0000 7f1e71ffb700 1 -- 172.21.15.42:0/790478802 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f1e7803c200 con 0x7f1e7c0a6130 2020-04-02T23:24:39.949 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.947+0000 7f1e82b98700 1 -- 172.21.15.42:0/790478802 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e7c065290 con 0x7f1e7c0a6130 2020-04-02T23:24:39.950 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.948+0000 7f1e81135700 1 --2- 172.21.15.42:0/790478802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e7c0a6130 0x7f1e7c132bc0 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f1e7c0a5900 tx=0x7f1e7800c460).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:39.950 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.948+0000 7f1e71ffb700 1 -- 172.21.15.42:0/790478802 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11806 (secure 0 0 0) 0x7f1e7803f820 con 0x7f1e7c0a6130 2020-04-02T23:24:39.950 INFO:teuthology.misc.health.smithi042.stdout: 2020-04-02T23:24:39.950 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":17,"fsid":"571c521c-9ca7-4052-ba5b-7a77e18ff12c","created":"2020-04-02T23:24:23.980442+0000","modified":"2020-04-02T23:24:38.107992+0000","last_up_change":"2020-04-02T23:24:36.096260+0000","last_in_change":"2020-04-02T23:24:36.096260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:24:27.091980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"976aac36-1cf8-408b-bf56-9f0eefe43b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":24836},{"type":"v1","addr":"172.21.15.42:6801","nonce":24836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":24836},{"type":"v1","addr":"172.21.15.42:6803","nonce":24836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":24836},{"type":"v1","addr":"172.21.15.42:6807","nonce":24836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":24836},{"type":"v1","addr":"172.21.15.42:6805","nonce":24836}]},"public_addr":"172.21.15.42:6801/24836","cluster_addr":"172.21.15.42:6803/24836","heartbeat_back_addr":"172.21.15.42:6807/24836","heartbeat_front_addr":"172.21.15.42:6805/24836","state":["exists","up"]},{"osd":1,"uuid":"22c1e489-ab99-4205-ba9d-fbfc144d2a8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":24881},{"type":"v1","addr":"172.21.15.42:6809","nonce":24881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":24881},{"type":"v1","addr":"172.21.15.42:6811","nonce":24881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":24881},{"type":"v1","addr":"172.21.15.42:6815","nonce":24881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":24881},{"type":"v1","addr":"172.21.15.42:6813","nonce":24881}]},"public_addr":"172.21.15.42:6809/24881","cluster_addr":"172.21.15.42:6811/24881","heartbeat_back_addr":"172.21.15.42:6815/24881","heartbeat_front_addr":"172.21.15.42:6813/24881","state":["exists","up"]},{"osd":2,"uuid":"f0b18b09-93c0-4286-8d15-746611ba53cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":24917},{"type":"v1","addr":"172.21.15.42:6817","nonce":24917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":24917},{"type":"v1","addr":"172.21.15.42:6819","nonce":24917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":24917},{"type":"v1","addr":"172.21.15.42:6823","nonce":24917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":24917},{"type":"v1","addr":"172.21.15.42:6821","nonce":24917}]},"public_addr":"172.21.15.42:6817/24917","cluster_addr":"172.21.15.42:6819/24917","heartbeat_back_addr":"172.21.15.42:6823/24917","heartbeat_front_addr":"172.21.15.42:6821/24917","state":["exists","up"]},{"osd":3,"uuid":"989d4a69-9abe-44de-95f2-6c7cbbe07471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":24940},{"type":"v1","addr":"172.21.15.42:6825","nonce":24940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":24940},{"type":"v1","addr":"172.21.15.42:6827","nonce":24940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":24940},{"type":"v1","addr":"172.21.15.42:6831","nonce":24940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":24940},{"type":"v1","addr":"172.21.15.42:6829","nonce":24940}]},"public_addr":"172.21.15.42:6825/24940","cluster_addr":"172.21.15.42:6827/24940","heartbeat_back_addr":"172.21.15.42:6831/24940","heartbeat_front_addr":"172.21.15.42:6829/24940","state":["exists","up"]},{"osd":4,"uuid":"b1a2ce60-ae80-4f8a-97a3-4fbb1399fdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":24239},{"type":"v1","addr":"172.21.15.84:6803","nonce":24239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":24239},{"type":"v1","addr":"172.21.15.84:6805","nonce":24239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":24239},{"type":"v1","addr":"172.21.15.84:6809","nonce":24239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":24239},{"type":"v1","addr":"172.21.15.84:6807","nonce":24239}]},"public_addr":"172.21.15.84:6803/24239","cluster_addr":"172.21.15.84:6805/24239","heartbeat_back_addr":"172.21.15.84:6809/24239","heartbeat_front_addr":"172.21.15.84:6807/24239","state":["exists","up"]},{"osd":5,"uuid":"396b36e5-7226-4e8e-aa8a-749cb5cec101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":24276},{"type":"v1","addr":"172.21.15.84:6811","nonce":24276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":24276},{"type":"v1","addr":"172.21.15.84:6813","nonce":24276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":24276},{"type":"v1","addr":"172.21.15.84:6817","nonce":24276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":24276},{"type":"v1","addr":"172.21.15.84:6815","nonce":24276}]},"public_addr":"172.21.15.84:6811/24276","cluster_addr":"172.21.15.84:6813/24276","heartbeat_back_addr":"172.21.15.84:6817/24276","heartbeat_front_addr":"172.21.15.84:6815/24276","state":["exists","up"]},{"osd":6,"uuid":"884bb915-28c3-463d-8046-e2908f6e8e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":24319},{"type":"v1","addr":"172.21.15.84:6819","nonce":24319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":24319},{"type":"v1","addr":"172.21.15.84:6821","nonce":24319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":24319},{"type":"v1","addr":"172.21.15.84:6825","nonce":24319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":24319},{"type":"v1","addr":"172.21.15.84:6823","nonce":24319}]},"public_addr":"172.21.15.84:6819/24319","cluster_addr":"172.21.15.84:6821/24319","heartbeat_back_addr":"172.21.15.84:6825/24319","heartbeat_front_addr":"172.21.15.84:6823/24319","state":["exists","up"]},{"osd":7,"uuid":"70e90d1d-f081-4de5-af4b-e987c159e597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":24349},{"type":"v1","addr":"172.21.15.84:6827","nonce":24349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":24349},{"type":"v1","addr":"172.21.15.84:6829","nonce":24349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":24349},{"type":"v1","addr":"172.21.15.84:6833","nonce":24349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":24349},{"type":"v1","addr":"172.21.15.84:6831","nonce":24349}]},"public_addr":"172.21.15.84:6827/24349","cluster_addr":"172.21.15.84:6829/24349","heartbeat_back_addr":"172.21.15.84:6833/24349","heartbeat_front_addr":"172.21.15.84:6831/24349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.195657+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.241354+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.257764+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.368827+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.967296+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.991068+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.077047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.095727+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:24:39.951 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.949+0000 7f1e82b98700 1 -- 172.21.15.42:0/790478802 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1e5c04d4f0 msgr2=0x7f1e5c04f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:39.952 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.949+0000 7f1e82b98700 1 --2- 172.21.15.42:0/790478802 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1e5c04d4f0 0x7f1e5c04f9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f1e6c002ed0 tx=0x7f1e6c007a40).stop 2020-04-02T23:24:39.952 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.949+0000 7f1e82b98700 1 -- 172.21.15.42:0/790478802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e7c0a6130 msgr2=0x7f1e7c132bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:39.952 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.949+0000 7f1e82b98700 1 --2- 172.21.15.42:0/790478802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e7c0a6130 0x7f1e7c132bc0 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f1e7c0a5900 tx=0x7f1e7800c460).stop 2020-04-02T23:24:39.952 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.949+0000 7f1e82b98700 1 -- 172.21.15.42:0/790478802 shutdown_connections 2020-04-02T23:24:39.952 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.949+0000 7f1e82b98700 1 --2- 172.21.15.42:0/790478802 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1e5c04d4f0 0x7f1e5c04f9b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:39.952 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.949+0000 7f1e82b98700 1 --2- 172.21.15.42:0/790478802 >> v2:172.21.15.84:3300/0 conn(0x7f1e7c14d320 0x7f1e7c07f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:39.953 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.949+0000 7f1e82b98700 1 --2- 172.21.15.42:0/790478802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e7c0a6130 0x7f1e7c132bc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:39.953 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.949+0000 7f1e82b98700 1 -- 172.21.15.42:0/790478802 >> 172.21.15.42:0/790478802 conn(0x7f1e7c05bea0 msgr2=0x7f1e7c0a0590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:39.953 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.949+0000 7f1e82b98700 1 -- 172.21.15.42:0/790478802 shutdown_connections 2020-04-02T23:24:39.953 INFO:teuthology.misc.health.smithi042.stderr:2020-04-02T23:24:39.949+0000 7f1e82b98700 1 -- 172.21.15.42:0/790478802 wait complete. 2020-04-02T23:24:39.961 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-04-02T23:24:39.961 INFO:tasks.ceph:Creating RBD pool 2020-04-02T23:24:39.961 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:39.975 INFO:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd pool create rbd 8 2020-04-02T23:24:40.134 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.125+0000 7f1dcccf9700 1 Processor -- start 2020-04-02T23:24:40.135 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.125+0000 7f1dcccf9700 1 -- start start 2020-04-02T23:24:40.135 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.126+0000 7f1dcccf9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1dc80ab230 0x7f1dc80a3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:40.135 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.126+0000 7f1dcccf9700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc80a55c0 con 0x7f1dc8080190 2020-04-02T23:24:40.135 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.126+0000 7f1dcccf9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc80a68c0 con 0x7f1dc8148690 2020-04-02T23:24:40.135 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.126+0000 7f1dcccf9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc8080600 con 0x7f1dc80ab230 2020-04-02T23:24:40.135 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.126+0000 7f1dc759e700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f1dc8080190 0x7f1dc814f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59046/0 (socket says 172.21.15.42:59046) 2020-04-02T23:24:40.136 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.126+0000 7f1dc759e700 1 -- 172.21.15.42:0/1766039535 learned_addr learned my addr 172.21.15.42:0/1766039535 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:40.136 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.126+0000 7f1dc6d9d700 1 --2- 172.21.15.42:0/1766039535 >> v2:172.21.15.84:3300/0 conn(0x7f1dc80ab230 0x7f1dc80a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:40.136 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.126+0000 7f1dc5d9b700 1 -- 172.21.15.42:0/1766039535 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412807599 0 0) 0x7f1dc80a55c0 con 0x7f1dc8080190 2020-04-02T23:24:40.136 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.126+0000 7f1dc5d9b700 1 -- 172.21.15.42:0/1766039535 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1db0003230 con 0x7f1dc8080190 2020-04-02T23:24:40.136 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc5d9b700 1 -- 172.21.15.42:0/1766039535 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2378789619 0 0) 0x7f1db0003230 con 0x7f1dc8080190 2020-04-02T23:24:40.136 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc5d9b700 1 -- 172.21.15.42:0/1766039535 >> v2:172.21.15.84:3300/0 conn(0x7f1dc80ab230 msgr2=0x7f1dc80a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:40.136 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc5d9b700 1 --2- 172.21.15.42:0/1766039535 >> v2:172.21.15.84:3300/0 conn(0x7f1dc80ab230 0x7f1dc80a3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:40.137 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc5d9b700 1 -- 172.21.15.42:0/1766039535 >> v1:172.21.15.84:6789/0 conn(0x7f1dc8148690 legacy=0x7f1dc807fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:40.137 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc5d9b700 1 -- 172.21.15.42:0/1766039535 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc80a6b60 con 0x7f1dc8080190 2020-04-02T23:24:40.137 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc5d9b700 1 -- 172.21.15.42:0/1766039535 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7f1dc0001a50 con 0x7f1dc8080190 2020-04-02T23:24:40.137 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc5d9b700 1 -- 172.21.15.42:0/1766039535 >> v1:172.21.15.42:6789/0 conn(0x7f1dc8080190 legacy=0x7f1dc814f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:40.137 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc5d9b700 1 --2- 172.21.15.42:0/1766039535 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1db0003720 0x7f1db0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:40.137 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc5d9b700 1 --2- 172.21.15.42:0/1766039535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 0x7f1db0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:40.137 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc5d9b700 1 --2- 172.21.15.42:0/1766039535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db0004db0 0x7f1db000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc5d9b700 1 -- 172.21.15.42:0/1766039535 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc8080600 con 0x7f1db00044d0 2020-04-02T23:24:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc5d9b700 1 -- 172.21.15.42:0/1766039535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db00041c0 con 0x7f1db0004db0 2020-04-02T23:24:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc5d9b700 1 -- 172.21.15.42:0/1766039535 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db004fb90 con 0x7f1db0003720 2020-04-02T23:24:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc659c700 1 --2- 172.21.15.42:0/1766039535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 0x7f1db0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc6d9d700 1 --2- 172.21.15.42:0/1766039535 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1db0003720 0x7f1db0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc759e700 1 --2- 172.21.15.42:0/1766039535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db0004db0 0x7f1db000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc659c700 1 -- 172.21.15.42:0/1766039535 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1db0003720 msgr2=0x7f1db0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:40.138 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc659c700 1 --2- 172.21.15.42:0/1766039535 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1db0003720 0x7f1db0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:40.139 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc659c700 1 -- 172.21.15.42:0/1766039535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db0004db0 msgr2=0x7f1db000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:40.139 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc659c700 1 --2- 172.21.15.42:0/1766039535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db0004db0 0x7f1db000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:40.139 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc659c700 1 -- 172.21.15.42:0/1766039535 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db0003230 con 0x7f1db00044d0 2020-04-02T23:24:40.139 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc759e700 1 -- 172.21.15.42:0/1766039535 reap_dead start 2020-04-02T23:24:40.139 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc659c700 1 --2- 172.21.15.42:0/1766039535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 0x7f1db0004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1dc809e210 tx=0x7f1dbc00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:40.139 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc659c700 1 --2- 172.21.15.42:0/1766039535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 0x7f1db0004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1dc809e210 tx=0x7f1dbc00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:40.139 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc659c700 1 --2- 172.21.15.42:0/1766039535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 0x7f1db0004950 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f1dc809e210 tx=0x7f1dbc00fcf0).ready entity=mon.0 client_cookie=532448da19c5f8e5 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc659c700 1 --2- 172.21.15.42:0/1766039535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 0x7f1db0004950 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f1dc809e210 tx=0x7f1dbc00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc5d9b700 1 -- 172.21.15.42:0/1766039535 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dbc003540 con 0x7f1db00044d0 2020-04-02T23:24:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc659c700 1 --2- 172.21.15.42:0/1766039535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 0x7f1db0004950 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f1dc809e210 tx=0x7f1dbc00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc5d9b700 1 -- 172.21.15.42:0/1766039535 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc0036a0 con 0x7f1db00044d0 2020-04-02T23:24:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc659c700 1 --2- 172.21.15.42:0/1766039535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 0x7f1db0004950 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f1dc809e210 tx=0x7f1dbc00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dc5d9b700 1 -- 172.21.15.42:0/1766039535 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dbc003a40 con 0x7f1db00044d0 2020-04-02T23:24:40.140 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dcccf9700 1 -- 172.21.15.42:0/1766039535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 msgr2=0x7f1db0004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:40.141 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.127+0000 7f1dcccf9700 1 --2- 172.21.15.42:0/1766039535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 0x7f1db0004950 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f1dc809e210 tx=0x7f1dbc00fcf0).stop 2020-04-02T23:24:40.141 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.128+0000 7f1dcccf9700 1 -- 172.21.15.42:0/1766039535 shutdown_connections 2020-04-02T23:24:40.141 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.128+0000 7f1dcccf9700 1 --2- 172.21.15.42:0/1766039535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 0x7f1db0004950 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:40.141 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.128+0000 7f1dcccf9700 1 -- 172.21.15.42:0/1766039535 >> 172.21.15.42:0/1766039535 conn(0x7f1dc809dc40 msgr2=0x7f1dc80aa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:40.141 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.128+0000 7f1dcccf9700 1 -- 172.21.15.42:0/1766039535 shutdown_connections 2020-04-02T23:24:40.141 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.128+0000 7f1dcccf9700 1 -- 172.21.15.42:0/1766039535 wait complete. 2020-04-02T23:24:40.141 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.129+0000 7f1dcccf9700 1 Processor -- start 2020-04-02T23:24:40.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.129+0000 7f1dcccf9700 1 -- start start 2020-04-02T23:24:40.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dcccf9700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1db00044d0 0x7f1dc80a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:40.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dcccf9700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1dc80a0000 0x7f1dc80a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:40.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dcccf9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc805bc60 con 0x7f1dc80a9fb0 2020-04-02T23:24:40.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dcccf9700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc8064330 con 0x7f1db00044d0 2020-04-02T23:24:40.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dcccf9700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc80645d0 con 0x7f1dc80a0000 2020-04-02T23:24:40.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dc6d9d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1db00044d0 0x7f1dc80a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:40.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dc6d9d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1db00044d0 0x7f1dc80a0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39630/0 (socket says 172.21.15.42:39630) 2020-04-02T23:24:40.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dc6d9d700 1 -- 172.21.15.42:0/3357814892 learned_addr learned my addr 172.21.15.42:0/3357814892 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:40.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dc659c700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1dc80a0000 0x7f1dc80a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:40.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dc6d9d700 1 -- 172.21.15.42:0/3357814892 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1dc80a0000 msgr2=0x7f1dc80a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:40.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dc6d9d700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1dc80a0000 0x7f1dc80a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:40.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dc6d9d700 1 -- 172.21.15.42:0/3357814892 >> v1:172.21.15.84:6789/0 conn(0x7f1dc80a9fb0 legacy=0x7f1dc8126730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:40.144 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dc6d9d700 1 -- 172.21.15.42:0/3357814892 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc8064020 con 0x7f1db00044d0 2020-04-02T23:24:40.144 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dc659c700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1dc80a0000 0x7f1dc80a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:24:40.144 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dc6d9d700 1 --2- 172.21.15.42:0/3357814892 >> v2:172.21.15.42:3300/0 conn(0x7f1db00044d0 0x7f1dc80a0670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1db8003070 tx=0x7f1dc80680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:40.144 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dc6d9d700 1 --2- 172.21.15.42:0/3357814892 >> v2:172.21.15.42:3300/0 conn(0x7f1db00044d0 0x7f1dc80a0670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1db8003070 tx=0x7f1dc80680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:40.144 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dc6d9d700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 0x7f1dc80a0670 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f1db8003070 tx=0x7f1dc80680a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:40.144 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dc6d9d700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 0x7f1dc80a0670 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f1db8003070 tx=0x7f1dc80680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:40.145 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dc6d9d700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 0x7f1dc80a0670 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f1db8003070 tx=0x7f1dc80680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:40.145 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1db77fe700 1 -- 172.21.15.42:0/3357814892 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1db8012a70 con 0x7f1db00044d0 2020-04-02T23:24:40.145 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dc6d9d700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 0x7f1dc80a0670 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f1db8003070 tx=0x7f1dc80680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:40.145 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1db77fe700 1 -- 172.21.15.42:0/3357814892 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db8012bd0 con 0x7f1db00044d0 2020-04-02T23:24:40.145 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1dcccf9700 1 -- 172.21.15.42:0/3357814892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc80a0f30 con 0x7f1db00044d0 2020-04-02T23:24:40.145 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.130+0000 7f1db77fe700 1 -- 172.21.15.42:0/3357814892 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1db80056c0 con 0x7f1db00044d0 2020-04-02T23:24:40.145 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.131+0000 7f1dcccf9700 1 -- 172.21.15.42:0/3357814892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc809f7d0 con 0x7f1db00044d0 2020-04-02T23:24:40.146 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.131+0000 7f1dc6d9d700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 0x7f1dc80a0670 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f1db8003070 tx=0x7f1dc80680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:40.146 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.131+0000 7f1db77fe700 1 -- 172.21.15.42:0/3357814892 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f1db8007180 con 0x7f1db00044d0 2020-04-02T23:24:40.146 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.131+0000 7f1dc6d9d700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 0x7f1dc80a0670 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f1db8003070 tx=0x7f1dc80680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:40.146 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.132+0000 7f1dcccf9700 1 -- 172.21.15.42:0/3357814892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc8056c50 con 0x7f1db00044d0 2020-04-02T23:24:40.146 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.132+0000 7f1db77fe700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1dac04d640 0x7f1dac04fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:40.146 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.132+0000 7f1db77fe700 1 -- 172.21.15.42:0/3357814892 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f1db8060d70 con 0x7f1db00044d0 2020-04-02T23:24:40.147 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.132+0000 7f1dc659c700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1dac04d640 0x7f1dac04fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:40.147 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.132+0000 7f1dc659c700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1dac04d640 0x7f1dac04fb00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1dc809e210 tx=0x7f1dbc00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:40.147 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.132+0000 7f1dc659c700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1dac04d640 0x7f1dac04fb00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1dc809e210 tx=0x7f1dbc00fcf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:40.147 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.132+0000 7f1dc659c700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1dac04d640 0x7f1dac04fb00 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f1dc809e210 tx=0x7f1dbc00fcf0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:40.147 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.135+0000 7f1dc6d9d700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 0x7f1dc80a0670 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f1db8003070 tx=0x7f1dc80680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:40.148 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.135+0000 7f1db77fe700 1 -- 172.21.15.42:0/3357814892 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f1db803c470 con 0x7f1db00044d0 2020-04-02T23:24:40.285 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.283+0000 7f1dcccf9700 1 -- 172.21.15.42:0/3357814892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f1dc8064710 con 0x7f1db00044d0 2020-04-02T23:24:40.951 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.949+0000 7f1dc6d9d700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 0x7f1dc80a0670 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7f1db8003070 tx=0x7f1dc80680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:40.952 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.949+0000 7f1db77fe700 1 -- 172.21.15.42:0/3357814892 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7f1db8007410 con 0x7f1db00044d0 2020-04-02T23:24:40.955 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.952+0000 7f1dcccf9700 1 -- 172.21.15.42:0/3357814892 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1dac04d640 msgr2=0x7f1dac04fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:40.955 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.952+0000 7f1dcccf9700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1dac04d640 0x7f1dac04fb00 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f1dc809e210 tx=0x7f1dbc00fcf0).stop 2020-04-02T23:24:40.955 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.952+0000 7f1dcccf9700 1 -- 172.21.15.42:0/3357814892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 msgr2=0x7f1dc80a0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:40.955 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.952+0000 7f1dcccf9700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 0x7f1dc80a0670 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f1db8003070 tx=0x7f1dc80680a0).stop 2020-04-02T23:24:40.955 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.953+0000 7f1dcccf9700 1 -- 172.21.15.42:0/3357814892 shutdown_connections 2020-04-02T23:24:40.956 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.953+0000 7f1dcccf9700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1db00044d0 0x7f1dc80a0670 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:40.956 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.953+0000 7f1dcccf9700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1dac04d640 0x7f1dac04fb00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:40.956 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.953+0000 7f1dcccf9700 1 --2- 172.21.15.42:0/3357814892 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1dc80a0000 0x7f1dc80a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:40.956 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.953+0000 7f1dcccf9700 1 -- 172.21.15.42:0/3357814892 >> 172.21.15.42:0/3357814892 conn(0x7f1dc809dc40 msgr2=0x7f1dc8123a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:40.956 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.953+0000 7f1dcccf9700 1 -- 172.21.15.42:0/3357814892 shutdown_connections 2020-04-02T23:24:40.956 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:40.953+0000 7f1dcccf9700 1 -- 172.21.15.42:0/3357814892 wait complete. 2020-04-02T23:24:40.957 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'rbd' created 2020-04-02T23:24:40.968 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:40.984 INFO:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-04-02T23:24:41.147 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.142+0000 7f8e1d5c7700 1 Processor -- start 2020-04-02T23:24:41.148 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.142+0000 7f8e1d5c7700 1 -- start start 2020-04-02T23:24:41.148 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.143+0000 7f8e1d5c7700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e180ab230 0x7f8e180a3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:41.148 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.143+0000 7f8e1d5c7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8e18148690 0x7f8e18148b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:41.148 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.143+0000 7f8e1d5c7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e180a55c0 con 0x7f8e1807fa80 2020-04-02T23:24:41.148 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.143+0000 7f8e1d5c7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e18080620 con 0x7f8e18148690 2020-04-02T23:24:41.148 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.143+0000 7f8e1d5c7700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180a68c0 con 0x7f8e180ab230 2020-04-02T23:24:41.149 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.143+0000 7f8e177fe700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e180ab230 0x7f8e180a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:41.149 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.143+0000 7f8e16ffd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8e18148690 0x7f8e18148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:41.149 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.143+0000 7f8e177fe700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e180ab230 0x7f8e180a3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.42:59390/0 (socket says 172.21.15.42:59390) 2020-04-02T23:24:41.149 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.143+0000 7f8e177fe700 1 -- 172.21.15.42:0/2060225648 learned_addr learned my addr 172.21.15.42:0/2060225648 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:41.149 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.143+0000 7f8e177fe700 1 -- 172.21.15.42:0/2060225648 >> v2:172.21.15.84:3300/0 conn(0x7f8e18148690 msgr2=0x7f8e18148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:41.150 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.143+0000 7f8e177fe700 1 --2- 172.21.15.42:0/2060225648 >> v2:172.21.15.84:3300/0 conn(0x7f8e18148690 0x7f8e18148b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:41.150 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.143+0000 7f8e177fe700 1 -- 172.21.15.42:0/2060225648 >> v1:172.21.15.84:6789/0 conn(0x7f8e1807fa80 legacy=0x7f8e1807ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:41.150 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.143+0000 7f8e177fe700 1 -- 172.21.15.42:0/2060225648 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e180a6b60 con 0x7f8e180ab230 2020-04-02T23:24:41.150 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.143+0000 7f8e167fc700 1 -- 172.21.15.42:0/2060225648 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39096523 0 0) 0x7f8e180a55c0 con 0x7f8e1807fa80 2020-04-02T23:24:41.150 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.144+0000 7f8e16ffd700 1 --2- 172.21.15.42:0/2060225648 >> v2:172.21.15.84:3300/0 conn(0x7f8e18148690 0x7f8e18148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:41.150 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.144+0000 7f8e177fe700 1 --2- 172.21.15.42:0/2060225648 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e180ab230 0x7f8e180a3440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8e08002f30 tx=0x7f8e180680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:41.150 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.144+0000 7f8e177fe700 1 --2- 172.21.15.42:0/2060225648 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e180ab230 0x7f8e180a3440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8e08002f30 tx=0x7f8e180680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:41.151 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.144+0000 7f8e177fe700 1 --2- 172.21.15.42:0/2060225648 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e180ab230 0x7f8e180a3440 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f8e08002f30 tx=0x7f8e180680a0).ready entity=mon.2 client_cookie=32be327b7ed0818c server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:41.151 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.144+0000 7f8e177fe700 1 --2- 172.21.15.42:0/2060225648 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e180ab230 0x7f8e180a3440 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f8e08002f30 tx=0x7f8e180680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:41.151 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.144+0000 7f8e167fc700 1 -- 172.21.15.42:0/2060225648 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e08011670 con 0x7f8e180ab230 2020-04-02T23:24:41.151 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.144+0000 7f8e177fe700 1 --2- 172.21.15.42:0/2060225648 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e180ab230 0x7f8e180a3440 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f8e08002f30 tx=0x7f8e180680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:41.151 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.144+0000 7f8e177fe700 1 --2- 172.21.15.42:0/2060225648 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e180ab230 0x7f8e180a3440 secure :-1 s=THROTTLE_DONE pgs=22 cs=0 l=1 rx=0x7f8e08002f30 tx=0x7f8e180680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:41.151 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.144+0000 7f8e167fc700 1 -- 172.21.15.42:0/2060225648 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e080117d0 con 0x7f8e180ab230 2020-04-02T23:24:41.151 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.144+0000 7f8e167fc700 1 -- 172.21.15.42:0/2060225648 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e08011bb0 con 0x7f8e180ab230 2020-04-02T23:24:41.152 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.144+0000 7f8e1d5c7700 1 -- 172.21.15.42:0/2060225648 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e180ab230 msgr2=0x7f8e180a3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:41.152 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.144+0000 7f8e1d5c7700 1 --2- 172.21.15.42:0/2060225648 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e180ab230 0x7f8e180a3440 secure :-1 s=READY pgs=22 cs=0 l=1 rx=0x7f8e08002f30 tx=0x7f8e180680a0).stop 2020-04-02T23:24:41.152 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.144+0000 7f8e1d5c7700 1 -- 172.21.15.42:0/2060225648 shutdown_connections 2020-04-02T23:24:41.152 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.144+0000 7f8e1d5c7700 1 --2- 172.21.15.42:0/2060225648 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e180ab230 0x7f8e180a3440 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:41.152 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.144+0000 7f8e1d5c7700 1 --2- 172.21.15.42:0/2060225648 >> v2:172.21.15.84:3300/0 conn(0x7f8e18148690 0x7f8e18148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:41.152 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.144+0000 7f8e1d5c7700 1 -- 172.21.15.42:0/2060225648 >> 172.21.15.42:0/2060225648 conn(0x7f8e1809dc40 msgr2=0x7f8e180aa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:41.152 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.144+0000 7f8e1d5c7700 1 -- 172.21.15.42:0/2060225648 shutdown_connections 2020-04-02T23:24:41.153 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.144+0000 7f8e1d5c7700 1 -- 172.21.15.42:0/2060225648 wait complete. 2020-04-02T23:24:41.153 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.145+0000 7f8e1d5c7700 1 Processor -- start 2020-04-02T23:24:41.153 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.146+0000 7f8e1d5c7700 1 -- start start 2020-04-02T23:24:41.156 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.146+0000 7f8e1d5c7700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e1807fa80 0x7f8e18061a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:41.156 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.146+0000 7f8e1d5c7700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e18061080 con 0x7f8e18148690 2020-04-02T23:24:41.156 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.146+0000 7f8e1d5c7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e18061320 con 0x7f8e180ab230 2020-04-02T23:24:41.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.146+0000 7f8e1d5c7700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e18061ec0 con 0x7f8e1807fa80 2020-04-02T23:24:41.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.146+0000 7f8e17fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f8e18148690 0x7f8e181317e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59072/0 (socket says 172.21.15.42:59072) 2020-04-02T23:24:41.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.146+0000 7f8e17fff700 1 -- 172.21.15.42:0/2089580202 learned_addr learned my addr 172.21.15.42:0/2089580202 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:41.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.147+0000 7f8e177fe700 1 --2- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e1807fa80 0x7f8e18061a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:41.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.147+0000 7f8dfffff700 1 -- 172.21.15.42:0/2089580202 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591347054 0 0) 0x7f8e18061080 con 0x7f8e18148690 2020-04-02T23:24:41.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.147+0000 7f8dfffff700 1 -- 172.21.15.42:0/2089580202 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8df8003230 con 0x7f8e18148690 2020-04-02T23:24:41.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.147+0000 7f8dfffff700 1 -- 172.21.15.42:0/2089580202 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165288033 0 0) 0x7f8e18061320 con 0x7f8e180ab230 2020-04-02T23:24:41.158 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.147+0000 7f8dfffff700 1 -- 172.21.15.42:0/2089580202 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e18061080 con 0x7f8e180ab230 2020-04-02T23:24:41.158 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.147+0000 7f8e177fe700 1 -- 172.21.15.42:0/2089580202 >> v1:172.21.15.84:6789/0 conn(0x7f8e180ab230 legacy=0x7f8e180642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:41.158 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.147+0000 7f8e177fe700 1 -- 172.21.15.42:0/2089580202 >> v1:172.21.15.42:6789/0 conn(0x7f8e18148690 legacy=0x7f8e181317e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:41.158 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.147+0000 7f8e177fe700 1 -- 172.21.15.42:0/2089580202 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e180615c0 con 0x7f8e1807fa80 2020-04-02T23:24:41.158 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.147+0000 7f8e177fe700 1 --2- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e1807fa80 0x7f8e18061a60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8e08002f30 tx=0x7f8e180680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:41.158 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.147+0000 7f8e177fe700 1 --2- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e1807fa80 0x7f8e18061a60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8e08002f30 tx=0x7f8e180680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:41.159 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.147+0000 7f8e177fe700 1 --2- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e1807fa80 0x7f8e18061a60 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7f8e08002f30 tx=0x7f8e180680a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:41.159 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.147+0000 7f8e177fe700 1 --2- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e1807fa80 0x7f8e18061a60 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f8e08002f30 tx=0x7f8e180680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:41.159 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.147+0000 7f8dfffff700 1 -- 172.21.15.42:0/2089580202 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e08011e30 con 0x7f8e1807fa80 2020-04-02T23:24:41.159 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.147+0000 7f8e177fe700 1 --2- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e1807fa80 0x7f8e18061a60 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f8e08002f30 tx=0x7f8e180680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:41.159 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.147+0000 7f8dfffff700 1 -- 172.21.15.42:0/2089580202 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e08011c00 con 0x7f8e1807fa80 2020-04-02T23:24:41.159 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.147+0000 7f8e177fe700 1 --2- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e1807fa80 0x7f8e18061a60 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f8e08002f30 tx=0x7f8e180680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:41.159 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.147+0000 7f8e1d5c7700 1 -- 172.21.15.42:0/2089580202 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e180a0b50 con 0x7f8e1807fa80 2020-04-02T23:24:41.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.147+0000 7f8dfffff700 1 -- 172.21.15.42:0/2089580202 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e08007530 con 0x7f8e1807fa80 2020-04-02T23:24:41.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.147+0000 7f8e1d5c7700 1 -- 172.21.15.42:0/2089580202 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e18062910 con 0x7f8e1807fa80 2020-04-02T23:24:41.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.148+0000 7f8e177fe700 1 --2- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e1807fa80 0x7f8e18061a60 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f8e08002f30 tx=0x7f8e180680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:41.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.148+0000 7f8e1d5c7700 1 -- 172.21.15.42:0/2089580202 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e18062c70 con 0x7f8e1807fa80 2020-04-02T23:24:41.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.148+0000 7f8dfffff700 1 -- 172.21.15.42:0/2089580202 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f8e080080a0 con 0x7f8e1807fa80 2020-04-02T23:24:41.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.148+0000 7f8e177fe700 1 --2- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e1807fa80 0x7f8e18061a60 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f8e08002f30 tx=0x7f8e180680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:41.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.149+0000 7f8dfffff700 1 --2- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8df804da00 0x7f8df804fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:41.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.149+0000 7f8dfffff700 1 -- 172.21.15.42:0/2089580202 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5242+0+0 (secure 0 0 0) 0x7f8e08060fb0 con 0x7f8e1807fa80 2020-04-02T23:24:41.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.149+0000 7f8e16ffd700 1 --2- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8df804da00 0x7f8df804fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:41.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.149+0000 7f8e16ffd700 1 --2- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8df804da00 0x7f8df804fec0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8e0c007920 tx=0x7f8e0c009a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:41.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.149+0000 7f8e16ffd700 1 --2- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8df804da00 0x7f8df804fec0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8e0c007920 tx=0x7f8e0c009a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:41.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.149+0000 7f8e16ffd700 1 --2- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8df804da00 0x7f8df804fec0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f8e0c007920 tx=0x7f8e0c009a90).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:41.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.153+0000 7f8e177fe700 1 --2- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e1807fa80 0x7f8e18061a60 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f8e08002f30 tx=0x7f8e180680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:41.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.153+0000 7f8dfffff700 1 -- 172.21.15.42:0/2089580202 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f8e0803c7b0 con 0x7f8e1807fa80 2020-04-02T23:24:41.302 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.300+0000 7f8e1d5c7700 1 -- 172.21.15.42:0/2089580202 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8e18056c50 con 0x7f8e1807fa80 2020-04-02T23:24:41.965 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.963+0000 7f8e177fe700 1 --2- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e1807fa80 0x7f8e18061a60 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7f8e08002f30 tx=0x7f8e180680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:41.965 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.963+0000 7f8dfffff700 1 -- 172.21.15.42:0/2089580202 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f8e0803fdd0 con 0x7f8e1807fa80 2020-04-02T23:24:41.968 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.965+0000 7f8e1d5c7700 1 -- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8df804da00 msgr2=0x7f8df804fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:41.968 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.965+0000 7f8e1d5c7700 1 --2- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8df804da00 0x7f8df804fec0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f8e0c007920 tx=0x7f8e0c009a90).stop 2020-04-02T23:24:41.968 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.965+0000 7f8e1d5c7700 1 -- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e1807fa80 msgr2=0x7f8e18061a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:41.968 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.965+0000 7f8e1d5c7700 1 --2- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e1807fa80 0x7f8e18061a60 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7f8e08002f30 tx=0x7f8e180680a0).stop 2020-04-02T23:24:41.968 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.965+0000 7f8e1d5c7700 1 -- 172.21.15.42:0/2089580202 shutdown_connections 2020-04-02T23:24:41.969 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.965+0000 7f8e1d5c7700 1 --2- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8df804da00 0x7f8df804fec0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:41.969 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.965+0000 7f8e1d5c7700 1 --2- 172.21.15.42:0/2089580202 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8e1807fa80 0x7f8e18061a60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:41.969 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.965+0000 7f8e1d5c7700 1 -- 172.21.15.42:0/2089580202 >> 172.21.15.42:0/2089580202 conn(0x7f8e1809dc40 msgr2=0x7f8e180a7720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:41.969 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.965+0000 7f8e1d5c7700 1 -- 172.21.15.42:0/2089580202 shutdown_connections 2020-04-02T23:24:41.969 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:41.966+0000 7f8e1d5c7700 1 -- 172.21.15.42:0/2089580202 wait complete. 2020-04-02T23:24:41.970 INFO:teuthology.orchestra.run.smithi042.stderr:enabled application 'rbd' on pool 'rbd' 2020-04-02T23:24:41.980 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-04-02T23:24:41.981 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:41.996 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:24:42.156 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.154+0000 7fa74a64a700 1 Processor -- start 2020-04-02T23:24:42.156 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.154+0000 7fa74a64a700 1 -- start start 2020-04-02T23:24:42.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.154+0000 7fa74a64a700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa7440ab090 0x7fa7440a5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:42.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.154+0000 7fa74a64a700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7440a56b0 0x7fa7440a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:42.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.154+0000 7fa74a64a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7440a1cd0 con 0x7fa744065ce0 2020-04-02T23:24:42.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.154+0000 7fa74a64a700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7440ab540 con 0x7fa7440ab090 2020-04-02T23:24:42.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.154+0000 7fa74a64a700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7440ab7a0 con 0x7fa7440a56b0 2020-04-02T23:24:42.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa748be7700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7440a56b0 0x7fa7440a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:42.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa7437fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa7440ab090 0x7fa7440a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:42.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa748be7700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7440a56b0 0x7fa7440a5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.42:59406/0 (socket says 172.21.15.42:59406) 2020-04-02T23:24:42.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa743fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa744065ce0 0x7fa7440a69a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:53454/0 (socket says 172.21.15.42:53454) 2020-04-02T23:24:42.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa748be7700 1 -- 172.21.15.42:0/1011299472 learned_addr learned my addr 172.21.15.42:0/1011299472 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:42.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa742ffd700 1 -- 172.21.15.42:0/1011299472 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271262297 0 0) 0x7fa7440a1cd0 con 0x7fa744065ce0 2020-04-02T23:24:42.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa742ffd700 1 -- 172.21.15.42:0/1011299472 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa730003230 con 0x7fa744065ce0 2020-04-02T23:24:42.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa748be7700 1 -- 172.21.15.42:0/1011299472 >> v2:172.21.15.84:3300/0 conn(0x7fa7440ab090 msgr2=0x7fa7440a5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:42.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa748be7700 1 --2- 172.21.15.42:0/1011299472 >> v2:172.21.15.84:3300/0 conn(0x7fa7440ab090 0x7fa7440a5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:42.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa748be7700 1 -- 172.21.15.42:0/1011299472 >> v1:172.21.15.84:6789/0 conn(0x7fa744065ce0 legacy=0x7fa7440a69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:42.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa748be7700 1 -- 172.21.15.42:0/1011299472 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7440a6500 con 0x7fa7440a56b0 2020-04-02T23:24:42.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa7437fe700 1 --2- 172.21.15.42:0/1011299472 >> v2:172.21.15.84:3300/0 conn(0x7fa7440ab090 0x7fa7440a5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:42.166 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa748be7700 1 --2- 172.21.15.42:0/1011299472 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7440a56b0 0x7fa7440a5b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa73c0032b0 tx=0x7fa73c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.166 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa748be7700 1 --2- 172.21.15.42:0/1011299472 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7440a56b0 0x7fa7440a5b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa73c0032b0 tx=0x7fa73c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.166 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa748be7700 1 --2- 172.21.15.42:0/1011299472 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7440a56b0 0x7fa7440a5b20 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7fa73c0032b0 tx=0x7fa73c007dc0).ready entity=mon.2 client_cookie=189f39829874c221 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:42.166 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa748be7700 1 --2- 172.21.15.42:0/1011299472 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7440a56b0 0x7fa7440a5b20 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fa73c0032b0 tx=0x7fa73c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.166 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa742ffd700 1 -- 172.21.15.42:0/1011299472 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa73c011e30 con 0x7fa7440a56b0 2020-04-02T23:24:42.166 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa748be7700 1 --2- 172.21.15.42:0/1011299472 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7440a56b0 0x7fa7440a5b20 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fa73c0032b0 tx=0x7fa73c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.166 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa742ffd700 1 -- 172.21.15.42:0/1011299472 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c00a160 con 0x7fa7440a56b0 2020-04-02T23:24:42.167 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa748be7700 1 --2- 172.21.15.42:0/1011299472 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7440a56b0 0x7fa7440a5b20 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7fa73c0032b0 tx=0x7fa73c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.167 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.155+0000 7fa742ffd700 1 -- 172.21.15.42:0/1011299472 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa73c00a580 con 0x7fa7440a56b0 2020-04-02T23:24:42.167 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.156+0000 7fa74a64a700 1 -- 172.21.15.42:0/1011299472 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7440a56b0 msgr2=0x7fa7440a5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:42.167 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.156+0000 7fa74a64a700 1 --2- 172.21.15.42:0/1011299472 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7440a56b0 0x7fa7440a5b20 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7fa73c0032b0 tx=0x7fa73c007dc0).stop 2020-04-02T23:24:42.167 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.156+0000 7fa74a64a700 1 -- 172.21.15.42:0/1011299472 shutdown_connections 2020-04-02T23:24:42.167 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.156+0000 7fa74a64a700 1 --2- 172.21.15.42:0/1011299472 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7440a56b0 0x7fa7440a5b20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:42.168 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.156+0000 7fa74a64a700 1 --2- 172.21.15.42:0/1011299472 >> v2:172.21.15.84:3300/0 conn(0x7fa7440ab090 0x7fa7440a5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:42.168 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.156+0000 7fa74a64a700 1 -- 172.21.15.42:0/1011299472 >> 172.21.15.42:0/1011299472 conn(0x7fa74405b720 msgr2=0x7fa7440aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:42.168 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.156+0000 7fa74a64a700 1 -- 172.21.15.42:0/1011299472 shutdown_connections 2020-04-02T23:24:42.168 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.156+0000 7fa74a64a700 1 -- 172.21.15.42:0/1011299472 wait complete. 2020-04-02T23:24:42.168 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.157+0000 7fa74a64a700 1 Processor -- start 2020-04-02T23:24:42.168 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.157+0000 7fa74a64a700 1 -- start start 2020-04-02T23:24:42.168 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa74a64a700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7440a56b0 0x7fa7441461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa74a64a700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa7440ab090 0x7fa744146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa74a64a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa744090240 con 0x7fa744065ce0 2020-04-02T23:24:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa74a64a700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7440904e0 con 0x7fa7440ab090 2020-04-02T23:24:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa74a64a700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa744145d20 con 0x7fa7440a56b0 2020-04-02T23:24:42.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa743fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa744065ce0 0x7fa74409c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:53460/0 (socket says 172.21.15.42:53460) 2020-04-02T23:24:42.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa743fff700 1 -- 172.21.15.42:0/1809459103 learned_addr learned my addr 172.21.15.42:0/1809459103 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:42.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa7437fe700 1 --2- 172.21.15.42:0/1809459103 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7440a56b0 0x7fa7441461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:42.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa748be7700 1 --2- 172.21.15.42:0/1809459103 >> v2:172.21.15.42:3300/0 conn(0x7fa7440ab090 0x7fa744146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:42.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa7417fa700 1 -- 172.21.15.42:0/1809459103 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021932103 0 0) 0x7fa744090240 con 0x7fa744065ce0 2020-04-02T23:24:42.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa7417fa700 1 -- 172.21.15.42:0/1809459103 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa724002fe0 con 0x7fa744065ce0 2020-04-02T23:24:42.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa748be7700 1 -- 172.21.15.42:0/1809459103 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7440a56b0 msgr2=0x7fa7441461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:42.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa748be7700 1 --2- 172.21.15.42:0/1809459103 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7440a56b0 0x7fa7441461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:42.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa748be7700 1 -- 172.21.15.42:0/1809459103 >> v1:172.21.15.84:6789/0 conn(0x7fa744065ce0 legacy=0x7fa74409c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:42.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa748be7700 1 -- 172.21.15.42:0/1809459103 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa744066880 con 0x7fa7440ab090 2020-04-02T23:24:42.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa748be7700 1 --2- 172.21.15.42:0/1809459103 >> v2:172.21.15.42:3300/0 conn(0x7fa7440ab090 0x7fa744146620 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7440907b0 tx=0x7fa73c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa748be7700 1 --2- 172.21.15.42:0/1809459103 >> v2:172.21.15.42:3300/0 conn(0x7fa7440ab090 0x7fa744146620 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7440907b0 tx=0x7fa73c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa748be7700 1 --2- 172.21.15.42:0/1809459103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7440ab090 0x7fa744146620 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7fa7440907b0 tx=0x7fa73c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:42.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa748be7700 1 --2- 172.21.15.42:0/1809459103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7440ab090 0x7fa744146620 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fa7440907b0 tx=0x7fa73c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa7417fa700 1 -- 172.21.15.42:0/1809459103 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa73c00ae40 con 0x7fa7440ab090 2020-04-02T23:24:42.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa748be7700 1 --2- 172.21.15.42:0/1809459103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7440ab090 0x7fa744146620 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fa7440907b0 tx=0x7fa73c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa748be7700 1 --2- 172.21.15.42:0/1809459103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7440ab090 0x7fa744146620 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fa7440907b0 tx=0x7fa73c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.158+0000 7fa7417fa700 1 -- 172.21.15.42:0/1809459103 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c005a40 con 0x7fa7440ab090 2020-04-02T23:24:42.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.159+0000 7fa74a64a700 1 -- 172.21.15.42:0/1809459103 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa744146a80 con 0x7fa7440ab090 2020-04-02T23:24:42.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.159+0000 7fa7417fa700 1 -- 172.21.15.42:0/1809459103 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa73c005e60 con 0x7fa7440ab090 2020-04-02T23:24:42.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.159+0000 7fa74a64a700 1 -- 172.21.15.42:0/1809459103 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74409cac0 con 0x7fa7440ab090 2020-04-02T23:24:42.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.159+0000 7fa748be7700 1 --2- 172.21.15.42:0/1809459103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7440ab090 0x7fa744146620 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fa7440907b0 tx=0x7fa73c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.160+0000 7fa74a64a700 1 -- 172.21.15.42:0/1809459103 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74405d2e0 con 0x7fa7440ab090 2020-04-02T23:24:42.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.160+0000 7fa7417fa700 1 -- 172.21.15.42:0/1809459103 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa73c0070b0 con 0x7fa7440ab090 2020-04-02T23:24:42.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.160+0000 7fa748be7700 1 --2- 172.21.15.42:0/1809459103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7440ab090 0x7fa744146620 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fa7440907b0 tx=0x7fa73c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.160+0000 7fa7417fa700 1 --2- 172.21.15.42:0/1809459103 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa72404d960 0x7fa72404fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:42.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.160+0000 7fa7417fa700 1 -- 172.21.15.42:0/1809459103 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa73c061680 con 0x7fa7440ab090 2020-04-02T23:24:42.174 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.160+0000 7fa743fff700 1 --2- 172.21.15.42:0/1809459103 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa72404d960 0x7fa72404fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:42.174 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.160+0000 7fa743fff700 1 --2- 172.21.15.42:0/1809459103 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa72404d960 0x7fa72404fe20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa734001110 tx=0x7fa734001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.174 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.160+0000 7fa743fff700 1 --2- 172.21.15.42:0/1809459103 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa72404d960 0x7fa72404fe20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa734001110 tx=0x7fa734001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.174 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.160+0000 7fa743fff700 1 --2- 172.21.15.42:0/1809459103 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa72404d960 0x7fa72404fe20 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fa734001110 tx=0x7fa734001780).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:42.175 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.163+0000 7fa748be7700 1 --2- 172.21.15.42:0/1809459103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7440ab090 0x7fa744146620 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fa7440907b0 tx=0x7fa73c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.175 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.163+0000 7fa7417fa700 1 -- 172.21.15.42:0/1809459103 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fa73c03cea0 con 0x7fa7440ab090 2020-04-02T23:24:42.315 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.313+0000 7fa74a64a700 1 -- 172.21.15.42:0/1809459103 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa744056c50 con 0x7fa7440ab090 2020-04-02T23:24:42.316 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.314+0000 7fa748be7700 1 --2- 172.21.15.42:0/1809459103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7440ab090 0x7fa744146620 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fa7440907b0 tx=0x7fa73c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.316 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.314+0000 7fa7417fa700 1 -- 172.21.15.42:0/1809459103 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13191 (secure 0 0 0) 0x7fa73c0404c0 con 0x7fa7440ab090 2020-04-02T23:24:42.317 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:24:42.317 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":19,"fsid":"571c521c-9ca7-4052-ba5b-7a77e18ff12c","created":"2020-04-02T23:24:23.980442+0000","modified":"2020-04-02T23:24:41.949636+0000","last_up_change":"2020-04-02T23:24:36.096260+0000","last_in_change":"2020-04-02T23:24:36.096260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:24:27.091980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:24:40.298468+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"976aac36-1cf8-408b-bf56-9f0eefe43b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":24836},{"type":"v1","addr":"172.21.15.42:6801","nonce":24836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":24836},{"type":"v1","addr":"172.21.15.42:6803","nonce":24836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":24836},{"type":"v1","addr":"172.21.15.42:6807","nonce":24836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":24836},{"type":"v1","addr":"172.21.15.42:6805","nonce":24836}]},"public_addr":"172.21.15.42:6801/24836","cluster_addr":"172.21.15.42:6803/24836","heartbeat_back_addr":"172.21.15.42:6807/24836","heartbeat_front_addr":"172.21.15.42:6805/24836","state":["exists","up"]},{"osd":1,"uuid":"22c1e489-ab99-4205-ba9d-fbfc144d2a8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":24881},{"type":"v1","addr":"172.21.15.42:6809","nonce":24881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":24881},{"type":"v1","addr":"172.21.15.42:6811","nonce":24881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":24881},{"type":"v1","addr":"172.21.15.42:6815","nonce":24881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":24881},{"type":"v1","addr":"172.21.15.42:6813","nonce":24881}]},"public_addr":"172.21.15.42:6809/24881","cluster_addr":"172.21.15.42:6811/24881","heartbeat_back_addr":"172.21.15.42:6815/24881","heartbeat_front_addr":"172.21.15.42:6813/24881","state":["exists","up"]},{"osd":2,"uuid":"f0b18b09-93c0-4286-8d15-746611ba53cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":24917},{"type":"v1","addr":"172.21.15.42:6817","nonce":24917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":24917},{"type":"v1","addr":"172.21.15.42:6819","nonce":24917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":24917},{"type":"v1","addr":"172.21.15.42:6823","nonce":24917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":24917},{"type":"v1","addr":"172.21.15.42:6821","nonce":24917}]},"public_addr":"172.21.15.42:6817/24917","cluster_addr":"172.21.15.42:6819/24917","heartbeat_back_addr":"172.21.15.42:6823/24917","heartbeat_front_addr":"172.21.15.42:6821/24917","state":["exists","up"]},{"osd":3,"uuid":"989d4a69-9abe-44de-95f2-6c7cbbe07471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":24940},{"type":"v1","addr":"172.21.15.42:6825","nonce":24940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":24940},{"type":"v1","addr":"172.21.15.42:6827","nonce":24940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":24940},{"type":"v1","addr":"172.21.15.42:6831","nonce":24940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":24940},{"type":"v1","addr":"172.21.15.42:6829","nonce":24940}]},"public_addr":"172.21.15.42:6825/24940","cluster_addr":"172.21.15.42:6827/24940","heartbeat_back_addr":"172.21.15.42:6831/24940","heartbeat_front_addr":"172.21.15.42:6829/24940","state":["exists","up"]},{"osd":4,"uuid":"b1a2ce60-ae80-4f8a-97a3-4fbb1399fdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":24239},{"type":"v1","addr":"172.21.15.84:6803","nonce":24239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":24239},{"type":"v1","addr":"172.21.15.84:6805","nonce":24239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":24239},{"type":"v1","addr":"172.21.15.84:6809","nonce":24239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":24239},{"type":"v1","addr":"172.21.15.84:6807","nonce":24239}]},"public_addr":"172.21.15.84:6803/24239","cluster_addr":"172.21.15.84:6805/24239","heartbeat_back_addr":"172.21.15.84:6809/24239","heartbeat_front_addr":"172.21.15.84:6807/24239","state":["exists","up"]},{"osd":5,"uuid":"396b36e5-7226-4e8e-aa8a-749cb5cec101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":24276},{"type":"v1","addr":"172.21.15.84:6811","nonce":24276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":24276},{"type":"v1","addr":"172.21.15.84:6813","nonce":24276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":24276},{"type":"v1","addr":"172.21.15.84:6817","nonce":24276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":24276},{"type":"v1","addr":"172.21.15.84:6815","nonce":24276}]},"public_addr":"172.21.15.84:6811/24276","cluster_addr":"172.21.15.84:6813/24276","heartbeat_back_addr":"172.21.15.84:6817/24276","heartbeat_front_addr":"172.21.15.84:6815/24276","state":["exists","up"]},{"osd":6,"uuid":"884bb915-28c3-463d-8046-e2908f6e8e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":24319},{"type":"v1","addr":"172.21.15.84:6819","nonce":24319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":24319},{"type":"v1","addr":"172.21.15.84:6821","nonce":24319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":24319},{"type":"v1","addr":"172.21.15.84:6825","nonce":24319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":24319},{"type":"v1","addr":"172.21.15.84:6823","nonce":24319}]},"public_addr":"172.21.15.84:6819/24319","cluster_addr":"172.21.15.84:6821/24319","heartbeat_back_addr":"172.21.15.84:6825/24319","heartbeat_front_addr":"172.21.15.84:6823/24319","state":["exists","up"]},{"osd":7,"uuid":"70e90d1d-f081-4de5-af4b-e987c159e597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":24349},{"type":"v1","addr":"172.21.15.84:6827","nonce":24349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":24349},{"type":"v1","addr":"172.21.15.84:6829","nonce":24349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":24349},{"type":"v1","addr":"172.21.15.84:6833","nonce":24349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":24349},{"type":"v1","addr":"172.21.15.84:6831","nonce":24349}]},"public_addr":"172.21.15.84:6827/24349","cluster_addr":"172.21.15.84:6829/24349","heartbeat_back_addr":"172.21.15.84:6833/24349","heartbeat_front_addr":"172.21.15.84:6831/24349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.195657+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.241354+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.257764+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.368827+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.967296+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.991068+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.077047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.095727+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:24:42.318 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.316+0000 7fa74a64a700 1 -- 172.21.15.42:0/1809459103 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa72404d960 msgr2=0x7fa72404fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:42.318 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.316+0000 7fa74a64a700 1 --2- 172.21.15.42:0/1809459103 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa72404d960 0x7fa72404fe20 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fa734001110 tx=0x7fa734001780).stop 2020-04-02T23:24:42.318 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.316+0000 7fa74a64a700 1 -- 172.21.15.42:0/1809459103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7440ab090 msgr2=0x7fa744146620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:42.318 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.316+0000 7fa74a64a700 1 --2- 172.21.15.42:0/1809459103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7440ab090 0x7fa744146620 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7fa7440907b0 tx=0x7fa73c007dc0).stop 2020-04-02T23:24:42.319 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.316+0000 7fa74a64a700 1 -- 172.21.15.42:0/1809459103 shutdown_connections 2020-04-02T23:24:42.319 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.316+0000 7fa74a64a700 1 --2- 172.21.15.42:0/1809459103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7440ab090 0x7fa744146620 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:42.319 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.316+0000 7fa74a64a700 1 --2- 172.21.15.42:0/1809459103 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa72404d960 0x7fa72404fe20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:42.319 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.316+0000 7fa74a64a700 1 --2- 172.21.15.42:0/1809459103 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa7440a56b0 0x7fa7441461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:42.320 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.316+0000 7fa74a64a700 1 -- 172.21.15.42:0/1809459103 >> 172.21.15.42:0/1809459103 conn(0x7fa74405b720 msgr2=0x7fa7440a5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:42.320 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.316+0000 7fa74a64a700 1 -- 172.21.15.42:0/1809459103 shutdown_connections 2020-04-02T23:24:42.320 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.316+0000 7fa74a64a700 1 -- 172.21.15.42:0/1809459103 wait complete. 2020-04-02T23:24:42.329 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:24:27.091980+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:24:40.298468+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-02T23:24:42.329 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:42.344 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-02T23:24:42.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.498+0000 7f67314a7700 1 Processor -- start 2020-04-02T23:24:42.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.498+0000 7f67314a7700 1 -- start start 2020-04-02T23:24:42.508 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.498+0000 7f67314a7700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c1389f0 0x7f672c138e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:42.508 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.498+0000 7f67314a7700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672c1386b0 con 0x7f672c1392d0 2020-04-02T23:24:42.508 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.498+0000 7f67314a7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672c0a4230 con 0x7f672c0ab230 2020-04-02T23:24:42.508 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.498+0000 7f67314a7700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672c0a4040 con 0x7f672c1389f0 2020-04-02T23:24:42.509 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.498+0000 7f6730ca6700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f672c1392d0 0x7f672c13fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59094/0 (socket says 172.21.15.42:59094) 2020-04-02T23:24:42.509 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.498+0000 7f6730ca6700 1 -- 172.21.15.42:0/1322800916 learned_addr learned my addr 172.21.15.42:0/1322800916 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:42.509 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f6723fff700 1 --2- 172.21.15.42:0/1322800916 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c1389f0 0x7f672c138e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:42.509 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f672b7fe700 1 -- 172.21.15.42:0/1322800916 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180347100 0 0) 0x7f672c1386b0 con 0x7f672c1392d0 2020-04-02T23:24:42.509 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f672b7fe700 1 -- 172.21.15.42:0/1322800916 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f670c003230 con 0x7f672c1392d0 2020-04-02T23:24:42.509 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f672b7fe700 1 -- 172.21.15.42:0/1322800916 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 803212737 0 0) 0x7f670c003230 con 0x7f672c1392d0 2020-04-02T23:24:42.510 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f672b7fe700 1 -- 172.21.15.42:0/1322800916 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c1389f0 msgr2=0x7f672c138e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:42.510 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f672b7fe700 1 --2- 172.21.15.42:0/1322800916 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c1389f0 0x7f672c138e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:42.510 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f672b7fe700 1 -- 172.21.15.42:0/1322800916 >> v1:172.21.15.84:6789/0 conn(0x7f672c0ab230 legacy=0x7f672c0a6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:42.510 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f672b7fe700 1 -- 172.21.15.42:0/1322800916 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c0a44d0 con 0x7f672c1392d0 2020-04-02T23:24:42.510 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f672b7fe700 1 -- 172.21.15.42:0/1322800916 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7f6724001a50 con 0x7f672c1392d0 2020-04-02T23:24:42.511 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f672b7fe700 1 -- 172.21.15.42:0/1322800916 >> v1:172.21.15.42:6789/0 conn(0x7f672c1392d0 legacy=0x7f672c13fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:42.511 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f672b7fe700 1 --2- 172.21.15.42:0/1322800916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f670c003750 0x7f670c003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:42.511 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f672b7fe700 1 --2- 172.21.15.42:0/1322800916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f670c004000 0x7f670c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:42.511 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f672b7fe700 1 --2- 172.21.15.42:0/1322800916 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c1389f0 0x7f670c004a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:42.511 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f672b7fe700 1 -- 172.21.15.42:0/1322800916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670c004f10 con 0x7f670c003750 2020-04-02T23:24:42.512 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f672b7fe700 1 -- 172.21.15.42:0/1322800916 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670c005080 con 0x7f670c004000 2020-04-02T23:24:42.512 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f672b7fe700 1 -- 172.21.15.42:0/1322800916 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670c005240 con 0x7f672c1389f0 2020-04-02T23:24:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f672bfff700 1 --2- 172.21.15.42:0/1322800916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f670c003750 0x7f670c003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f6723fff700 1 --2- 172.21.15.42:0/1322800916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f670c004000 0x7f670c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:42.514 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f6730ca6700 1 --2- 172.21.15.42:0/1322800916 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c1389f0 0x7f670c004a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:42.514 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f672bfff700 1 -- 172.21.15.42:0/1322800916 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c1389f0 msgr2=0x7f670c004a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:42.514 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f672bfff700 1 --2- 172.21.15.42:0/1322800916 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c1389f0 0x7f670c004a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:42.514 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f672bfff700 1 -- 172.21.15.42:0/1322800916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f670c004000 msgr2=0x7f670c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:42.514 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.499+0000 7f672bfff700 1 --2- 172.21.15.42:0/1322800916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f670c004000 0x7f670c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:42.514 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.500+0000 7f672bfff700 1 -- 172.21.15.42:0/1322800916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c003230 con 0x7f670c003750 2020-04-02T23:24:42.514 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.500+0000 7f672bfff700 1 --2- 172.21.15.42:0/1322800916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f670c003750 0x7f670c003b30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f671c001120 tx=0x7f672c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.515 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.500+0000 7f672bfff700 1 --2- 172.21.15.42:0/1322800916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f670c003750 0x7f670c003b30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f671c001120 tx=0x7f672c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.515 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.500+0000 7f672bfff700 1 --2- 172.21.15.42:0/1322800916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f670c003750 0x7f670c003b30 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f671c001120 tx=0x7f672c0680a0).ready entity=mon.0 client_cookie=bdc04d0ac105b602 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:42.515 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.500+0000 7f672bfff700 1 --2- 172.21.15.42:0/1322800916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f670c003750 0x7f670c003b30 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f671c001120 tx=0x7f672c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.515 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.500+0000 7f672b7fe700 1 -- 172.21.15.42:0/1322800916 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f671c001ab0 con 0x7f670c003750 2020-04-02T23:24:42.515 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.500+0000 7f672bfff700 1 --2- 172.21.15.42:0/1322800916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f670c003750 0x7f670c003b30 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f671c001120 tx=0x7f672c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.516 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.500+0000 7f672bfff700 1 --2- 172.21.15.42:0/1322800916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f670c003750 0x7f670c003b30 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f671c001120 tx=0x7f672c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.516 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.500+0000 7f672b7fe700 1 -- 172.21.15.42:0/1322800916 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c006910 con 0x7f670c003750 2020-04-02T23:24:42.516 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.500+0000 7f672b7fe700 1 -- 172.21.15.42:0/1322800916 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f671c006d30 con 0x7f670c003750 2020-04-02T23:24:42.516 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.500+0000 7f67314a7700 1 -- 172.21.15.42:0/1322800916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f670c003750 msgr2=0x7f670c003b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:42.516 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.500+0000 7f67314a7700 1 --2- 172.21.15.42:0/1322800916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f670c003750 0x7f670c003b30 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f671c001120 tx=0x7f672c0680a0).stop 2020-04-02T23:24:42.516 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.500+0000 7f6730ca6700 1 -- 172.21.15.42:0/1322800916 reap_dead start 2020-04-02T23:24:42.517 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.500+0000 7f67314a7700 1 -- 172.21.15.42:0/1322800916 shutdown_connections 2020-04-02T23:24:42.517 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.500+0000 7f67314a7700 1 -- 172.21.15.42:0/1322800916 >> 172.21.15.42:0/1322800916 conn(0x7f672c09dc40 msgr2=0x7f672c0aa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:42.517 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.500+0000 7f67314a7700 1 -- 172.21.15.42:0/1322800916 shutdown_connections 2020-04-02T23:24:42.517 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.500+0000 7f67314a7700 1 -- 172.21.15.42:0/1322800916 wait complete. 2020-04-02T23:24:42.517 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.501+0000 7f67314a7700 1 Processor -- start 2020-04-02T23:24:42.517 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.501+0000 7f67314a7700 1 -- start start 2020-04-02T23:24:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.502+0000 7f67314a7700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c12b130 0x7f672c066140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.502+0000 7f67314a7700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672c05bd60 con 0x7f672c129e00 2020-04-02T23:24:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.502+0000 7f67314a7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672c0a4e40 con 0x7f672c0665a0 2020-04-02T23:24:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.502+0000 7f67314a7700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672c136c30 con 0x7f672c12b130 2020-04-02T23:24:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.502+0000 7f6730ca6700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f672c129e00 0x7f672c150530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59106/0 (socket says 172.21.15.42:59106) 2020-04-02T23:24:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.502+0000 7f6730ca6700 1 -- 172.21.15.42:0/144416380 learned_addr learned my addr 172.21.15.42:0/144416380 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:42.519 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.502+0000 7f672bfff700 1 --2- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c12b130 0x7f672c066140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:42.519 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.502+0000 7f6729ffb700 1 -- 172.21.15.42:0/144416380 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424859076 0 0) 0x7f672c05bd60 con 0x7f672c129e00 2020-04-02T23:24:42.519 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.502+0000 7f6729ffb700 1 -- 172.21.15.42:0/144416380 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6710002fe0 con 0x7f672c129e00 2020-04-02T23:24:42.519 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.502+0000 7f6729ffb700 1 -- 172.21.15.42:0/144416380 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345989053 0 0) 0x7f672c0a4e40 con 0x7f672c0665a0 2020-04-02T23:24:42.519 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.502+0000 7f6729ffb700 1 -- 172.21.15.42:0/144416380 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f672c05bd60 con 0x7f672c0665a0 2020-04-02T23:24:42.519 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.502+0000 7f672bfff700 1 -- 172.21.15.42:0/144416380 >> v1:172.21.15.84:6789/0 conn(0x7f672c0665a0 legacy=0x7f672c1296f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:42.519 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.502+0000 7f672bfff700 1 -- 172.21.15.42:0/144416380 >> v1:172.21.15.42:6789/0 conn(0x7f672c129e00 legacy=0x7f672c150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:42.520 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.502+0000 7f672bfff700 1 -- 172.21.15.42:0/144416380 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c1381a0 con 0x7f672c12b130 2020-04-02T23:24:42.520 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.502+0000 7f672bfff700 1 --2- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c12b130 0x7f672c066140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f671c001120 tx=0x7f672c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.520 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.503+0000 7f672bfff700 1 --2- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c12b130 0x7f672c066140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f671c001120 tx=0x7f672c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.520 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.503+0000 7f672bfff700 1 --2- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c12b130 0x7f672c066140 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f671c001120 tx=0x7f672c0680a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:42.520 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.503+0000 7f672bfff700 1 --2- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c12b130 0x7f672c066140 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f671c001120 tx=0x7f672c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.520 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.503+0000 7f6729ffb700 1 -- 172.21.15.42:0/144416380 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f671c003560 con 0x7f672c12b130 2020-04-02T23:24:42.521 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.503+0000 7f672bfff700 1 --2- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c12b130 0x7f672c066140 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f671c001120 tx=0x7f672c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.521 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.503+0000 7f6729ffb700 1 -- 172.21.15.42:0/144416380 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c0036c0 con 0x7f672c12b130 2020-04-02T23:24:42.521 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.503+0000 7f672bfff700 1 --2- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c12b130 0x7f672c066140 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f671c001120 tx=0x7f672c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.521 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.503+0000 7f67314a7700 1 -- 172.21.15.42:0/144416380 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672c0a1850 con 0x7f672c12b130 2020-04-02T23:24:42.521 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.503+0000 7f6729ffb700 1 -- 172.21.15.42:0/144416380 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f671c003a20 con 0x7f672c12b130 2020-04-02T23:24:42.521 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.503+0000 7f67314a7700 1 -- 172.21.15.42:0/144416380 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672c137440 con 0x7f672c12b130 2020-04-02T23:24:42.521 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.504+0000 7f672bfff700 1 --2- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c12b130 0x7f672c066140 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f671c001120 tx=0x7f672c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.522 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.504+0000 7f67314a7700 1 -- 172.21.15.42:0/144416380 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672c056c50 con 0x7f672c12b130 2020-04-02T23:24:42.522 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.504+0000 7f6729ffb700 1 -- 172.21.15.42:0/144416380 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f671c003c20 con 0x7f672c12b130 2020-04-02T23:24:42.522 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.504+0000 7f672bfff700 1 --2- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c12b130 0x7f672c066140 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f671c001120 tx=0x7f672c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.523 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.504+0000 7f6729ffb700 1 --2- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f671004da20 0x7f671004fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:42.523 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.504+0000 7f6729ffb700 1 -- 172.21.15.42:0/144416380 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f671c060cc0 con 0x7f672c12b130 2020-04-02T23:24:42.523 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.504+0000 7f6723fff700 1 --2- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f671004da20 0x7f671004fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:42.523 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.505+0000 7f6723fff700 1 --2- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f671004da20 0x7f671004fee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6714007ed0 tx=0x7f6714007fc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.523 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.505+0000 7f6723fff700 1 --2- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f671004da20 0x7f671004fee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6714007ed0 tx=0x7f6714007fc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.523 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.505+0000 7f6723fff700 1 --2- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f671004da20 0x7f671004fee0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f6714007ed0 tx=0x7f6714007fc0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:42.524 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.508+0000 7f672bfff700 1 --2- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c12b130 0x7f672c066140 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f671c001120 tx=0x7f672c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.525 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.508+0000 7f6729ffb700 1 -- 172.21.15.42:0/144416380 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f671c03c4c0 con 0x7f672c12b130 2020-04-02T23:24:42.655 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.653+0000 7f67314a7700 1 -- 172.21.15.42:0/144416380 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f672c0675a0 con 0x7f672c12b130 2020-04-02T23:24:42.656 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.654+0000 7f672bfff700 1 --2- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c12b130 0x7f672c066140 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rx=0x7f671c001120 tx=0x7f672c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.656 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.654+0000 7f6729ffb700 1 -- 172.21.15.42:0/144416380 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v19) v1 ==== 110+0+10 (secure 0 0 0) 0x7f671c03fae0 con 0x7f672c12b130 2020-04-02T23:24:42.656 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2020-04-02T23:24:42.658 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.656+0000 7f67314a7700 1 -- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f671004da20 msgr2=0x7f671004fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:42.658 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.656+0000 7f67314a7700 1 --2- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f671004da20 0x7f671004fee0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f6714007ed0 tx=0x7f6714007fc0).stop 2020-04-02T23:24:42.658 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.656+0000 7f67314a7700 1 -- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c12b130 msgr2=0x7f672c066140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:42.658 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.656+0000 7f67314a7700 1 --2- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c12b130 0x7f672c066140 secure :-1 s=READY pgs=25 cs=0 l=1 rx=0x7f671c001120 tx=0x7f672c0680a0).stop 2020-04-02T23:24:42.659 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.656+0000 7f67314a7700 1 -- 172.21.15.42:0/144416380 shutdown_connections 2020-04-02T23:24:42.659 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.656+0000 7f67314a7700 1 --2- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f671004da20 0x7f671004fee0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:42.659 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.656+0000 7f67314a7700 1 --2- 172.21.15.42:0/144416380 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f672c12b130 0x7f672c066140 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:42.659 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.656+0000 7f67314a7700 1 -- 172.21.15.42:0/144416380 >> 172.21.15.42:0/144416380 conn(0x7f672c09dc40 msgr2=0x7f672c0a66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:42.659 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.656+0000 7f67314a7700 1 -- 172.21.15.42:0/144416380 shutdown_connections 2020-04-02T23:24:42.659 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.656+0000 7f67314a7700 1 -- 172.21.15.42:0/144416380 wait complete. 2020-04-02T23:24:42.668 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:42.682 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-02T23:24:42.843 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.835+0000 7f648ef58700 1 Processor -- start 2020-04-02T23:24:42.843 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.835+0000 7f648ef58700 1 -- start start 2020-04-02T23:24:42.843 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.836+0000 7f648ef58700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f64880a20b0 0x7f648813d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:42.843 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.836+0000 7f648ef58700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f648813d640 0x7f648813fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:42.843 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.836+0000 7f648ef58700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64880a25f0 con 0x7f64880a1cd0 2020-04-02T23:24:42.844 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.836+0000 7f648ef58700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648809a8f0 con 0x7f64880a20b0 2020-04-02T23:24:42.844 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.836+0000 7f648ef58700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648809ab90 con 0x7f648813d640 2020-04-02T23:24:42.844 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.836+0000 7f6487fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f64880a20b0 0x7f648813d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:42.844 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.836+0000 7f648ccf4700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f64880a1cd0 0x7f64880a6340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59110/0 (socket says 172.21.15.42:59110) 2020-04-02T23:24:42.844 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.836+0000 7f648ccf4700 1 -- 172.21.15.42:0/3353400138 learned_addr learned my addr 172.21.15.42:0/3353400138 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:42.844 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.836+0000 7f648d4f5700 1 --2- 172.21.15.42:0/3353400138 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f648813d640 0x7f648813fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:42.844 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.836+0000 7f6487fff700 1 -- 172.21.15.42:0/3353400138 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f648813d640 msgr2=0x7f648813fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:42.845 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.836+0000 7f6487fff700 1 --2- 172.21.15.42:0/3353400138 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f648813d640 0x7f648813fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:42.845 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.836+0000 7f6487fff700 1 -- 172.21.15.42:0/3353400138 >> v1:172.21.15.42:6789/0 conn(0x7f64880a1cd0 legacy=0x7f64880a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:42.845 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.836+0000 7f6487fff700 1 -- 172.21.15.42:0/3353400138 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648809ae30 con 0x7f64880a20b0 2020-04-02T23:24:42.845 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.836+0000 7f64877fe700 1 -- 172.21.15.42:0/3353400138 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965718261 0 0) 0x7f64880a25f0 con 0x7f64880a1cd0 2020-04-02T23:24:42.845 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.837+0000 7f648d4f5700 1 --2- 172.21.15.42:0/3353400138 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f648813d640 0x7f648813fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:24:42.845 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.837+0000 7f6487fff700 1 --2- 172.21.15.42:0/3353400138 >> v2:172.21.15.42:3300/0 conn(0x7f64880a20b0 0x7f648813d1e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f647c002f30 tx=0x7f647c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.845 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.837+0000 7f6487fff700 1 --2- 172.21.15.42:0/3353400138 >> v2:172.21.15.42:3300/0 conn(0x7f64880a20b0 0x7f648813d1e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f647c002f30 tx=0x7f647c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.837+0000 7f6487fff700 1 --2- 172.21.15.42:0/3353400138 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64880a20b0 0x7f648813d1e0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f647c002f30 tx=0x7f647c007a40).ready entity=mon.0 client_cookie=dc600ac4d94c725 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:42.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.837+0000 7f6487fff700 1 --2- 172.21.15.42:0/3353400138 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64880a20b0 0x7f648813d1e0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f647c002f30 tx=0x7f647c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.837+0000 7f64877fe700 1 -- 172.21.15.42:0/3353400138 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f647c011470 con 0x7f64880a20b0 2020-04-02T23:24:42.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.837+0000 7f6487fff700 1 --2- 172.21.15.42:0/3353400138 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64880a20b0 0x7f648813d1e0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f647c002f30 tx=0x7f647c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.837+0000 7f64877fe700 1 -- 172.21.15.42:0/3353400138 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647c0115d0 con 0x7f64880a20b0 2020-04-02T23:24:42.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.837+0000 7f6487fff700 1 --2- 172.21.15.42:0/3353400138 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64880a20b0 0x7f648813d1e0 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f647c002f30 tx=0x7f647c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.837+0000 7f64877fe700 1 -- 172.21.15.42:0/3353400138 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f647c0119b0 con 0x7f64880a20b0 2020-04-02T23:24:42.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.837+0000 7f648ef58700 1 -- 172.21.15.42:0/3353400138 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64880a20b0 msgr2=0x7f648813d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:42.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.837+0000 7f648ef58700 1 --2- 172.21.15.42:0/3353400138 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64880a20b0 0x7f648813d1e0 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f647c002f30 tx=0x7f647c007a40).stop 2020-04-02T23:24:42.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.837+0000 7f648ef58700 1 -- 172.21.15.42:0/3353400138 shutdown_connections 2020-04-02T23:24:42.849 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.837+0000 7f648ef58700 1 --2- 172.21.15.42:0/3353400138 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f648813d640 0x7f648813fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:42.849 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.837+0000 7f648ef58700 1 --2- 172.21.15.42:0/3353400138 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64880a20b0 0x7f648813d1e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:42.849 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.837+0000 7f648ef58700 1 -- 172.21.15.42:0/3353400138 >> 172.21.15.42:0/3353400138 conn(0x7f648805b720 msgr2=0x7f64880aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:42.849 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.837+0000 7f648ef58700 1 -- 172.21.15.42:0/3353400138 shutdown_connections 2020-04-02T23:24:42.849 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.837+0000 7f648ef58700 1 -- 172.21.15.42:0/3353400138 wait complete. 2020-04-02T23:24:42.849 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.838+0000 7f648ef58700 1 Processor -- start 2020-04-02T23:24:42.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.838+0000 7f648ef58700 1 -- start start 2020-04-02T23:24:42.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.839+0000 7f648ef58700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f648813d640 0x7f648813cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:42.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.839+0000 7f648ef58700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6488062740 con 0x7f64880a1cd0 2020-04-02T23:24:42.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.839+0000 7f648ef58700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64880656c0 con 0x7f64880a20b0 2020-04-02T23:24:42.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.839+0000 7f648ef58700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6488065320 con 0x7f648813d640 2020-04-02T23:24:42.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.839+0000 7f648ccf4700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f64880a1cd0 0x7f64880663c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59118/0 (socket says 172.21.15.42:59118) 2020-04-02T23:24:42.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.839+0000 7f648ccf4700 1 -- 172.21.15.42:0/978270982 learned_addr learned my addr 172.21.15.42:0/978270982 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:42.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.839+0000 7f648d4f5700 1 --2- 172.21.15.42:0/978270982 >> v2:172.21.15.84:3300/0 conn(0x7f648813d640 0x7f648813cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:42.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.839+0000 7f6485ffb700 1 -- 172.21.15.42:0/978270982 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335166111 0 0) 0x7f6488062740 con 0x7f64880a1cd0 2020-04-02T23:24:42.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.839+0000 7f6485ffb700 1 -- 172.21.15.42:0/978270982 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6468002fe0 con 0x7f64880a1cd0 2020-04-02T23:24:42.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.839+0000 7f648d4f5700 1 -- 172.21.15.42:0/978270982 >> v1:172.21.15.84:6789/0 conn(0x7f64880a20b0 legacy=0x7f648813c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:42.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.839+0000 7f648d4f5700 1 -- 172.21.15.42:0/978270982 >> v1:172.21.15.42:6789/0 conn(0x7f64880a1cd0 legacy=0x7f64880663c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:42.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.839+0000 7f6485ffb700 1 -- 172.21.15.42:0/978270982 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73548532 0 0) 0x7f64880656c0 con 0x7f64880a20b0 2020-04-02T23:24:42.852 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.839+0000 7f648d4f5700 1 -- 172.21.15.42:0/978270982 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6488065960 con 0x7f648813d640 2020-04-02T23:24:42.853 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.839+0000 7f648d4f5700 1 --2- 172.21.15.42:0/978270982 >> v2:172.21.15.84:3300/0 conn(0x7f648813d640 0x7f648813cd60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f64800032b0 tx=0x7f6480010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.853 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.840+0000 7f648d4f5700 1 --2- 172.21.15.42:0/978270982 >> v2:172.21.15.84:3300/0 conn(0x7f648813d640 0x7f648813cd60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f64800032b0 tx=0x7f6480010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.853 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.840+0000 7f648d4f5700 1 --2- 172.21.15.42:0/978270982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f648813d640 0x7f648813cd60 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f64800032b0 tx=0x7f6480010da0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:42.853 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.840+0000 7f648d4f5700 1 --2- 172.21.15.42:0/978270982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f648813d640 0x7f648813cd60 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f64800032b0 tx=0x7f6480010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.853 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.840+0000 7f6485ffb700 1 -- 172.21.15.42:0/978270982 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6480005e30 con 0x7f648813d640 2020-04-02T23:24:42.854 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.840+0000 7f648d4f5700 1 --2- 172.21.15.42:0/978270982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f648813d640 0x7f648813cd60 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f64800032b0 tx=0x7f6480010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.854 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.840+0000 7f6485ffb700 1 -- 172.21.15.42:0/978270982 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6480007540 con 0x7f648813d640 2020-04-02T23:24:42.854 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.840+0000 7f648ef58700 1 -- 172.21.15.42:0/978270982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6488065c00 con 0x7f648813d640 2020-04-02T23:24:42.854 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.840+0000 7f648d4f5700 1 --2- 172.21.15.42:0/978270982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f648813d640 0x7f648813cd60 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f64800032b0 tx=0x7f6480010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.854 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.840+0000 7f6485ffb700 1 -- 172.21.15.42:0/978270982 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64800078a0 con 0x7f648813d640 2020-04-02T23:24:42.854 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.840+0000 7f648ef58700 1 -- 172.21.15.42:0/978270982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6488066ad0 con 0x7f648813d640 2020-04-02T23:24:42.855 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.841+0000 7f648d4f5700 1 --2- 172.21.15.42:0/978270982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f648813d640 0x7f648813cd60 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f64800032b0 tx=0x7f6480010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.855 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.841+0000 7f648ef58700 1 -- 172.21.15.42:0/978270982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648805d2e0 con 0x7f648813d640 2020-04-02T23:24:42.855 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.841+0000 7f6485ffb700 1 -- 172.21.15.42:0/978270982 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f6480010170 con 0x7f648813d640 2020-04-02T23:24:42.855 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.841+0000 7f648d4f5700 1 --2- 172.21.15.42:0/978270982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f648813d640 0x7f648813cd60 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f64800032b0 tx=0x7f6480010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.841+0000 7f6485ffb700 1 --2- 172.21.15.42:0/978270982 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f646804d820 0x7f646804fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:42.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.841+0000 7f6485ffb700 1 -- 172.21.15.42:0/978270982 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f64800610e0 con 0x7f648813d640 2020-04-02T23:24:42.858 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.841+0000 7f648ccf4700 1 --2- 172.21.15.42:0/978270982 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f646804d820 0x7f646804fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:42.858 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.842+0000 7f648ccf4700 1 --2- 172.21.15.42:0/978270982 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f646804d820 0x7f646804fce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6478000ff0 tx=0x7f64780016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.858 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.842+0000 7f648ccf4700 1 --2- 172.21.15.42:0/978270982 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f646804d820 0x7f646804fce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6478000ff0 tx=0x7f64780016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.842+0000 7f648ccf4700 1 --2- 172.21.15.42:0/978270982 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f646804d820 0x7f646804fce0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f6478000ff0 tx=0x7f64780016e0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:42.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.845+0000 7f648d4f5700 1 --2- 172.21.15.42:0/978270982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f648813d640 0x7f648813cd60 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f64800032b0 tx=0x7f6480010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.845+0000 7f6485ffb700 1 -- 172.21.15.42:0/978270982 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f648003c760 con 0x7f648813d640 2020-04-02T23:24:42.997 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.995+0000 7f648ef58700 1 -- 172.21.15.42:0/978270982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6488056c50 con 0x7f648813d640 2020-04-02T23:24:42.999 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.995+0000 7f648d4f5700 1 --2- 172.21.15.42:0/978270982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f648813d640 0x7f648813cd60 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7f64800032b0 tx=0x7f6480010da0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:42.999 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.995+0000 7f6485ffb700 1 -- 172.21.15.42:0/978270982 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f648003fd80 con 0x7f648813d640 2020-04-02T23:24:42.999 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 8 2020-04-02T23:24:43.000 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.997+0000 7f648ef58700 1 -- 172.21.15.42:0/978270982 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f646804d820 msgr2=0x7f646804fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:43.000 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.997+0000 7f648ef58700 1 --2- 172.21.15.42:0/978270982 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f646804d820 0x7f646804fce0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f6478000ff0 tx=0x7f64780016e0).stop 2020-04-02T23:24:43.001 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.997+0000 7f648ef58700 1 -- 172.21.15.42:0/978270982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f648813d640 msgr2=0x7f648813cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:43.001 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.997+0000 7f648ef58700 1 --2- 172.21.15.42:0/978270982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f648813d640 0x7f648813cd60 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7f64800032b0 tx=0x7f6480010da0).stop 2020-04-02T23:24:43.001 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.997+0000 7f648ef58700 1 -- 172.21.15.42:0/978270982 shutdown_connections 2020-04-02T23:24:43.001 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.997+0000 7f648ef58700 1 --2- 172.21.15.42:0/978270982 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f646804d820 0x7f646804fce0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:43.001 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.997+0000 7f648ef58700 1 --2- 172.21.15.42:0/978270982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f648813d640 0x7f648813cd60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:43.001 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.997+0000 7f648ef58700 1 -- 172.21.15.42:0/978270982 >> 172.21.15.42:0/978270982 conn(0x7f648805b720 msgr2=0x7f64880a7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:43.001 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.997+0000 7f648ef58700 1 -- 172.21.15.42:0/978270982 shutdown_connections 2020-04-02T23:24:43.002 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:42.997+0000 7f648ef58700 1 -- 172.21.15.42:0/978270982 wait complete. 2020-04-02T23:24:43.009 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:43.023 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-04-02T23:24:43.176 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.174+0000 7fd86f5ab700 1 Processor -- start 2020-04-02T23:24:43.177 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.174+0000 7fd86f5ab700 1 -- start start 2020-04-02T23:24:43.183 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.175+0000 7fd86f5ab700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd8680aa1a0 0x7fd868138720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:43.183 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.175+0000 7fd86f5ab700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd868138b80 0x7fd86805c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:43.183 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.175+0000 7fd86f5ab700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd86805c4f0 0x7fd86809dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:43.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.175+0000 7fd86f5ab700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8680aacd0 con 0x7fd8680aa1a0 2020-04-02T23:24:43.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.175+0000 7fd86f5ab700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd86805c960 con 0x7fd86805c4f0 2020-04-02T23:24:43.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.175+0000 7fd86f5ab700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8680a2980 con 0x7fd868138b80 2020-04-02T23:24:43.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.175+0000 7fd86d347700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd8680aa1a0 0x7fd868138720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:43.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.175+0000 7fd86d347700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd8680aa1a0 0x7fd868138720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39700/0 (socket says 172.21.15.42:39700) 2020-04-02T23:24:43.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.175+0000 7fd86d347700 1 -- 172.21.15.42:0/1245092141 learned_addr learned my addr 172.21.15.42:0/1245092141 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:43.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.175+0000 7fd86db48700 1 --2- 172.21.15.42:0/1245092141 >> v2:172.21.15.84:3300/0 conn(0x7fd86805c4f0 0x7fd86809dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:43.185 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.175+0000 7fd86cb46700 1 --2- 172.21.15.42:0/1245092141 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd868138b80 0x7fd86805c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:43.185 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.175+0000 7fd86d347700 1 -- 172.21.15.42:0/1245092141 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd868138b80 msgr2=0x7fd86805c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:43.185 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.175+0000 7fd86d347700 1 --2- 172.21.15.42:0/1245092141 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd868138b80 0x7fd86805c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:43.185 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.175+0000 7fd86d347700 1 -- 172.21.15.42:0/1245092141 >> v2:172.21.15.84:3300/0 conn(0x7fd86805c4f0 msgr2=0x7fd86809dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:43.185 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.175+0000 7fd86d347700 1 --2- 172.21.15.42:0/1245092141 >> v2:172.21.15.84:3300/0 conn(0x7fd86805c4f0 0x7fd86809dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:43.185 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.176+0000 7fd86d347700 1 -- 172.21.15.42:0/1245092141 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86813c100 con 0x7fd8680aa1a0 2020-04-02T23:24:43.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.176+0000 7fd86d347700 1 --2- 172.21.15.42:0/1245092141 >> v2:172.21.15.42:3300/0 conn(0x7fd8680aa1a0 0x7fd868138720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd860002f30 tx=0x7fd860007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.176+0000 7fd86d347700 1 --2- 172.21.15.42:0/1245092141 >> v2:172.21.15.42:3300/0 conn(0x7fd8680aa1a0 0x7fd868138720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd860002f30 tx=0x7fd860007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.176+0000 7fd86d347700 1 --2- 172.21.15.42:0/1245092141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8680aa1a0 0x7fd868138720 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fd860002f30 tx=0x7fd860007a40).ready entity=mon.0 client_cookie=8f7d480b9617148d server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:43.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.176+0000 7fd86d347700 1 --2- 172.21.15.42:0/1245092141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8680aa1a0 0x7fd868138720 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fd860002f30 tx=0x7fd860007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.176+0000 7fd86d347700 1 --2- 172.21.15.42:0/1245092141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8680aa1a0 0x7fd868138720 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fd860002f30 tx=0x7fd860007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.176+0000 7fd867fff700 1 -- 172.21.15.42:0/1245092141 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd860011720 con 0x7fd8680aa1a0 2020-04-02T23:24:43.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.176+0000 7fd86d347700 1 --2- 172.21.15.42:0/1245092141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8680aa1a0 0x7fd868138720 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7fd860002f30 tx=0x7fd860007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.176+0000 7fd867fff700 1 -- 172.21.15.42:0/1245092141 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd860011880 con 0x7fd8680aa1a0 2020-04-02T23:24:43.188 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.176+0000 7fd867fff700 1 -- 172.21.15.42:0/1245092141 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd860011c60 con 0x7fd8680aa1a0 2020-04-02T23:24:43.188 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.176+0000 7fd86f5ab700 1 -- 172.21.15.42:0/1245092141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8680aa1a0 msgr2=0x7fd868138720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:43.188 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.176+0000 7fd86f5ab700 1 --2- 172.21.15.42:0/1245092141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8680aa1a0 0x7fd868138720 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fd860002f30 tx=0x7fd860007a40).stop 2020-04-02T23:24:43.188 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.176+0000 7fd86f5ab700 1 -- 172.21.15.42:0/1245092141 shutdown_connections 2020-04-02T23:24:43.188 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.176+0000 7fd86f5ab700 1 --2- 172.21.15.42:0/1245092141 >> v2:172.21.15.84:3300/0 conn(0x7fd86805c4f0 0x7fd86809dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:43.188 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.176+0000 7fd86f5ab700 1 --2- 172.21.15.42:0/1245092141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8680aa1a0 0x7fd868138720 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:43.188 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.176+0000 7fd86f5ab700 1 --2- 172.21.15.42:0/1245092141 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd868138b80 0x7fd86805c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:43.189 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.176+0000 7fd86f5ab700 1 -- 172.21.15.42:0/1245092141 >> 172.21.15.42:0/1245092141 conn(0x7fd8680aedc0 msgr2=0x7fd8680af1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:43.189 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.176+0000 7fd86f5ab700 1 -- 172.21.15.42:0/1245092141 shutdown_connections 2020-04-02T23:24:43.189 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.176+0000 7fd86f5ab700 1 -- 172.21.15.42:0/1245092141 wait complete. 2020-04-02T23:24:43.189 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.177+0000 7fd86f5ab700 1 Processor -- start 2020-04-02T23:24:43.189 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.177+0000 7fd86f5ab700 1 -- start start 2020-04-02T23:24:43.189 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.178+0000 7fd86f5ab700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd86805c4f0 0x7fd868137b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:43.189 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.178+0000 7fd86f5ab700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd8680aa1a0 0x7fd8681321e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:43.190 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.178+0000 7fd86f5ab700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd868138b80 0x7fd868132640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:43.190 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.178+0000 7fd86f5ab700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8680a18b0 con 0x7fd86805c4f0 2020-04-02T23:24:43.190 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.178+0000 7fd86f5ab700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd868132aa0 con 0x7fd8680aa1a0 2020-04-02T23:24:43.190 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.178+0000 7fd86f5ab700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8680a2d50 con 0x7fd868138b80 2020-04-02T23:24:43.190 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.178+0000 7fd86d347700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd86805c4f0 0x7fd868137b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:43.190 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.178+0000 7fd86d347700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd86805c4f0 0x7fd868137b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39706/0 (socket says 172.21.15.42:39706) 2020-04-02T23:24:43.190 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.178+0000 7fd86d347700 1 -- 172.21.15.42:0/3879977942 learned_addr learned my addr 172.21.15.42:0/3879977942 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:43.191 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.178+0000 7fd86cb46700 1 --2- 172.21.15.42:0/3879977942 >> v2:172.21.15.84:3300/0 conn(0x7fd8680aa1a0 0x7fd8681321e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:43.191 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.178+0000 7fd86db48700 1 --2- 172.21.15.42:0/3879977942 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd868138b80 0x7fd868132640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:43.191 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.178+0000 7fd86d347700 1 -- 172.21.15.42:0/3879977942 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd868138b80 msgr2=0x7fd868132640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:43.191 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.178+0000 7fd86d347700 1 --2- 172.21.15.42:0/3879977942 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd868138b80 0x7fd868132640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:43.191 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.178+0000 7fd86d347700 1 -- 172.21.15.42:0/3879977942 >> v2:172.21.15.84:3300/0 conn(0x7fd8680aa1a0 msgr2=0x7fd8681321e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:43.191 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.178+0000 7fd86d347700 1 --2- 172.21.15.42:0/3879977942 >> v2:172.21.15.84:3300/0 conn(0x7fd8680aa1a0 0x7fd8681321e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:43.192 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.178+0000 7fd86d347700 1 -- 172.21.15.42:0/3879977942 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8680a2ff0 con 0x7fd86805c4f0 2020-04-02T23:24:43.192 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.178+0000 7fd86d347700 1 --2- 172.21.15.42:0/3879977942 >> v2:172.21.15.42:3300/0 conn(0x7fd86805c4f0 0x7fd868137b30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd860002f30 tx=0x7fd860007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.192 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.178+0000 7fd86d347700 1 --2- 172.21.15.42:0/3879977942 >> v2:172.21.15.42:3300/0 conn(0x7fd86805c4f0 0x7fd868137b30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd860002f30 tx=0x7fd860007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.192 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.178+0000 7fd86d347700 1 --2- 172.21.15.42:0/3879977942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86805c4f0 0x7fd868137b30 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fd860002f30 tx=0x7fd860007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:43.193 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.179+0000 7fd86d347700 1 --2- 172.21.15.42:0/3879977942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86805c4f0 0x7fd868137b30 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fd860002f30 tx=0x7fd860007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.193 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.179+0000 7fd86d347700 1 --2- 172.21.15.42:0/3879977942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86805c4f0 0x7fd868137b30 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fd860002f30 tx=0x7fd860007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.193 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.179+0000 7fd8667fc700 1 -- 172.21.15.42:0/3879977942 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd860011ea0 con 0x7fd86805c4f0 2020-04-02T23:24:43.193 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.179+0000 7fd86d347700 1 --2- 172.21.15.42:0/3879977942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86805c4f0 0x7fd868137b30 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fd860002f30 tx=0x7fd860007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.193 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.179+0000 7fd8667fc700 1 -- 172.21.15.42:0/3879977942 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd860007150 con 0x7fd86805c4f0 2020-04-02T23:24:43.193 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.179+0000 7fd8667fc700 1 -- 172.21.15.42:0/3879977942 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd860007530 con 0x7fd86805c4f0 2020-04-02T23:24:43.193 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.179+0000 7fd86f5ab700 1 -- 172.21.15.42:0/3879977942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd868137f90 con 0x7fd86805c4f0 2020-04-02T23:24:43.193 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.179+0000 7fd86f5ab700 1 -- 172.21.15.42:0/3879977942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8680a12d0 con 0x7fd86805c4f0 2020-04-02T23:24:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.179+0000 7fd86d347700 1 --2- 172.21.15.42:0/3879977942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86805c4f0 0x7fd868137b30 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fd860002f30 tx=0x7fd860007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.180+0000 7fd8667fc700 1 -- 172.21.15.42:0/3879977942 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd8600056c0 con 0x7fd86805c4f0 2020-04-02T23:24:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.180+0000 7fd86d347700 1 --2- 172.21.15.42:0/3879977942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86805c4f0 0x7fd868137b30 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fd860002f30 tx=0x7fd860007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.180+0000 7fd86f5ab700 1 -- 172.21.15.42:0/3879977942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8680a33b0 con 0x7fd86805c4f0 2020-04-02T23:24:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.180+0000 7fd8667fc700 1 --2- 172.21.15.42:0/3879977942 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd84804d5c0 0x7fd84804fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.180+0000 7fd8667fc700 1 -- 172.21.15.42:0/3879977942 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd860061390 con 0x7fd86805c4f0 2020-04-02T23:24:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.180+0000 7fd86cb46700 1 --2- 172.21.15.42:0/3879977942 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd84804d5c0 0x7fd84804fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.181+0000 7fd86cb46700 1 --2- 172.21.15.42:0/3879977942 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd84804d5c0 0x7fd84804fa80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd85c0032b0 tx=0x7fd85c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.195 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.181+0000 7fd86cb46700 1 --2- 172.21.15.42:0/3879977942 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd84804d5c0 0x7fd84804fa80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd85c0032b0 tx=0x7fd85c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.195 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.181+0000 7fd86cb46700 1 --2- 172.21.15.42:0/3879977942 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd84804d5c0 0x7fd84804fa80 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fd85c0032b0 tx=0x7fd85c007dc0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:43.195 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.184+0000 7fd86d347700 1 --2- 172.21.15.42:0/3879977942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86805c4f0 0x7fd868137b30 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fd860002f30 tx=0x7fd860007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.195 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.184+0000 7fd8667fc700 1 -- 172.21.15.42:0/3879977942 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fd86003cbb0 con 0x7fd86805c4f0 2020-04-02T23:24:43.338 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.334+0000 7fd86f5ab700 1 -- 172.21.15.42:0/3879977942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd8680a3180 con 0x7fd86805c4f0 2020-04-02T23:24:43.339 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.334+0000 7fd86d347700 1 --2- 172.21.15.42:0/3879977942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86805c4f0 0x7fd868137b30 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7fd860002f30 tx=0x7fd860007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.339 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.334+0000 7fd8667fc700 1 -- 172.21.15.42:0/3879977942 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+143 (secure 0 0 0) 0x7fd8600401d0 con 0x7fd86805c4f0 2020-04-02T23:24:43.339 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.335+0000 7fd86f5ab700 1 -- 172.21.15.42:0/3879977942 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd84804d5c0 msgr2=0x7fd84804fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:43.339 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.335+0000 7fd86f5ab700 1 --2- 172.21.15.42:0/3879977942 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd84804d5c0 0x7fd84804fa80 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fd85c0032b0 tx=0x7fd85c007dc0).stop 2020-04-02T23:24:43.339 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.335+0000 7fd86f5ab700 1 -- 172.21.15.42:0/3879977942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86805c4f0 msgr2=0x7fd868137b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:43.339 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.335+0000 7fd86f5ab700 1 --2- 172.21.15.42:0/3879977942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86805c4f0 0x7fd868137b30 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fd860002f30 tx=0x7fd860007a40).stop 2020-04-02T23:24:43.341 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.335+0000 7fd86f5ab700 1 -- 172.21.15.42:0/3879977942 shutdown_connections 2020-04-02T23:24:43.341 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.335+0000 7fd86f5ab700 1 --2- 172.21.15.42:0/3879977942 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd84804d5c0 0x7fd84804fa80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:43.341 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.335+0000 7fd86f5ab700 1 --2- 172.21.15.42:0/3879977942 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd868138b80 0x7fd868132640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:43.341 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.335+0000 7fd86f5ab700 1 --2- 172.21.15.42:0/3879977942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd86805c4f0 0x7fd868137b30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:43.341 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.335+0000 7fd86f5ab700 1 --2- 172.21.15.42:0/3879977942 >> v2:172.21.15.84:3300/0 conn(0x7fd8680aa1a0 0x7fd8681321e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:43.341 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.335+0000 7fd86f5ab700 1 -- 172.21.15.42:0/3879977942 >> 172.21.15.42:0/3879977942 conn(0x7fd8680aedc0 msgr2=0x7fd8680655d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:43.342 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.335+0000 7fd86f5ab700 1 -- 172.21.15.42:0/3879977942 shutdown_connections 2020-04-02T23:24:43.342 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.335+0000 7fd86f5ab700 1 -- 172.21.15.42:0/3879977942 wait complete. 2020-04-02T23:24:43.342 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:24:43.342 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2020-04-02T23:24:43.342 INFO:teuthology.orchestra.run.smithi042.stdout: { 2020-04-02T23:24:43.342 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2020-04-02T23:24:43.342 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": "device_health_metrics" 2020-04-02T23:24:43.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:24:43.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2020-04-02T23:24:43.343 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 2, 2020-04-02T23:24:43.343 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": "rbd" 2020-04-02T23:24:43.343 INFO:teuthology.orchestra.run.smithi042.stdout: } 2020-04-02T23:24:43.343 INFO:teuthology.orchestra.run.smithi042.stdout:] 2020-04-02T23:24:43.348 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-04-02T23:24:43.348 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:43.364 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-04-02T23:24:43.519 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.517+0000 7f309de7e700 1 Processor -- start 2020-04-02T23:24:43.520 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.517+0000 7f309de7e700 1 -- start start 2020-04-02T23:24:43.528 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.518+0000 7f309de7e700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3098065ce0 0x7f30980ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:43.528 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.518+0000 7f309de7e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f30980a69a0 0x7f30980a6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:43.528 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.518+0000 7f309de7e700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f309813c1f0 0x7f309813c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:43.528 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.518+0000 7f309de7e700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30980a1cd0 con 0x7f3098065ce0 2020-04-02T23:24:43.528 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.518+0000 7f309de7e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30980ab7a0 con 0x7f30980a69a0 2020-04-02T23:24:43.529 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.518+0000 7f309de7e700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30980a6500 con 0x7f309813c1f0 2020-04-02T23:24:43.529 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.518+0000 7f30977fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3098065ce0 0x7f30980ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:43.529 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.518+0000 7f30977fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3098065ce0 0x7f30980ab090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39714/0 (socket says 172.21.15.42:39714) 2020-04-02T23:24:43.529 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.518+0000 7f30977fe700 1 -- 172.21.15.42:0/383939630 learned_addr learned my addr 172.21.15.42:0/383939630 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:43.529 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.518+0000 7f308ffff700 1 --2- 172.21.15.42:0/383939630 >> v2:172.21.15.84:3300/0 conn(0x7f30980a69a0 0x7f30980a6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:43.529 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.518+0000 7f3097fff700 1 --2- 172.21.15.42:0/383939630 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f309813c1f0 0x7f309813c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:43.529 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.518+0000 7f30977fe700 1 -- 172.21.15.42:0/383939630 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f309813c1f0 msgr2=0x7f309813c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:43.530 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.518+0000 7f30977fe700 1 --2- 172.21.15.42:0/383939630 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f309813c1f0 0x7f309813c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:43.530 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.518+0000 7f30977fe700 1 -- 172.21.15.42:0/383939630 >> v2:172.21.15.84:3300/0 conn(0x7f30980a69a0 msgr2=0x7f30980a6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:43.530 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.518+0000 7f30977fe700 1 --2- 172.21.15.42:0/383939630 >> v2:172.21.15.84:3300/0 conn(0x7f30980a69a0 0x7f30980a6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:43.530 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.518+0000 7f30977fe700 1 -- 172.21.15.42:0/383939630 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30980ab4f0 con 0x7f3098065ce0 2020-04-02T23:24:43.530 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.518+0000 7f308ffff700 1 --2- 172.21.15.42:0/383939630 >> v2:172.21.15.84:3300/0 conn(0x7f30980a69a0 0x7f30980a6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:24:43.530 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.519+0000 7f30977fe700 1 --2- 172.21.15.42:0/383939630 >> v2:172.21.15.42:3300/0 conn(0x7f3098065ce0 0x7f30980ab090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3088002f30 tx=0x7f3088007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.530 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.519+0000 7f30977fe700 1 --2- 172.21.15.42:0/383939630 >> v2:172.21.15.42:3300/0 conn(0x7f3098065ce0 0x7f30980ab090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3088002f30 tx=0x7f3088007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.531 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.519+0000 7f30977fe700 1 --2- 172.21.15.42:0/383939630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3098065ce0 0x7f30980ab090 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f3088002f30 tx=0x7f3088007a40).ready entity=mon.0 client_cookie=9cbffdd80e67966a server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:43.531 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.519+0000 7f30977fe700 1 --2- 172.21.15.42:0/383939630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3098065ce0 0x7f30980ab090 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f3088002f30 tx=0x7f3088007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.531 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.519+0000 7f30977fe700 1 --2- 172.21.15.42:0/383939630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3098065ce0 0x7f30980ab090 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f3088002f30 tx=0x7f3088007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.531 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.519+0000 7f3096ffd700 1 -- 172.21.15.42:0/383939630 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3088011720 con 0x7f3098065ce0 2020-04-02T23:24:43.531 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.519+0000 7f30977fe700 1 --2- 172.21.15.42:0/383939630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3098065ce0 0x7f30980ab090 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f3088002f30 tx=0x7f3088007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.531 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.519+0000 7f3096ffd700 1 -- 172.21.15.42:0/383939630 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3088011880 con 0x7f3098065ce0 2020-04-02T23:24:43.531 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.519+0000 7f3096ffd700 1 -- 172.21.15.42:0/383939630 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3088011c20 con 0x7f3098065ce0 2020-04-02T23:24:43.532 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.519+0000 7f309de7e700 1 -- 172.21.15.42:0/383939630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3098065ce0 msgr2=0x7f30980ab090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:43.532 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.519+0000 7f309de7e700 1 --2- 172.21.15.42:0/383939630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3098065ce0 0x7f30980ab090 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f3088002f30 tx=0x7f3088007a40).stop 2020-04-02T23:24:43.532 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.519+0000 7f309de7e700 1 -- 172.21.15.42:0/383939630 shutdown_connections 2020-04-02T23:24:43.532 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.519+0000 7f309de7e700 1 --2- 172.21.15.42:0/383939630 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f309813c1f0 0x7f309813c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:43.532 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.519+0000 7f309de7e700 1 --2- 172.21.15.42:0/383939630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3098065ce0 0x7f30980ab090 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:43.532 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.519+0000 7f309de7e700 1 --2- 172.21.15.42:0/383939630 >> v2:172.21.15.84:3300/0 conn(0x7f30980a69a0 0x7f30980a6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:43.532 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.519+0000 7f309de7e700 1 -- 172.21.15.42:0/383939630 >> 172.21.15.42:0/383939630 conn(0x7f309805b720 msgr2=0x7f30980aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:43.533 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.519+0000 7f309de7e700 1 -- 172.21.15.42:0/383939630 shutdown_connections 2020-04-02T23:24:43.533 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.519+0000 7f309de7e700 1 -- 172.21.15.42:0/383939630 wait complete. 2020-04-02T23:24:43.533 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.520+0000 7f309de7e700 1 Processor -- start 2020-04-02T23:24:43.533 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.520+0000 7f309de7e700 1 -- start start 2020-04-02T23:24:43.534 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.521+0000 7f309de7e700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3098065ce0 0x7f309809d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:43.534 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.521+0000 7f309de7e700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f30980a69a0 0x7f3098099380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:43.534 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.521+0000 7f309de7e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f309809bcb0 con 0x7f309813c1f0 2020-04-02T23:24:43.534 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.521+0000 7f309de7e700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309809b0e0 con 0x7f30980a69a0 2020-04-02T23:24:43.534 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.521+0000 7f309de7e700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309809bf10 con 0x7f3098065ce0 2020-04-02T23:24:43.534 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.521+0000 7f308ffff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f30980a69a0 0x7f3098099380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:43.534 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.521+0000 7f308ffff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f30980a69a0 0x7f3098099380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39722/0 (socket says 172.21.15.42:39722) 2020-04-02T23:24:43.535 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.521+0000 7f308ffff700 1 -- 172.21.15.42:0/2783052725 learned_addr learned my addr 172.21.15.42:0/2783052725 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:43.535 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.521+0000 7f30977fe700 1 --2- 172.21.15.42:0/2783052725 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3098065ce0 0x7f309809d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:43.535 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.521+0000 7f30957fa700 1 -- 172.21.15.42:0/2783052725 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135458224 0 0) 0x7f309809bcb0 con 0x7f309813c1f0 2020-04-02T23:24:43.535 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.521+0000 7f308ffff700 1 -- 172.21.15.42:0/2783052725 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3098065ce0 msgr2=0x7f309809d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:43.535 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.521+0000 7f308ffff700 1 --2- 172.21.15.42:0/2783052725 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3098065ce0 0x7f309809d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:43.535 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.521+0000 7f308ffff700 1 -- 172.21.15.42:0/2783052725 >> v1:172.21.15.84:6789/0 conn(0x7f309813c1f0 legacy=0x7f30981471f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:43.535 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.521+0000 7f308ffff700 1 -- 172.21.15.42:0/2783052725 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309809c1b0 con 0x7f30980a69a0 2020-04-02T23:24:43.536 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.521+0000 7f308ffff700 1 --2- 172.21.15.42:0/2783052725 >> v2:172.21.15.42:3300/0 conn(0x7f30980a69a0 0x7f3098099380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3080007920 tx=0x7f3080010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.536 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.521+0000 7f308ffff700 1 --2- 172.21.15.42:0/2783052725 >> v2:172.21.15.42:3300/0 conn(0x7f30980a69a0 0x7f3098099380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3080007920 tx=0x7f3080010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.536 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.521+0000 7f308ffff700 1 --2- 172.21.15.42:0/2783052725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30980a69a0 0x7f3098099380 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f3080007920 tx=0x7f3080010b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:43.536 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.522+0000 7f308ffff700 1 --2- 172.21.15.42:0/2783052725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30980a69a0 0x7f3098099380 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f3080007920 tx=0x7f3080010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.536 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.522+0000 7f308ffff700 1 --2- 172.21.15.42:0/2783052725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30980a69a0 0x7f3098099380 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f3080007920 tx=0x7f3080010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.536 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.522+0000 7f30957fa700 1 -- 172.21.15.42:0/2783052725 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3080005e90 con 0x7f30980a69a0 2020-04-02T23:24:43.536 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.522+0000 7f308ffff700 1 --2- 172.21.15.42:0/2783052725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30980a69a0 0x7f3098099380 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f3080007920 tx=0x7f3080010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.537 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.522+0000 7f30957fa700 1 -- 172.21.15.42:0/2783052725 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3080007160 con 0x7f30980a69a0 2020-04-02T23:24:43.537 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.522+0000 7f309de7e700 1 -- 172.21.15.42:0/2783052725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309809e490 con 0x7f30980a69a0 2020-04-02T23:24:43.537 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.522+0000 7f30957fa700 1 -- 172.21.15.42:0/2783052725 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3080007500 con 0x7f30980a69a0 2020-04-02T23:24:43.537 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.522+0000 7f309de7e700 1 -- 172.21.15.42:0/2783052725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309809c650 con 0x7f30980a69a0 2020-04-02T23:24:43.537 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.522+0000 7f308ffff700 1 --2- 172.21.15.42:0/2783052725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30980a69a0 0x7f3098099380 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f3080007920 tx=0x7f3080010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.537 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.523+0000 7f309de7e700 1 -- 172.21.15.42:0/2783052725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309805d2e0 con 0x7f30980a69a0 2020-04-02T23:24:43.538 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.523+0000 7f30957fa700 1 -- 172.21.15.42:0/2783052725 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f308000e300 con 0x7f30980a69a0 2020-04-02T23:24:43.538 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.523+0000 7f308ffff700 1 --2- 172.21.15.42:0/2783052725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30980a69a0 0x7f3098099380 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f3080007920 tx=0x7f3080010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.538 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.523+0000 7f30957fa700 1 --2- 172.21.15.42:0/2783052725 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f307c04d430 0x7f307c04f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:43.538 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.523+0000 7f30957fa700 1 -- 172.21.15.42:0/2783052725 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3080007e40 con 0x7f30980a69a0 2020-04-02T23:24:43.538 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.523+0000 7f30977fe700 1 --2- 172.21.15.42:0/2783052725 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f307c04d430 0x7f307c04f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:43.538 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.523+0000 7f30977fe700 1 --2- 172.21.15.42:0/2783052725 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f307c04d430 0x7f307c04f8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3088002f30 tx=0x7f3088007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.539 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.523+0000 7f30977fe700 1 --2- 172.21.15.42:0/2783052725 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f307c04d430 0x7f307c04f8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3088002f30 tx=0x7f3088007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.539 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.523+0000 7f30977fe700 1 --2- 172.21.15.42:0/2783052725 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f307c04d430 0x7f307c04f8f0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f3088002f30 tx=0x7f3088007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:43.539 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.526+0000 7f308ffff700 1 --2- 172.21.15.42:0/2783052725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30980a69a0 0x7f3098099380 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f3080007920 tx=0x7f3080010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.539 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.526+0000 7f30957fa700 1 -- 172.21.15.42:0/2783052725 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f308003c830 con 0x7f30980a69a0 2020-04-02T23:24:43.675 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.673+0000 7f309de7e700 1 -- 172.21.15.42:0/2783052725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f309809c340 con 0x7f30980a69a0 2020-04-02T23:24:43.971 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.969+0000 7f308ffff700 1 --2- 172.21.15.42:0/2783052725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30980a69a0 0x7f3098099380 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f3080007920 tx=0x7f3080010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:43.971 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.969+0000 7f30957fa700 1 -- 172.21.15.42:0/2783052725 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v21) v1 ==== 133+0+0 (secure 0 0 0) 0x7f308000a0e0 con 0x7f30980a69a0 2020-04-02T23:24:43.973 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.971+0000 7f309de7e700 1 -- 172.21.15.42:0/2783052725 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f307c04d430 msgr2=0x7f307c04f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:43.974 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.971+0000 7f309de7e700 1 --2- 172.21.15.42:0/2783052725 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f307c04d430 0x7f307c04f8f0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7f3088002f30 tx=0x7f3088007a40).stop 2020-04-02T23:24:43.974 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.971+0000 7f309de7e700 1 -- 172.21.15.42:0/2783052725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30980a69a0 msgr2=0x7f3098099380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:43.974 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.971+0000 7f309de7e700 1 --2- 172.21.15.42:0/2783052725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30980a69a0 0x7f3098099380 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f3080007920 tx=0x7f3080010b90).stop 2020-04-02T23:24:43.974 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.971+0000 7f309de7e700 1 -- 172.21.15.42:0/2783052725 shutdown_connections 2020-04-02T23:24:43.974 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.971+0000 7f309de7e700 1 --2- 172.21.15.42:0/2783052725 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f307c04d430 0x7f307c04f8f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:43.974 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.971+0000 7f309de7e700 1 --2- 172.21.15.42:0/2783052725 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3098065ce0 0x7f309809d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:43.975 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.971+0000 7f309de7e700 1 --2- 172.21.15.42:0/2783052725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30980a69a0 0x7f3098099380 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:43.975 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.971+0000 7f309de7e700 1 -- 172.21.15.42:0/2783052725 >> 172.21.15.42:0/2783052725 conn(0x7f309805b720 msgr2=0x7f309813ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:43.975 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.971+0000 7f309de7e700 1 -- 172.21.15.42:0/2783052725 shutdown_connections 2020-04-02T23:24:43.975 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:43.971+0000 7f309de7e700 1 -- 172.21.15.42:0/2783052725 wait complete. 2020-04-02T23:24:43.975 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2020-04-02T23:24:43.984 INFO:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2020-04-02T23:24:43.984 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:43.999 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2020-04-02T23:24:44.158 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.156+0000 7f7856a45700 1 Processor -- start 2020-04-02T23:24:44.158 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.156+0000 7f7856a45700 1 -- start start 2020-04-02T23:24:44.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.157+0000 7f7856a45700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f78500ab410 0x7f78500a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:44.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.157+0000 7f7856a45700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f78500a23e0 0x7f78500a2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:44.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.157+0000 7f7856a45700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78500a31b0 con 0x7f78500a6a90 2020-04-02T23:24:44.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.157+0000 7f7856a45700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78500a49f0 con 0x7f78500ab410 2020-04-02T23:24:44.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.157+0000 7f7856a45700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785005ff40 con 0x7f78500a23e0 2020-04-02T23:24:44.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.157+0000 7f7854fe2700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f78500a23e0 0x7f78500a2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:44.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.157+0000 7f784ffff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f78500ab410 0x7f78500a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:44.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.157+0000 7f7854fe2700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f78500a23e0 0x7f78500a2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.42:59484/0 (socket says 172.21.15.42:59484) 2020-04-02T23:24:44.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.157+0000 7f7854fe2700 1 -- 172.21.15.42:0/967911700 learned_addr learned my addr 172.21.15.42:0/967911700 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:44.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.157+0000 7f7854fe2700 1 -- 172.21.15.42:0/967911700 >> v2:172.21.15.84:3300/0 conn(0x7f78500ab410 msgr2=0x7f78500a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:44.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.157+0000 7f7854fe2700 1 --2- 172.21.15.42:0/967911700 >> v2:172.21.15.84:3300/0 conn(0x7f78500ab410 0x7f78500a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:44.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.157+0000 7f7854fe2700 1 -- 172.21.15.42:0/967911700 >> v1:172.21.15.84:6789/0 conn(0x7f78500a6a90 legacy=0x7f78500a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:44.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.157+0000 7f7854fe2700 1 -- 172.21.15.42:0/967911700 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78500a3420 con 0x7f78500a23e0 2020-04-02T23:24:44.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.157+0000 7f784ffff700 1 --2- 172.21.15.42:0/967911700 >> v2:172.21.15.84:3300/0 conn(0x7f78500ab410 0x7f78500a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:44.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.157+0000 7f7854fe2700 1 --2- 172.21.15.42:0/967911700 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f78500a23e0 0x7f78500a2830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f78480032b0 tx=0x7f7848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:44.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.157+0000 7f7854fe2700 1 --2- 172.21.15.42:0/967911700 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f78500a23e0 0x7f78500a2830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f78480032b0 tx=0x7f7848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:44.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.157+0000 7f7854fe2700 1 --2- 172.21.15.42:0/967911700 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f78500a23e0 0x7f78500a2830 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f78480032b0 tx=0x7f7848007dc0).ready entity=mon.2 client_cookie=55f8126c4b2437a5 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:44.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.158+0000 7f7854fe2700 1 --2- 172.21.15.42:0/967911700 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f78500a23e0 0x7f78500a2830 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f78480032b0 tx=0x7f7848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:44.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.158+0000 7f784effd700 1 -- 172.21.15.42:0/967911700 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f784800a160 con 0x7f78500a23e0 2020-04-02T23:24:44.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.158+0000 7f7854fe2700 1 --2- 172.21.15.42:0/967911700 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f78500a23e0 0x7f78500a2830 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f78480032b0 tx=0x7f7848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:44.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.158+0000 7f7854fe2700 1 --2- 172.21.15.42:0/967911700 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f78500a23e0 0x7f78500a2830 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7f78480032b0 tx=0x7f7848007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:44.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.158+0000 7f784effd700 1 -- 172.21.15.42:0/967911700 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784800a2c0 con 0x7f78500a23e0 2020-04-02T23:24:44.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.158+0000 7f784effd700 1 -- 172.21.15.42:0/967911700 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f784800a6e0 con 0x7f78500a23e0 2020-04-02T23:24:44.167 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.158+0000 7f7856a45700 1 -- 172.21.15.42:0/967911700 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f78500a23e0 msgr2=0x7f78500a2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:44.167 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.158+0000 7f7856a45700 1 --2- 172.21.15.42:0/967911700 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f78500a23e0 0x7f78500a2830 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7f78480032b0 tx=0x7f7848007dc0).stop 2020-04-02T23:24:44.167 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.158+0000 7f7856a45700 1 -- 172.21.15.42:0/967911700 shutdown_connections 2020-04-02T23:24:44.168 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.158+0000 7f7856a45700 1 --2- 172.21.15.42:0/967911700 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f78500a23e0 0x7f78500a2830 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:44.168 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.158+0000 7f7856a45700 1 --2- 172.21.15.42:0/967911700 >> v2:172.21.15.84:3300/0 conn(0x7f78500ab410 0x7f78500a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:44.168 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.158+0000 7f7856a45700 1 -- 172.21.15.42:0/967911700 >> 172.21.15.42:0/967911700 conn(0x7f785005b720 msgr2=0x7f78500aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:44.168 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.158+0000 7f7856a45700 1 -- 172.21.15.42:0/967911700 shutdown_connections 2020-04-02T23:24:44.169 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.158+0000 7f7856a45700 1 -- 172.21.15.42:0/967911700 wait complete. 2020-04-02T23:24:44.169 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.159+0000 7f7856a45700 1 Processor -- start 2020-04-02T23:24:44.169 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.159+0000 7f7856a45700 1 -- start start 2020-04-02T23:24:44.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.160+0000 7f7856a45700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f78500a23e0 0x7f7850066490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:44.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.160+0000 7f7856a45700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f78500ab410 0x7f78500668f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:44.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.160+0000 7f7856a45700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7850065ab0 con 0x7f78500a6a90 2020-04-02T23:24:44.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.160+0000 7f7856a45700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7850064d20 con 0x7f78500a23e0 2020-04-02T23:24:44.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.160+0000 7f7856a45700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7850065d50 con 0x7f78500ab410 2020-04-02T23:24:44.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.160+0000 7f784ffff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f78500a23e0 0x7f7850066490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:44.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.160+0000 7f784ffff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f78500a23e0 0x7f7850066490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39734/0 (socket says 172.21.15.42:39734) 2020-04-02T23:24:44.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.160+0000 7f784ffff700 1 -- 172.21.15.42:0/861592803 learned_addr learned my addr 172.21.15.42:0/861592803 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:44.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.160+0000 7f7854fe2700 1 --2- 172.21.15.42:0/861592803 >> v2:172.21.15.84:3300/0 conn(0x7f78500ab410 0x7f78500668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:44.174 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.160+0000 7f784d7fa700 1 -- 172.21.15.42:0/861592803 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77441799 0 0) 0x7f7850065ab0 con 0x7f78500a6a90 2020-04-02T23:24:44.174 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.160+0000 7f784d7fa700 1 -- 172.21.15.42:0/861592803 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7830002fe0 con 0x7f78500a6a90 2020-04-02T23:24:44.174 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.160+0000 7f784ffff700 1 -- 172.21.15.42:0/861592803 >> v2:172.21.15.84:3300/0 conn(0x7f78500ab410 msgr2=0x7f78500668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:44.174 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.160+0000 7f784ffff700 1 --2- 172.21.15.42:0/861592803 >> v2:172.21.15.84:3300/0 conn(0x7f78500ab410 0x7f78500668f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:44.174 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.160+0000 7f784ffff700 1 -- 172.21.15.42:0/861592803 >> v1:172.21.15.84:6789/0 conn(0x7f78500a6a90 legacy=0x7f78501377a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:44.174 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.160+0000 7f784ffff700 1 -- 172.21.15.42:0/861592803 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7850065ff0 con 0x7f78500a23e0 2020-04-02T23:24:44.174 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.160+0000 7f784ffff700 1 --2- 172.21.15.42:0/861592803 >> v2:172.21.15.42:3300/0 conn(0x7f78500a23e0 0x7f7850066490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7840002ef0 tx=0x7f7840010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:44.175 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.160+0000 7f784ffff700 1 --2- 172.21.15.42:0/861592803 >> v2:172.21.15.42:3300/0 conn(0x7f78500a23e0 0x7f7850066490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7840002ef0 tx=0x7f7840010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:44.175 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.160+0000 7f784ffff700 1 --2- 172.21.15.42:0/861592803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78500a23e0 0x7f7850066490 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f7840002ef0 tx=0x7f7840010eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:44.175 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.161+0000 7f784ffff700 1 --2- 172.21.15.42:0/861592803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78500a23e0 0x7f7850066490 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f7840002ef0 tx=0x7f7840010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:44.175 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.161+0000 7f784d7fa700 1 -- 172.21.15.42:0/861592803 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7840007540 con 0x7f78500a23e0 2020-04-02T23:24:44.175 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.161+0000 7f784ffff700 1 --2- 172.21.15.42:0/861592803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78500a23e0 0x7f7850066490 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f7840002ef0 tx=0x7f7840010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:44.175 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.161+0000 7f784ffff700 1 --2- 172.21.15.42:0/861592803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78500a23e0 0x7f7850066490 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f7840002ef0 tx=0x7f7840010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:44.175 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.161+0000 7f784d7fa700 1 -- 172.21.15.42:0/861592803 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7840005a60 con 0x7f78500a23e0 2020-04-02T23:24:44.176 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.161+0000 7f7856a45700 1 -- 172.21.15.42:0/861592803 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f785009aab0 con 0x7f78500a23e0 2020-04-02T23:24:44.176 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.161+0000 7f784d7fa700 1 -- 172.21.15.42:0/861592803 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7840005e80 con 0x7f78500a23e0 2020-04-02T23:24:44.176 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.161+0000 7f7856a45700 1 -- 172.21.15.42:0/861592803 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78501410b0 con 0x7f78500a23e0 2020-04-02T23:24:44.176 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.161+0000 7f784ffff700 1 --2- 172.21.15.42:0/861592803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78500a23e0 0x7f7850066490 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f7840002ef0 tx=0x7f7840010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:44.176 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.162+0000 7f7856a45700 1 -- 172.21.15.42:0/861592803 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f785005d2e0 con 0x7f78500a23e0 2020-04-02T23:24:44.176 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.162+0000 7f784d7fa700 1 -- 172.21.15.42:0/861592803 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f7840010180 con 0x7f78500a23e0 2020-04-02T23:24:44.176 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.162+0000 7f784ffff700 1 --2- 172.21.15.42:0/861592803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78500a23e0 0x7f7850066490 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f7840002ef0 tx=0x7f7840010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:44.177 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.162+0000 7f784d7fa700 1 --2- 172.21.15.42:0/861592803 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f783004d8f0 0x7f783004fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:44.177 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.162+0000 7f784d7fa700 1 -- 172.21.15.42:0/861592803 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f7840061160 con 0x7f78500a23e0 2020-04-02T23:24:44.177 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.162+0000 7f784f7fe700 1 --2- 172.21.15.42:0/861592803 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f783004d8f0 0x7f783004fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:44.177 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.163+0000 7f784f7fe700 1 --2- 172.21.15.42:0/861592803 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f783004d8f0 0x7f783004fdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7844000fe0 tx=0x7f78440027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:44.177 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.163+0000 7f784f7fe700 1 --2- 172.21.15.42:0/861592803 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f783004d8f0 0x7f783004fdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7844000fe0 tx=0x7f78440027b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:44.177 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.163+0000 7f784f7fe700 1 --2- 172.21.15.42:0/861592803 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f783004d8f0 0x7f783004fdb0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f7844000fe0 tx=0x7f78440027b0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:44.177 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.166+0000 7f784ffff700 1 --2- 172.21.15.42:0/861592803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78500a23e0 0x7f7850066490 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f7840002ef0 tx=0x7f7840010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:44.178 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.166+0000 7f784d7fa700 1 -- 172.21.15.42:0/861592803 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f784003c840 con 0x7f78500a23e0 2020-04-02T23:24:44.326 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.324+0000 7f7856a45700 1 -- 172.21.15.42:0/861592803 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f7850066180 con 0x7f78500a23e0 2020-04-02T23:24:44.973 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.971+0000 7f784ffff700 1 --2- 172.21.15.42:0/861592803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78500a23e0 0x7f7850066490 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f7840002ef0 tx=0x7f7840010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:44.973 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.971+0000 7f784d7fa700 1 -- 172.21.15.42:0/861592803 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 154+0+0 (secure 0 0 0) 0x7f784003fe60 con 0x7f78500a23e0 2020-04-02T23:24:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.974+0000 7f7856a45700 1 -- 172.21.15.42:0/861592803 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f783004d8f0 msgr2=0x7f783004fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.974+0000 7f7856a45700 1 --2- 172.21.15.42:0/861592803 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f783004d8f0 0x7f783004fdb0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f7844000fe0 tx=0x7f78440027b0).stop 2020-04-02T23:24:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.974+0000 7f7856a45700 1 -- 172.21.15.42:0/861592803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78500a23e0 msgr2=0x7f7850066490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.974+0000 7f7856a45700 1 --2- 172.21.15.42:0/861592803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78500a23e0 0x7f7850066490 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f7840002ef0 tx=0x7f7840010eb0).stop 2020-04-02T23:24:44.977 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.975+0000 7f7856a45700 1 -- 172.21.15.42:0/861592803 shutdown_connections 2020-04-02T23:24:44.977 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.975+0000 7f7856a45700 1 --2- 172.21.15.42:0/861592803 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f783004d8f0 0x7f783004fdb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:44.978 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.975+0000 7f7856a45700 1 --2- 172.21.15.42:0/861592803 >> v2:172.21.15.84:3300/0 conn(0x7f78500ab410 0x7f78500668f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:44.978 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.975+0000 7f7856a45700 1 --2- 172.21.15.42:0/861592803 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78500a23e0 0x7f7850066490 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:44.978 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.975+0000 7f7856a45700 1 -- 172.21.15.42:0/861592803 >> 172.21.15.42:0/861592803 conn(0x7f785005b720 msgr2=0x7f7850069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:44.978 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.975+0000 7f7856a45700 1 -- 172.21.15.42:0/861592803 shutdown_connections 2020-04-02T23:24:44.978 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:44.975+0000 7f7856a45700 1 -- 172.21.15.42:0/861592803 wait complete. 2020-04-02T23:24:44.991 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:45.006 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 erasure cephfs_data 2020-04-02T23:24:45.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.170+0000 7f9b68f6c700 1 Processor -- start 2020-04-02T23:24:45.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.170+0000 7f9b68f6c700 1 -- start start 2020-04-02T23:24:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.170+0000 7f9b68f6c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b640ab410 0x7f9b640a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.170+0000 7f9b68f6c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9b640a6a90 0x7f9b640a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.170+0000 7f9b68f6c700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b640a2130 0x7f9b640a2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.170+0000 7f9b68f6c700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b640a31b0 con 0x7f9b640a6a90 2020-04-02T23:24:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.170+0000 7f9b68f6c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b640a49f0 con 0x7f9b640ab410 2020-04-02T23:24:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.170+0000 7f9b68f6c700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6405ff40 con 0x7f9b640a2130 2020-04-02T23:24:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b59d9b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9b640a6a90 0x7f9b640a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b59d9b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9b640a6a90 0x7f9b640a1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39744/0 (socket says 172.21.15.42:39744) 2020-04-02T23:24:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b59d9b700 1 -- 172.21.15.42:0/1667015566 learned_addr learned my addr 172.21.15.42:0/1667015566 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b6259c700 1 --2- 172.21.15.42:0/1667015566 >> v2:172.21.15.84:3300/0 conn(0x7f9b640ab410 0x7f9b640a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b62d9d700 1 --2- 172.21.15.42:0/1667015566 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b640a2130 0x7f9b640a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b59d9b700 1 -- 172.21.15.42:0/1667015566 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b640a2130 msgr2=0x7f9b640a2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b59d9b700 1 --2- 172.21.15.42:0/1667015566 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b640a2130 0x7f9b640a2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b59d9b700 1 -- 172.21.15.42:0/1667015566 >> v2:172.21.15.84:3300/0 conn(0x7f9b640ab410 msgr2=0x7f9b640a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b59d9b700 1 --2- 172.21.15.42:0/1667015566 >> v2:172.21.15.84:3300/0 conn(0x7f9b640ab410 0x7f9b640a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b59d9b700 1 -- 172.21.15.42:0/1667015566 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b640a3420 con 0x7f9b640a6a90 2020-04-02T23:24:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b59d9b700 1 --2- 172.21.15.42:0/1667015566 >> v2:172.21.15.42:3300/0 conn(0x7f9b640a6a90 0x7f9b640a1cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9b4c002f30 tx=0x7f9b4c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b59d9b700 1 --2- 172.21.15.42:0/1667015566 >> v2:172.21.15.42:3300/0 conn(0x7f9b640a6a90 0x7f9b640a1cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9b4c002f30 tx=0x7f9b4c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b59d9b700 1 --2- 172.21.15.42:0/1667015566 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b640a6a90 0x7f9b640a1cd0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f9b4c002f30 tx=0x7f9b4c007a40).ready entity=mon.0 client_cookie=78e1f42c1144dcf5 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b59d9b700 1 --2- 172.21.15.42:0/1667015566 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b640a6a90 0x7f9b640a1cd0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f9b4c002f30 tx=0x7f9b4c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b61d9b700 1 -- 172.21.15.42:0/1667015566 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b4c011720 con 0x7f9b640a6a90 2020-04-02T23:24:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b59d9b700 1 --2- 172.21.15.42:0/1667015566 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b640a6a90 0x7f9b640a1cd0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f9b4c002f30 tx=0x7f9b4c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b59d9b700 1 --2- 172.21.15.42:0/1667015566 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b640a6a90 0x7f9b640a1cd0 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f9b4c002f30 tx=0x7f9b4c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b61d9b700 1 -- 172.21.15.42:0/1667015566 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c011880 con 0x7f9b640a6a90 2020-04-02T23:24:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b61d9b700 1 -- 172.21.15.42:0/1667015566 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b4c011c60 con 0x7f9b640a6a90 2020-04-02T23:24:45.182 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b68f6c700 1 -- 172.21.15.42:0/1667015566 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b640a6a90 msgr2=0x7f9b640a1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.171+0000 7f9b68f6c700 1 --2- 172.21.15.42:0/1667015566 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b640a6a90 0x7f9b640a1cd0 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f9b4c002f30 tx=0x7f9b4c007a40).stop 2020-04-02T23:24:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.172+0000 7f9b68f6c700 1 -- 172.21.15.42:0/1667015566 shutdown_connections 2020-04-02T23:24:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.172+0000 7f9b68f6c700 1 --2- 172.21.15.42:0/1667015566 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b640a2130 0x7f9b640a2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.172+0000 7f9b68f6c700 1 --2- 172.21.15.42:0/1667015566 >> v2:172.21.15.84:3300/0 conn(0x7f9b640ab410 0x7f9b640a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.172+0000 7f9b68f6c700 1 --2- 172.21.15.42:0/1667015566 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b640a6a90 0x7f9b640a1cd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.172+0000 7f9b68f6c700 1 -- 172.21.15.42:0/1667015566 >> 172.21.15.42:0/1667015566 conn(0x7f9b6405b720 msgr2=0x7f9b640aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:45.183 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.172+0000 7f9b68f6c700 1 -- 172.21.15.42:0/1667015566 shutdown_connections 2020-04-02T23:24:45.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.172+0000 7f9b68f6c700 1 -- 172.21.15.42:0/1667015566 wait complete. 2020-04-02T23:24:45.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.173+0000 7f9b68f6c700 1 Processor -- start 2020-04-02T23:24:45.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.173+0000 7f9b68f6c700 1 -- start start 2020-04-02T23:24:45.198 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.173+0000 7f9b68f6c700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b640a6a90 0x7f9b64062e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:45.198 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.173+0000 7f9b68f6c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9b640ab410 0x7f9b640661e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:45.198 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.173+0000 7f9b68f6c700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b64066850 con 0x7f9b640a2130 2020-04-02T23:24:45.198 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.173+0000 7f9b68f6c700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b64066640 con 0x7f9b640ab410 2020-04-02T23:24:45.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.173+0000 7f9b68f6c700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b640a0bb0 con 0x7f9b640a6a90 2020-04-02T23:24:45.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.173+0000 7f9b6259c700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f9b640a2130 0x7f9b641387b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59172/0 (socket says 172.21.15.42:59172) 2020-04-02T23:24:45.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.173+0000 7f9b6259c700 1 -- 172.21.15.42:0/3306925399 learned_addr learned my addr 172.21.15.42:0/3306925399 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:45.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.173+0000 7f9b62d9d700 1 --2- 172.21.15.42:0/3306925399 >> v2:172.21.15.42:3300/0 conn(0x7f9b640ab410 0x7f9b640661e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:45.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.174+0000 7f9b5bfff700 1 -- 172.21.15.42:0/3306925399 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198849689 0 0) 0x7f9b64066850 con 0x7f9b640a2130 2020-04-02T23:24:45.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.174+0000 7f9b59d9b700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b640a6a90 0x7f9b64062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:45.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.174+0000 7f9b5bfff700 1 -- 172.21.15.42:0/3306925399 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b48002fe0 con 0x7f9b640a2130 2020-04-02T23:24:45.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.174+0000 7f9b62d9d700 1 -- 172.21.15.42:0/3306925399 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b640a6a90 msgr2=0x7f9b64062e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:45.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.174+0000 7f9b62d9d700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b640a6a90 0x7f9b64062e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:45.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.174+0000 7f9b62d9d700 1 -- 172.21.15.42:0/3306925399 >> v1:172.21.15.42:6789/0 conn(0x7f9b640a2130 legacy=0x7f9b641387b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:45.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.174+0000 7f9b62d9d700 1 -- 172.21.15.42:0/3306925399 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b640633a0 con 0x7f9b640ab410 2020-04-02T23:24:45.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.174+0000 7f9b62d9d700 1 --2- 172.21.15.42:0/3306925399 >> v2:172.21.15.42:3300/0 conn(0x7f9b640ab410 0x7f9b640661e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b5c0032b0 tx=0x7f9b5c010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:45.201 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.174+0000 7f9b62d9d700 1 --2- 172.21.15.42:0/3306925399 >> v2:172.21.15.42:3300/0 conn(0x7f9b640ab410 0x7f9b640661e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b5c0032b0 tx=0x7f9b5c010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:45.201 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.174+0000 7f9b62d9d700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b640ab410 0x7f9b640661e0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f9b5c0032b0 tx=0x7f9b5c010d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:45.201 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.174+0000 7f9b62d9d700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b640ab410 0x7f9b640661e0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f9b5c0032b0 tx=0x7f9b5c010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:45.201 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.174+0000 7f9b5bfff700 1 -- 172.21.15.42:0/3306925399 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b5c005e30 con 0x7f9b640ab410 2020-04-02T23:24:45.201 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.174+0000 7f9b62d9d700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b640ab410 0x7f9b640661e0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f9b5c0032b0 tx=0x7f9b5c010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:45.201 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.174+0000 7f9b5bfff700 1 -- 172.21.15.42:0/3306925399 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5c007540 con 0x7f9b640ab410 2020-04-02T23:24:45.201 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.174+0000 7f9b62d9d700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b640ab410 0x7f9b640661e0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f9b5c0032b0 tx=0x7f9b5c010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:45.202 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.174+0000 7f9b68f6c700 1 -- 172.21.15.42:0/3306925399 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b64063640 con 0x7f9b640ab410 2020-04-02T23:24:45.202 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.174+0000 7f9b5bfff700 1 -- 172.21.15.42:0/3306925399 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b5c0078e0 con 0x7f9b640ab410 2020-04-02T23:24:45.202 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.174+0000 7f9b68f6c700 1 -- 172.21.15.42:0/3306925399 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b64138ec0 con 0x7f9b640ab410 2020-04-02T23:24:45.202 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.175+0000 7f9b62d9d700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b640ab410 0x7f9b640661e0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f9b5c0032b0 tx=0x7f9b5c010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:45.202 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.175+0000 7f9b5bfff700 1 -- 172.21.15.42:0/3306925399 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f9b5c010170 con 0x7f9b640ab410 2020-04-02T23:24:45.202 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.175+0000 7f9b62d9d700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b640ab410 0x7f9b640661e0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f9b5c0032b0 tx=0x7f9b5c010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:45.202 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.175+0000 7f9b68f6c700 1 -- 172.21.15.42:0/3306925399 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b6405d2e0 con 0x7f9b640ab410 2020-04-02T23:24:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.175+0000 7f9b5bfff700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9b4804d8e0 0x7f9b4804fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.175+0000 7f9b5bfff700 1 -- 172.21.15.42:0/3306925399 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5863+0+0 (secure 0 0 0) 0x7f9b5c061440 con 0x7f9b640ab410 2020-04-02T23:24:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.176+0000 7f9b6259c700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9b4804d8e0 0x7f9b4804fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.176+0000 7f9b6259c700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9b4804d8e0 0x7f9b4804fda0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b54002f30 tx=0x7f9b540022e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.176+0000 7f9b6259c700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9b4804d8e0 0x7f9b4804fda0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b54002f30 tx=0x7f9b540022e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.176+0000 7f9b6259c700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9b4804d8e0 0x7f9b4804fda0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f9b54002f30 tx=0x7f9b540022e0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:45.204 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.179+0000 7f9b62d9d700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b640ab410 0x7f9b640661e0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f9b5c0032b0 tx=0x7f9b5c010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:45.204 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.179+0000 7f9b5bfff700 1 -- 172.21.15.42:0/3306925399 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f9b5c03cac0 con 0x7f9b640ab410 2020-04-02T23:24:45.327 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:45.325+0000 7f9b68f6c700 1 -- 172.21.15.42:0/3306925399 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"} v 0) v1 -- 0x7f9b64063c50 con 0x7f9b640ab410 2020-04-02T23:24:46.176 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:46.174+0000 7f9b62d9d700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b640ab410 0x7f9b640661e0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f9b5c0032b0 tx=0x7f9b5c010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:46.985 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:46.982+0000 7f9b62d9d700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b640ab410 0x7f9b640661e0 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f9b5c0032b0 tx=0x7f9b5c010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:46.985 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:46.982+0000 7f9b5bfff700 1 -- 172.21.15.42:0/3306925399 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"}]=0 pool 'cephfs_data' created v24) v1 ==== 188+0+0 (secure 0 0 0) 0x7f9b5c0400e0 con 0x7f9b640ab410 2020-04-02T23:24:46.988 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:46.986+0000 7f9b68f6c700 1 -- 172.21.15.42:0/3306925399 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9b4804d8e0 msgr2=0x7f9b4804fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:46.988 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:46.986+0000 7f9b68f6c700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9b4804d8e0 0x7f9b4804fda0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f9b54002f30 tx=0x7f9b540022e0).stop 2020-04-02T23:24:46.988 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:46.986+0000 7f9b68f6c700 1 -- 172.21.15.42:0/3306925399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b640ab410 msgr2=0x7f9b640661e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:46.988 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:46.986+0000 7f9b68f6c700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b640ab410 0x7f9b640661e0 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f9b5c0032b0 tx=0x7f9b5c010d60).stop 2020-04-02T23:24:46.989 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:46.986+0000 7f9b68f6c700 1 -- 172.21.15.42:0/3306925399 shutdown_connections 2020-04-02T23:24:46.989 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:46.986+0000 7f9b68f6c700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b640ab410 0x7f9b640661e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:46.990 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:46.986+0000 7f9b68f6c700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9b4804d8e0 0x7f9b4804fda0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:46.990 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:46.986+0000 7f9b68f6c700 1 --2- 172.21.15.42:0/3306925399 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9b640a6a90 0x7f9b64062e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:46.990 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:46.986+0000 7f9b68f6c700 1 -- 172.21.15.42:0/3306925399 >> 172.21.15.42:0/3306925399 conn(0x7f9b6405b720 msgr2=0x7f9b640aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:46.990 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:46.986+0000 7f9b68f6c700 1 -- 172.21.15.42:0/3306925399 shutdown_connections 2020-04-02T23:24:46.990 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:46.986+0000 7f9b68f6c700 1 -- 172.21.15.42:0/3306925399 wait complete. 2020-04-02T23:24:46.990 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2020-04-02T23:24:47.001 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:47.017 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool set cephfs_data allow_ec_overwrites true 2020-04-02T23:24:47.180 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.178+0000 7f00f9cbc700 1 Processor -- start 2020-04-02T23:24:47.180 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.178+0000 7f00f9cbc700 1 -- start start 2020-04-02T23:24:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.178+0000 7f00f9cbc700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00f40ad620 0x7f00f40a83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.179+0000 7f00f9cbc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f00f40a69b0 0x7f00f413a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:47.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.179+0000 7f00f9cbc700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f40a8a40 con 0x7f00f40a6530 2020-04-02T23:24:47.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.179+0000 7f00f9cbc700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f40a5af0 con 0x7f00f40a69b0 2020-04-02T23:24:47.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.179+0000 7f00f9cbc700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40a5d90 con 0x7f00f40ad620 2020-04-02T23:24:47.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.179+0000 7f00f37fe700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00f40ad620 0x7f00f40a83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:47.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.179+0000 7f00f3fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f00f40a69b0 0x7f00f413a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:47.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.179+0000 7f00f37fe700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00f40ad620 0x7f00f40a83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.42:59508/0 (socket says 172.21.15.42:59508) 2020-04-02T23:24:47.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.179+0000 7f00f37fe700 1 -- 172.21.15.42:0/3438003105 learned_addr learned my addr 172.21.15.42:0/3438003105 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.179+0000 7f00f37fe700 1 -- 172.21.15.42:0/3438003105 >> v2:172.21.15.84:3300/0 conn(0x7f00f40a69b0 msgr2=0x7f00f413a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.179+0000 7f00f37fe700 1 --2- 172.21.15.42:0/3438003105 >> v2:172.21.15.84:3300/0 conn(0x7f00f40a69b0 0x7f00f413a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.179+0000 7f00f37fe700 1 -- 172.21.15.42:0/3438003105 >> v1:172.21.15.84:6789/0 conn(0x7f00f40a6530 legacy=0x7f00f4139d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.179+0000 7f00f37fe700 1 -- 172.21.15.42:0/3438003105 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f40a6230 con 0x7f00f40ad620 2020-04-02T23:24:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.179+0000 7f00f27fc700 1 -- 172.21.15.42:0/3438003105 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60411168 0 0) 0x7f00f40a8a40 con 0x7f00f40a6530 2020-04-02T23:24:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.179+0000 7f00f3fff700 1 --2- 172.21.15.42:0/3438003105 >> v2:172.21.15.84:3300/0 conn(0x7f00f40a69b0 0x7f00f413a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.179+0000 7f00f37fe700 1 --2- 172.21.15.42:0/3438003105 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00f40ad620 0x7f00f40a83e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f00e4002f30 tx=0x7f00e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:47.186 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.179+0000 7f00f37fe700 1 --2- 172.21.15.42:0/3438003105 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00f40ad620 0x7f00f40a83e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f00e4002f30 tx=0x7f00e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:47.186 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.179+0000 7f00f37fe700 1 --2- 172.21.15.42:0/3438003105 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00f40ad620 0x7f00f40a83e0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f00e4002f30 tx=0x7f00e4007a40).ready entity=mon.2 client_cookie=32fb4c04548afe65 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:47.186 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.179+0000 7f00f37fe700 1 --2- 172.21.15.42:0/3438003105 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00f40ad620 0x7f00f40a83e0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f00e4002f30 tx=0x7f00e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:47.186 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.179+0000 7f00f27fc700 1 -- 172.21.15.42:0/3438003105 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00e4011670 con 0x7f00f40ad620 2020-04-02T23:24:47.186 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.179+0000 7f00f37fe700 1 --2- 172.21.15.42:0/3438003105 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00f40ad620 0x7f00f40a83e0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f00e4002f30 tx=0x7f00e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:47.186 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.180+0000 7f00f37fe700 1 --2- 172.21.15.42:0/3438003105 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00f40ad620 0x7f00f40a83e0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f00e4002f30 tx=0x7f00e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:47.186 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.180+0000 7f00f27fc700 1 -- 172.21.15.42:0/3438003105 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e40117d0 con 0x7f00f40ad620 2020-04-02T23:24:47.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.180+0000 7f00f27fc700 1 -- 172.21.15.42:0/3438003105 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00e4011bb0 con 0x7f00f40ad620 2020-04-02T23:24:47.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.180+0000 7f00f9cbc700 1 -- 172.21.15.42:0/3438003105 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00f40ad620 msgr2=0x7f00f40a83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:47.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.180+0000 7f00f9cbc700 1 --2- 172.21.15.42:0/3438003105 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00f40ad620 0x7f00f40a83e0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f00e4002f30 tx=0x7f00e4007a40).stop 2020-04-02T23:24:47.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.180+0000 7f00f9cbc700 1 -- 172.21.15.42:0/3438003105 shutdown_connections 2020-04-02T23:24:47.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.180+0000 7f00f9cbc700 1 --2- 172.21.15.42:0/3438003105 >> v2:172.21.15.84:3300/0 conn(0x7f00f40a69b0 0x7f00f413a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:47.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.180+0000 7f00f9cbc700 1 --2- 172.21.15.42:0/3438003105 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00f40ad620 0x7f00f40a83e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:47.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.180+0000 7f00f9cbc700 1 -- 172.21.15.42:0/3438003105 >> 172.21.15.42:0/3438003105 conn(0x7f00f4062930 msgr2=0x7f00f40acb90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:47.188 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.180+0000 7f00f9cbc700 1 -- 172.21.15.42:0/3438003105 shutdown_connections 2020-04-02T23:24:47.188 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.180+0000 7f00f9cbc700 1 -- 172.21.15.42:0/3438003105 wait complete. 2020-04-02T23:24:47.188 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.181+0000 7f00f9cbc700 1 Processor -- start 2020-04-02T23:24:47.188 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.181+0000 7f00f9cbc700 1 -- start start 2020-04-02T23:24:47.207 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f9cbc700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00f40a6530 0x7f00f409da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f9cbc700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f00f40a69b0 0x7f00f409a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f9cbc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f00f40ad620 0x7f00f4144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f9cbc700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f4143f30 con 0x7f00f40a69b0 2020-04-02T23:24:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f9cbc700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f41441d0 con 0x7f00f40ad620 2020-04-02T23:24:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f9cbc700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f4144470 con 0x7f00f40a6530 2020-04-02T23:24:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f37fe700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00f40a6530 0x7f00f409da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:47.209 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f2ffd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f00f40a69b0 0x7f00f409a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:47.209 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f37fe700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00f40a6530 0x7f00f409da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.42:59514/0 (socket says 172.21.15.42:59514) 2020-04-02T23:24:47.209 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f37fe700 1 -- 172.21.15.42:0/3327292075 learned_addr learned my addr 172.21.15.42:0/3327292075 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:47.209 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f3fff700 1 --2- 172.21.15.42:0/3327292075 >> v2:172.21.15.84:3300/0 conn(0x7f00f40ad620 0x7f00f4144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:47.209 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f3fff700 1 -- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00f40a6530 msgr2=0x7f00f409da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:47.209 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f3fff700 1 --2- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00f40a6530 0x7f00f409da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:47.209 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f3fff700 1 -- 172.21.15.42:0/3327292075 >> v2:172.21.15.42:3300/0 conn(0x7f00f40a69b0 msgr2=0x7f00f409a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:47.210 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f3fff700 1 --2- 172.21.15.42:0/3327292075 >> v2:172.21.15.42:3300/0 conn(0x7f00f40a69b0 0x7f00f409a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:47.210 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f3fff700 1 -- 172.21.15.42:0/3327292075 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f409f320 con 0x7f00f40ad620 2020-04-02T23:24:47.210 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f37fe700 1 --2- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00f40a6530 0x7f00f409da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:47.210 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f2ffd700 1 --2- 172.21.15.42:0/3327292075 >> v2:172.21.15.42:3300/0 conn(0x7f00f40a69b0 0x7f00f409a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:47.210 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f3fff700 1 --2- 172.21.15.42:0/3327292075 >> v2:172.21.15.84:3300/0 conn(0x7f00f40ad620 0x7f00f4144910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f00ec0032b0 tx=0x7f00ec011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:47.210 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f3fff700 1 --2- 172.21.15.42:0/3327292075 >> v2:172.21.15.84:3300/0 conn(0x7f00f40ad620 0x7f00f4144910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f00ec0032b0 tx=0x7f00ec011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:47.210 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f3fff700 1 --2- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f40ad620 0x7f00f4144910 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f00ec0032b0 tx=0x7f00ec011040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:47.211 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f3fff700 1 --2- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f40ad620 0x7f00f4144910 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f00ec0032b0 tx=0x7f00ec011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:47.211 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f0ff9700 1 -- 172.21.15.42:0/3327292075 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00ec005e30 con 0x7f00f40ad620 2020-04-02T23:24:47.211 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f3fff700 1 --2- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f40ad620 0x7f00f4144910 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f00ec0032b0 tx=0x7f00ec011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:47.211 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f0ff9700 1 -- 172.21.15.42:0/3327292075 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec007540 con 0x7f00f40ad620 2020-04-02T23:24:47.211 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f3fff700 1 --2- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f40ad620 0x7f00f4144910 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f00ec0032b0 tx=0x7f00ec011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:47.211 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f9cbc700 1 -- 172.21.15.42:0/3327292075 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f40aaad0 con 0x7f00f40ad620 2020-04-02T23:24:47.211 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.182+0000 7f00f0ff9700 1 -- 172.21.15.42:0/3327292075 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00ec00c6f0 con 0x7f00f40ad620 2020-04-02T23:24:47.211 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.183+0000 7f00f9cbc700 1 -- 172.21.15.42:0/3327292075 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f409ee50 con 0x7f00f40ad620 2020-04-02T23:24:47.212 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.183+0000 7f00f3fff700 1 --2- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f40ad620 0x7f00f4144910 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f00ec0032b0 tx=0x7f00ec011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:47.212 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.183+0000 7f00f9cbc700 1 -- 172.21.15.42:0/3327292075 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f4056c50 con 0x7f00f40ad620 2020-04-02T23:24:47.213 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.184+0000 7f00f0ff9700 1 -- 172.21.15.42:0/3327292075 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f00ec00e180 con 0x7f00f40ad620 2020-04-02T23:24:47.213 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.184+0000 7f00f3fff700 1 --2- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f40ad620 0x7f00f4144910 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f00ec0032b0 tx=0x7f00ec011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:47.213 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.184+0000 7f00f0ff9700 1 --2- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f00d404d5c0 0x7f00d404fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:47.213 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.184+0000 7f00f0ff9700 1 -- 172.21.15.42:0/3327292075 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6315+0+0 (secure 0 0 0) 0x7f00ec060fe0 con 0x7f00f40ad620 2020-04-02T23:24:47.213 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.184+0000 7f00f37fe700 1 --2- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f00d404d5c0 0x7f00d404fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:47.213 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.184+0000 7f00f37fe700 1 --2- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f00d404d5c0 0x7f00d404fa80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f00e4002f30 tx=0x7f00e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:47.214 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.184+0000 7f00f37fe700 1 --2- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f00d404d5c0 0x7f00d404fa80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f00e4002f30 tx=0x7f00e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:47.214 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.184+0000 7f00f37fe700 1 --2- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f00d404d5c0 0x7f00d404fa80 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f00e4002f30 tx=0x7f00e4007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:47.214 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.187+0000 7f00f3fff700 1 --2- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f40ad620 0x7f00f4144910 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f00ec0032b0 tx=0x7f00ec011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:47.214 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.187+0000 7f00f0ff9700 1 -- 172.21.15.42:0/3327292075 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f00ec03c6c0 con 0x7f00f40ad620 2020-04-02T23:24:47.335 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.333+0000 7f00f9cbc700 1 -- 172.21.15.42:0/3327292075 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f00f41445e0 con 0x7f00f40ad620 2020-04-02T23:24:47.988 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.986+0000 7f00f3fff700 1 --2- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f40ad620 0x7f00f4144910 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7f00ec0032b0 tx=0x7f00ec011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:47.988 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.986+0000 7f00f0ff9700 1 -- 172.21.15.42:0/3327292075 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) v1 ==== 166+0+0 (secure 0 0 0) 0x7f00ec00e410 con 0x7f00f40ad620 2020-04-02T23:24:47.992 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.990+0000 7f00f9cbc700 1 -- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f00d404d5c0 msgr2=0x7f00d404fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:47.993 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.990+0000 7f00f9cbc700 1 --2- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f00d404d5c0 0x7f00d404fa80 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f00e4002f30 tx=0x7f00e4007a40).stop 2020-04-02T23:24:47.993 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.990+0000 7f00f9cbc700 1 -- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f40ad620 msgr2=0x7f00f4144910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:47.993 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.990+0000 7f00f9cbc700 1 --2- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f40ad620 0x7f00f4144910 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f00ec0032b0 tx=0x7f00ec011040).stop 2020-04-02T23:24:47.993 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.990+0000 7f00f9cbc700 1 -- 172.21.15.42:0/3327292075 shutdown_connections 2020-04-02T23:24:47.993 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.990+0000 7f00f9cbc700 1 --2- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f40ad620 0x7f00f4144910 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:47.993 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.990+0000 7f00f9cbc700 1 --2- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f00d404d5c0 0x7f00d404fa80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:47.994 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.990+0000 7f00f9cbc700 1 --2- 172.21.15.42:0/3327292075 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00f40a6530 0x7f00f409da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:47.994 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.990+0000 7f00f9cbc700 1 --2- 172.21.15.42:0/3327292075 >> v2:172.21.15.42:3300/0 conn(0x7f00f40a69b0 0x7f00f409a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:47.994 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.990+0000 7f00f9cbc700 1 -- 172.21.15.42:0/3327292075 >> 172.21.15.42:0/3327292075 conn(0x7f00f4062930 msgr2=0x7f00f409ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:47.994 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.991+0000 7f00f9cbc700 1 -- 172.21.15.42:0/3327292075 shutdown_connections 2020-04-02T23:24:47.994 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:47.991+0000 7f00f9cbc700 1 -- 172.21.15.42:0/3327292075 wait complete. 2020-04-02T23:24:47.994 INFO:teuthology.orchestra.run.smithi042.stderr:set pool 4 allow_ec_overwrites to true 2020-04-02T23:24:48.005 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:48.021 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-04-02T23:24:48.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.185+0000 7f4a7e5df700 1 Processor -- start 2020-04-02T23:24:48.188 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.185+0000 7f4a7e5df700 1 -- start start 2020-04-02T23:24:48.192 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.186+0000 7f4a7e5df700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4a780ab090 0x7f4a780a5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:48.192 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.186+0000 7f4a7e5df700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4a780a56b0 0x7f4a780a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:48.193 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.186+0000 7f4a7e5df700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a780a1cd0 con 0x7f4a78065ce0 2020-04-02T23:24:48.193 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.186+0000 7f4a7e5df700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a780ab540 con 0x7f4a780ab090 2020-04-02T23:24:48.193 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.186+0000 7f4a7e5df700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a780ab7a0 con 0x7f4a780a56b0 2020-04-02T23:24:48.193 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.186+0000 7f4a777fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4a780ab090 0x7f4a780a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:48.193 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.186+0000 7f4a77fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f4a78065ce0 0x7f4a780a69a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59194/0 (socket says 172.21.15.42:59194) 2020-04-02T23:24:48.193 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.186+0000 7f4a77fff700 1 -- 172.21.15.42:0/1330925698 learned_addr learned my addr 172.21.15.42:0/1330925698 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:48.193 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.186+0000 7f4a7cb7c700 1 --2- 172.21.15.42:0/1330925698 >> v2:172.21.15.84:3300/0 conn(0x7f4a780a56b0 0x7f4a780a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:48.194 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.186+0000 7f4a777fe700 1 -- 172.21.15.42:0/1330925698 >> v2:172.21.15.84:3300/0 conn(0x7f4a780a56b0 msgr2=0x7f4a780a5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:48.194 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.186+0000 7f4a777fe700 1 --2- 172.21.15.42:0/1330925698 >> v2:172.21.15.84:3300/0 conn(0x7f4a780a56b0 0x7f4a780a5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:48.194 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.186+0000 7f4a777fe700 1 -- 172.21.15.42:0/1330925698 >> v1:172.21.15.42:6789/0 conn(0x7f4a78065ce0 legacy=0x7f4a780a69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:48.194 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.186+0000 7f4a76ffd700 1 -- 172.21.15.42:0/1330925698 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061967395 0 0) 0x7f4a780a1cd0 con 0x7f4a78065ce0 2020-04-02T23:24:48.194 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.186+0000 7f4a777fe700 1 -- 172.21.15.42:0/1330925698 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a780a6500 con 0x7f4a780ab090 2020-04-02T23:24:48.194 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.186+0000 7f4a7cb7c700 1 --2- 172.21.15.42:0/1330925698 >> v2:172.21.15.84:3300/0 conn(0x7f4a780a56b0 0x7f4a780a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:24:48.194 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.186+0000 7f4a777fe700 1 --2- 172.21.15.42:0/1330925698 >> v2:172.21.15.42:3300/0 conn(0x7f4a780ab090 0x7f4a780a5250 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4a6c002f30 tx=0x7f4a6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.195 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.187+0000 7f4a777fe700 1 --2- 172.21.15.42:0/1330925698 >> v2:172.21.15.42:3300/0 conn(0x7f4a780ab090 0x7f4a780a5250 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4a6c002f30 tx=0x7f4a6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.195 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.187+0000 7f4a777fe700 1 --2- 172.21.15.42:0/1330925698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a780ab090 0x7f4a780a5250 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f4a6c002f30 tx=0x7f4a6c007a40).ready entity=mon.0 client_cookie=307faec1db567f20 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:48.195 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.187+0000 7f4a777fe700 1 --2- 172.21.15.42:0/1330925698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a780ab090 0x7f4a780a5250 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f4a6c002f30 tx=0x7f4a6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.195 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.187+0000 7f4a76ffd700 1 -- 172.21.15.42:0/1330925698 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a6c011470 con 0x7f4a780ab090 2020-04-02T23:24:48.195 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.187+0000 7f4a777fe700 1 --2- 172.21.15.42:0/1330925698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a780ab090 0x7f4a780a5250 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f4a6c002f30 tx=0x7f4a6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.195 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.187+0000 7f4a777fe700 1 --2- 172.21.15.42:0/1330925698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a780ab090 0x7f4a780a5250 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f4a6c002f30 tx=0x7f4a6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.195 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.187+0000 7f4a76ffd700 1 -- 172.21.15.42:0/1330925698 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c0115d0 con 0x7f4a780ab090 2020-04-02T23:24:48.196 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.187+0000 7f4a76ffd700 1 -- 172.21.15.42:0/1330925698 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a6c011970 con 0x7f4a780ab090 2020-04-02T23:24:48.196 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.187+0000 7f4a7e5df700 1 -- 172.21.15.42:0/1330925698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a780ab090 msgr2=0x7f4a780a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:48.196 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.187+0000 7f4a7e5df700 1 --2- 172.21.15.42:0/1330925698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a780ab090 0x7f4a780a5250 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f4a6c002f30 tx=0x7f4a6c007a40).stop 2020-04-02T23:24:48.196 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.187+0000 7f4a7e5df700 1 -- 172.21.15.42:0/1330925698 shutdown_connections 2020-04-02T23:24:48.196 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.187+0000 7f4a7e5df700 1 --2- 172.21.15.42:0/1330925698 >> v2:172.21.15.84:3300/0 conn(0x7f4a780a56b0 0x7f4a780a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:48.196 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.187+0000 7f4a7e5df700 1 --2- 172.21.15.42:0/1330925698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a780ab090 0x7f4a780a5250 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:48.196 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.187+0000 7f4a7e5df700 1 -- 172.21.15.42:0/1330925698 >> 172.21.15.42:0/1330925698 conn(0x7f4a7805b720 msgr2=0x7f4a780aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:48.197 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.187+0000 7f4a7e5df700 1 -- 172.21.15.42:0/1330925698 shutdown_connections 2020-04-02T23:24:48.197 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.187+0000 7f4a7e5df700 1 -- 172.21.15.42:0/1330925698 wait complete. 2020-04-02T23:24:48.197 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.188+0000 7f4a7e5df700 1 Processor -- start 2020-04-02T23:24:48.197 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.188+0000 7f4a7e5df700 1 -- start start 2020-04-02T23:24:48.197 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.189+0000 7f4a7e5df700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4a780a56b0 0x7f4a780a0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:48.197 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.189+0000 7f4a7e5df700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a78146240 con 0x7f4a78065ce0 2020-04-02T23:24:48.197 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.189+0000 7f4a7e5df700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a781464e0 con 0x7f4a780ab090 2020-04-02T23:24:48.198 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.189+0000 7f4a7e5df700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a78146780 con 0x7f4a780a56b0 2020-04-02T23:24:48.198 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.189+0000 7f4a77fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f4a78065ce0 0x7f4a7809e790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59200/0 (socket says 172.21.15.42:59200) 2020-04-02T23:24:48.198 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.189+0000 7f4a777fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4a780a56b0 0x7f4a780a0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:48.198 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.189+0000 7f4a77fff700 1 -- 172.21.15.42:0/3362319956 learned_addr learned my addr 172.21.15.42:0/3362319956 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:48.198 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.189+0000 7f4a777fe700 1 -- 172.21.15.42:0/3362319956 >> v1:172.21.15.84:6789/0 conn(0x7f4a780ab090 legacy=0x7f4a781376d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:48.198 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.189+0000 7f4a757fa700 1 -- 172.21.15.42:0/3362319956 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173937257 0 0) 0x7f4a78146240 con 0x7f4a78065ce0 2020-04-02T23:24:48.198 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.189+0000 7f4a777fe700 1 -- 172.21.15.42:0/3362319956 >> v1:172.21.15.42:6789/0 conn(0x7f4a78065ce0 legacy=0x7f4a7809e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:48.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.189+0000 7f4a777fe700 1 -- 172.21.15.42:0/3362319956 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7809eea0 con 0x7f4a780a56b0 2020-04-02T23:24:48.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.189+0000 7f4a777fe700 1 --2- 172.21.15.42:0/3362319956 >> v2:172.21.15.42:3300/0 conn(0x7f4a780a56b0 0x7f4a780a0f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a6c002f30 tx=0x7f4a6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.189+0000 7f4a777fe700 1 --2- 172.21.15.42:0/3362319956 >> v2:172.21.15.42:3300/0 conn(0x7f4a780a56b0 0x7f4a780a0f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a6c002f30 tx=0x7f4a6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.189+0000 7f4a777fe700 1 --2- 172.21.15.42:0/3362319956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a780a56b0 0x7f4a780a0f90 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f4a6c002f30 tx=0x7f4a6c007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:48.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.190+0000 7f4a777fe700 1 --2- 172.21.15.42:0/3362319956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a780a56b0 0x7f4a780a0f90 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f4a6c002f30 tx=0x7f4a6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.190+0000 7f4a757fa700 1 -- 172.21.15.42:0/3362319956 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a6c007150 con 0x7f4a780a56b0 2020-04-02T23:24:48.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.190+0000 7f4a777fe700 1 --2- 172.21.15.42:0/3362319956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a780a56b0 0x7f4a780a0f90 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f4a6c002f30 tx=0x7f4a6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.190+0000 7f4a7e5df700 1 -- 172.21.15.42:0/3362319956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a78146c20 con 0x7f4a780a56b0 2020-04-02T23:24:48.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.190+0000 7f4a757fa700 1 -- 172.21.15.42:0/3362319956 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c0072b0 con 0x7f4a780a56b0 2020-04-02T23:24:48.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.190+0000 7f4a777fe700 1 --2- 172.21.15.42:0/3362319956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a780a56b0 0x7f4a780a0f90 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f4a6c002f30 tx=0x7f4a6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.190+0000 7f4a757fa700 1 -- 172.21.15.42:0/3362319956 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a6c0056c0 con 0x7f4a780a56b0 2020-04-02T23:24:48.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.190+0000 7f4a7e5df700 1 -- 172.21.15.42:0/3362319956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a78137de0 con 0x7f4a780a56b0 2020-04-02T23:24:48.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.190+0000 7f4a777fe700 1 --2- 172.21.15.42:0/3362319956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a780a56b0 0x7f4a780a0f90 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f4a6c002f30 tx=0x7f4a6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.202 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.191+0000 7f4a757fa700 1 -- 172.21.15.42:0/3362319956 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f4a6c0058f0 con 0x7f4a780a56b0 2020-04-02T23:24:48.203 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.191+0000 7f4a777fe700 1 --2- 172.21.15.42:0/3362319956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a780a56b0 0x7f4a780a0f90 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f4a6c002f30 tx=0x7f4a6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.204 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.191+0000 7f4a7e5df700 1 -- 172.21.15.42:0/3362319956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a7805d2e0 con 0x7f4a780a56b0 2020-04-02T23:24:48.204 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.191+0000 7f4a757fa700 1 --2- 172.21.15.42:0/3362319956 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4a5804d390 0x7f4a5804f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:48.204 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.191+0000 7f4a757fa700 1 -- 172.21.15.42:0/3362319956 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6315+0+0 (secure 0 0 0) 0x7f4a6c061690 con 0x7f4a780a56b0 2020-04-02T23:24:48.204 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.191+0000 7f4a77fff700 1 --2- 172.21.15.42:0/3362319956 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4a5804d390 0x7f4a5804f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:48.204 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.192+0000 7f4a77fff700 1 --2- 172.21.15.42:0/3362319956 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4a5804d390 0x7f4a5804f850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a68001260 tx=0x7f4a68001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.204 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.192+0000 7f4a77fff700 1 --2- 172.21.15.42:0/3362319956 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4a5804d390 0x7f4a5804f850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a68001260 tx=0x7f4a68001720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.204 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.192+0000 7f4a77fff700 1 --2- 172.21.15.42:0/3362319956 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4a5804d390 0x7f4a5804f850 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f4a68001260 tx=0x7f4a68001720).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:48.205 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.195+0000 7f4a777fe700 1 --2- 172.21.15.42:0/3362319956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a780a56b0 0x7f4a780a0f90 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f4a6c002f30 tx=0x7f4a6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.205 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.195+0000 7f4a757fa700 1 -- 172.21.15.42:0/3362319956 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f4a6c03ce90 con 0x7f4a780a56b0 2020-04-02T23:24:48.394 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.392+0000 7f4a7e5df700 1 -- 172.21.15.42:0/3362319956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f4a78146950 con 0x7f4a780a56b0 2020-04-02T23:24:48.395 INFO:tasks.ceph.mon.a.smithi042.stderr:2020-04-02T23:24:48.393+0000 7f6e98e48700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-04-02T23:24:48.398 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.396+0000 7f4a777fe700 1 --2- 172.21.15.42:0/3362319956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a780a56b0 0x7f4a780a0f90 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f4a6c002f30 tx=0x7f4a6c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.398 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.396+0000 7f4a757fa700 1 -- 172.21.15.42:0/3362319956 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v2) v1 ==== 187+0+0 (secure 0 0 0) 0x7f4a6c0404b0 con 0x7f4a780a56b0 2020-04-02T23:24:48.400 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.397+0000 7f4a7e5df700 1 -- 172.21.15.42:0/3362319956 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4a5804d390 msgr2=0x7f4a5804f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:48.400 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.397+0000 7f4a7e5df700 1 --2- 172.21.15.42:0/3362319956 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4a5804d390 0x7f4a5804f850 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f4a68001260 tx=0x7f4a68001720).stop 2020-04-02T23:24:48.400 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.397+0000 7f4a7e5df700 1 -- 172.21.15.42:0/3362319956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a780a56b0 msgr2=0x7f4a780a0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:48.400 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.397+0000 7f4a7e5df700 1 --2- 172.21.15.42:0/3362319956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a780a56b0 0x7f4a780a0f90 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f4a6c002f30 tx=0x7f4a6c007a40).stop 2020-04-02T23:24:48.401 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.397+0000 7f4a7e5df700 1 -- 172.21.15.42:0/3362319956 shutdown_connections 2020-04-02T23:24:48.401 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.397+0000 7f4a7e5df700 1 --2- 172.21.15.42:0/3362319956 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4a5804d390 0x7f4a5804f850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:48.401 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.397+0000 7f4a7e5df700 1 --2- 172.21.15.42:0/3362319956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a780a56b0 0x7f4a780a0f90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:48.401 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.397+0000 7f4a7e5df700 1 -- 172.21.15.42:0/3362319956 >> 172.21.15.42:0/3362319956 conn(0x7f4a7805b720 msgr2=0x7f4a780a5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:48.401 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.398+0000 7f4a7e5df700 1 -- 172.21.15.42:0/3362319956 shutdown_connections 2020-04-02T23:24:48.401 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.398+0000 7f4a7e5df700 1 -- 172.21.15.42:0/3362319956 wait complete. 2020-04-02T23:24:48.401 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 3 and data pool 4 2020-04-02T23:24:48.410 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:48.424 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:24:48.577 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.575+0000 7fced7066700 1 Processor -- start 2020-04-02T23:24:48.577 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.575+0000 7fced7066700 1 -- start start 2020-04-02T23:24:48.580 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.576+0000 7fced7066700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fced00ab410 0x7fced00a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:48.580 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.576+0000 7fced7066700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fced00a6a90 0x7fced00a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:48.581 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.576+0000 7fced7066700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced00a31b0 con 0x7fced00a2130 2020-04-02T23:24:48.581 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.576+0000 7fced7066700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced00a49f0 con 0x7fced00a6a90 2020-04-02T23:24:48.581 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.576+0000 7fced7066700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced005ff40 con 0x7fced00ab410 2020-04-02T23:24:48.581 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.576+0000 7fcecffff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fced00a6a90 0x7fced00a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:48.581 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.576+0000 7fcecffff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fced00a6a90 0x7fced00a1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39786/0 (socket says 172.21.15.42:39786) 2020-04-02T23:24:48.582 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.576+0000 7fcecffff700 1 -- 172.21.15.42:0/3412988287 learned_addr learned my addr 172.21.15.42:0/3412988287 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:48.582 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.576+0000 7fced4e02700 1 --2- 172.21.15.42:0/3412988287 >> v2:172.21.15.84:3300/0 conn(0x7fced00ab410 0x7fced00a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:48.582 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.576+0000 7fcecffff700 1 -- 172.21.15.42:0/3412988287 >> v2:172.21.15.84:3300/0 conn(0x7fced00ab410 msgr2=0x7fced00a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:48.582 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.576+0000 7fcecffff700 1 --2- 172.21.15.42:0/3412988287 >> v2:172.21.15.84:3300/0 conn(0x7fced00ab410 0x7fced00a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:48.582 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.576+0000 7fcecffff700 1 -- 172.21.15.42:0/3412988287 >> v1:172.21.15.84:6789/0 conn(0x7fced00a2130 legacy=0x7fced00a2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:48.582 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.576+0000 7fcecffff700 1 -- 172.21.15.42:0/3412988287 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced00a3420 con 0x7fced00a6a90 2020-04-02T23:24:48.582 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.576+0000 7fcecffff700 1 --2- 172.21.15.42:0/3412988287 >> v2:172.21.15.42:3300/0 conn(0x7fced00a6a90 0x7fced00a1cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fced005bc20 tx=0x7fcec4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.576+0000 7fcecffff700 1 --2- 172.21.15.42:0/3412988287 >> v2:172.21.15.42:3300/0 conn(0x7fced00a6a90 0x7fced00a1cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fced005bc20 tx=0x7fcec4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.576+0000 7fcecffff700 1 --2- 172.21.15.42:0/3412988287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced00a6a90 0x7fced00a1cd0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fced005bc20 tx=0x7fcec4007a40).ready entity=mon.0 client_cookie=caf9b686f49938b7 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:48.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.576+0000 7fcecffff700 1 --2- 172.21.15.42:0/3412988287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced00a6a90 0x7fced00a1cd0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fced005bc20 tx=0x7fcec4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.576+0000 7fcecffff700 1 --2- 172.21.15.42:0/3412988287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced00a6a90 0x7fced00a1cd0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fced005bc20 tx=0x7fcec4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.576+0000 7fcecf7fe700 1 -- 172.21.15.42:0/3412988287 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcec40116e0 con 0x7fced00a6a90 2020-04-02T23:24:48.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.576+0000 7fcecffff700 1 --2- 172.21.15.42:0/3412988287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced00a6a90 0x7fced00a1cd0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fced005bc20 tx=0x7fcec4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.577+0000 7fcecf7fe700 1 -- 172.21.15.42:0/3412988287 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec4011840 con 0x7fced00a6a90 2020-04-02T23:24:48.584 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.577+0000 7fcecf7fe700 1 -- 172.21.15.42:0/3412988287 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcec4011c20 con 0x7fced00a6a90 2020-04-02T23:24:48.584 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.577+0000 7fced7066700 1 -- 172.21.15.42:0/3412988287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced00a6a90 msgr2=0x7fced00a1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:48.584 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.577+0000 7fced7066700 1 --2- 172.21.15.42:0/3412988287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced00a6a90 0x7fced00a1cd0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fced005bc20 tx=0x7fcec4007a40).stop 2020-04-02T23:24:48.584 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.577+0000 7fced7066700 1 -- 172.21.15.42:0/3412988287 shutdown_connections 2020-04-02T23:24:48.584 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.577+0000 7fced7066700 1 --2- 172.21.15.42:0/3412988287 >> v2:172.21.15.84:3300/0 conn(0x7fced00ab410 0x7fced00a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:48.584 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.577+0000 7fced7066700 1 --2- 172.21.15.42:0/3412988287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced00a6a90 0x7fced00a1cd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:48.584 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.577+0000 7fced7066700 1 -- 172.21.15.42:0/3412988287 >> 172.21.15.42:0/3412988287 conn(0x7fced005b720 msgr2=0x7fced00aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:48.585 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.577+0000 7fced7066700 1 -- 172.21.15.42:0/3412988287 shutdown_connections 2020-04-02T23:24:48.585 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.577+0000 7fced7066700 1 -- 172.21.15.42:0/3412988287 wait complete. 2020-04-02T23:24:48.585 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.578+0000 7fced7066700 1 Processor -- start 2020-04-02T23:24:48.585 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.578+0000 7fced7066700 1 -- start start 2020-04-02T23:24:48.589 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.579+0000 7fced7066700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fced00a2130 0x7fced009cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:48.589 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.579+0000 7fced7066700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fced00a6a90 0x7fced0090890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:48.589 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.579+0000 7fced7066700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced009de30 con 0x7fced00ab410 2020-04-02T23:24:48.589 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.579+0000 7fced7066700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced0090cf0 con 0x7fced00a2130 2020-04-02T23:24:48.589 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.579+0000 7fced7066700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced0147170 con 0x7fced00a6a90 2020-04-02T23:24:48.590 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.579+0000 7fced4e02700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fced00a2130 0x7fced009cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:48.590 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.579+0000 7fced4e02700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fced00a2130 0x7fced009cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39790/0 (socket says 172.21.15.42:39790) 2020-04-02T23:24:48.590 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.579+0000 7fced4e02700 1 -- 172.21.15.42:0/2103875921 learned_addr learned my addr 172.21.15.42:0/2103875921 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:48.590 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.579+0000 7fced5603700 1 --1- 172.21.15.42:0/2103875921 >> v1:172.21.15.42:6789/0 conn(0x7fced00ab410 0x7fced009d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59218/0 (socket says 172.21.15.42:59218) 2020-04-02T23:24:48.590 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.579+0000 7fcecffff700 1 --2- 172.21.15.42:0/2103875921 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fced00a6a90 0x7fced0090890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:48.590 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.579+0000 7fced4e02700 1 -- 172.21.15.42:0/2103875921 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fced00a6a90 msgr2=0x7fced0090890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:48.590 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.579+0000 7fced4e02700 1 --2- 172.21.15.42:0/2103875921 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fced00a6a90 0x7fced0090890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:48.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.579+0000 7fced4e02700 1 -- 172.21.15.42:0/2103875921 >> v1:172.21.15.42:6789/0 conn(0x7fced00ab410 legacy=0x7fced009d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:48.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.579+0000 7fcecdffb700 1 -- 172.21.15.42:0/2103875921 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425132535 0 0) 0x7fcec00020a0 con 0x7fced00ab410 2020-04-02T23:24:48.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.579+0000 7fced4e02700 1 -- 172.21.15.42:0/2103875921 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced009c370 con 0x7fced00a2130 2020-04-02T23:24:48.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.579+0000 7fced4e02700 1 --2- 172.21.15.42:0/2103875921 >> v2:172.21.15.42:3300/0 conn(0x7fced00a2130 0x7fced009cd10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcec80032b0 tx=0x7fcec8011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.579+0000 7fced4e02700 1 --2- 172.21.15.42:0/2103875921 >> v2:172.21.15.42:3300/0 conn(0x7fced00a2130 0x7fced009cd10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcec80032b0 tx=0x7fcec8011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.579+0000 7fced4e02700 1 --2- 172.21.15.42:0/2103875921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced00a2130 0x7fced009cd10 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fcec80032b0 tx=0x7fcec8011060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:48.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.579+0000 7fced4e02700 1 --2- 172.21.15.42:0/2103875921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced00a2130 0x7fced009cd10 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fcec80032b0 tx=0x7fcec8011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.580+0000 7fcecdffb700 1 -- 172.21.15.42:0/2103875921 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcec8005e20 con 0x7fced00a2130 2020-04-02T23:24:48.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.580+0000 7fced4e02700 1 --2- 172.21.15.42:0/2103875921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced00a2130 0x7fced009cd10 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fcec80032b0 tx=0x7fcec8011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.580+0000 7fcecdffb700 1 -- 172.21.15.42:0/2103875921 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec8012a00 con 0x7fced00a2130 2020-04-02T23:24:48.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.580+0000 7fced4e02700 1 --2- 172.21.15.42:0/2103875921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced00a2130 0x7fced009cd10 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fcec80032b0 tx=0x7fcec8011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.580+0000 7fced7066700 1 -- 172.21.15.42:0/2103875921 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced009c5d0 con 0x7fced00a2130 2020-04-02T23:24:48.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.580+0000 7fcecdffb700 1 -- 172.21.15.42:0/2103875921 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcec8012da0 con 0x7fced00a2130 2020-04-02T23:24:48.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.580+0000 7fced7066700 1 -- 172.21.15.42:0/2103875921 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced01461c0 con 0x7fced00a2130 2020-04-02T23:24:48.593 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.580+0000 7fced4e02700 1 --2- 172.21.15.42:0/2103875921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced00a2130 0x7fced009cd10 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fcec80032b0 tx=0x7fcec8011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.593 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.581+0000 7fced7066700 1 -- 172.21.15.42:0/2103875921 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced005d2e0 con 0x7fced00a2130 2020-04-02T23:24:48.593 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.581+0000 7fcecdffb700 1 -- 172.21.15.42:0/2103875921 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fcec8007180 con 0x7fced00a2130 2020-04-02T23:24:48.593 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.581+0000 7fced4e02700 1 --2- 172.21.15.42:0/2103875921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced00a2130 0x7fced009cd10 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fcec80032b0 tx=0x7fcec8011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.593 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.581+0000 7fcecdffb700 1 --2- 172.21.15.42:0/2103875921 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fceb004d450 0x7fceb004f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:48.593 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.581+0000 7fcecdffb700 1 -- 172.21.15.42:0/2103875921 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fcec80610d0 con 0x7fced00a2130 2020-04-02T23:24:48.593 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.581+0000 7fcecffff700 1 --2- 172.21.15.42:0/2103875921 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fceb004d450 0x7fceb004f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:48.594 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.582+0000 7fcecffff700 1 --2- 172.21.15.42:0/2103875921 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fceb004d450 0x7fceb004f910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fced005bc20 tx=0x7fcec4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.594 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.582+0000 7fcecffff700 1 --2- 172.21.15.42:0/2103875921 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fceb004d450 0x7fceb004f910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fced005bc20 tx=0x7fcec4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.594 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.582+0000 7fcecffff700 1 --2- 172.21.15.42:0/2103875921 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fceb004d450 0x7fceb004f910 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fced005bc20 tx=0x7fcec4007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:48.594 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.585+0000 7fced4e02700 1 --2- 172.21.15.42:0/2103875921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced00a2130 0x7fced009cd10 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fcec80032b0 tx=0x7fcec8011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.594 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.585+0000 7fcecdffb700 1 -- 172.21.15.42:0/2103875921 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fcec803c810 con 0x7fced00a2130 2020-04-02T23:24:48.734 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.732+0000 7fced7066700 1 -- 172.21.15.42:0/2103875921 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fced009ca30 con 0x7fced00a2130 2020-04-02T23:24:48.735 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.733+0000 7fced4e02700 1 --2- 172.21.15.42:0/2103875921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced00a2130 0x7fced009cd10 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fcec80032b0 tx=0x7fcec8011060).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.735 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.733+0000 7fcecdffb700 1 -- 172.21.15.42:0/2103875921 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fcec803fe30 con 0x7fced00a2130 2020-04-02T23:24:48.735 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:24:48.735 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":26,"fsid":"571c521c-9ca7-4052-ba5b-7a77e18ff12c","created":"2020-04-02T23:24:23.980442+0000","modified":"2020-04-02T23:24:48.393847+0000","last_up_change":"2020-04-02T23:24:36.096260+0000","last_in_change":"2020-04-02T23:24:36.096260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:24:27.091980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:24:40.298468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:24:43.688260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:24:45.991301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"976aac36-1cf8-408b-bf56-9f0eefe43b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":24836},{"type":"v1","addr":"172.21.15.42:6801","nonce":24836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":24836},{"type":"v1","addr":"172.21.15.42:6803","nonce":24836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":24836},{"type":"v1","addr":"172.21.15.42:6807","nonce":24836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":24836},{"type":"v1","addr":"172.21.15.42:6805","nonce":24836}]},"public_addr":"172.21.15.42:6801/24836","cluster_addr":"172.21.15.42:6803/24836","heartbeat_back_addr":"172.21.15.42:6807/24836","heartbeat_front_addr":"172.21.15.42:6805/24836","state":["exists","up"]},{"osd":1,"uuid":"22c1e489-ab99-4205-ba9d-fbfc144d2a8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":24881},{"type":"v1","addr":"172.21.15.42:6809","nonce":24881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":24881},{"type":"v1","addr":"172.21.15.42:6811","nonce":24881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":24881},{"type":"v1","addr":"172.21.15.42:6815","nonce":24881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":24881},{"type":"v1","addr":"172.21.15.42:6813","nonce":24881}]},"public_addr":"172.21.15.42:6809/24881","cluster_addr":"172.21.15.42:6811/24881","heartbeat_back_addr":"172.21.15.42:6815/24881","heartbeat_front_addr":"172.21.15.42:6813/24881","state":["exists","up"]},{"osd":2,"uuid":"f0b18b09-93c0-4286-8d15-746611ba53cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":24917},{"type":"v1","addr":"172.21.15.42:6817","nonce":24917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":24917},{"type":"v1","addr":"172.21.15.42:6819","nonce":24917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":24917},{"type":"v1","addr":"172.21.15.42:6823","nonce":24917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":24917},{"type":"v1","addr":"172.21.15.42:6821","nonce":24917}]},"public_addr":"172.21.15.42:6817/24917","cluster_addr":"172.21.15.42:6819/24917","heartbeat_back_addr":"172.21.15.42:6823/24917","heartbeat_front_addr":"172.21.15.42:6821/24917","state":["exists","up"]},{"osd":3,"uuid":"989d4a69-9abe-44de-95f2-6c7cbbe07471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":24940},{"type":"v1","addr":"172.21.15.42:6825","nonce":24940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":24940},{"type":"v1","addr":"172.21.15.42:6827","nonce":24940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":24940},{"type":"v1","addr":"172.21.15.42:6831","nonce":24940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":24940},{"type":"v1","addr":"172.21.15.42:6829","nonce":24940}]},"public_addr":"172.21.15.42:6825/24940","cluster_addr":"172.21.15.42:6827/24940","heartbeat_back_addr":"172.21.15.42:6831/24940","heartbeat_front_addr":"172.21.15.42:6829/24940","state":["exists","up"]},{"osd":4,"uuid":"b1a2ce60-ae80-4f8a-97a3-4fbb1399fdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":24239},{"type":"v1","addr":"172.21.15.84:6803","nonce":24239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":24239},{"type":"v1","addr":"172.21.15.84:6805","nonce":24239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":24239},{"type":"v1","addr":"172.21.15.84:6809","nonce":24239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":24239},{"type":"v1","addr":"172.21.15.84:6807","nonce":24239}]},"public_addr":"172.21.15.84:6803/24239","cluster_addr":"172.21.15.84:6805/24239","heartbeat_back_addr":"172.21.15.84:6809/24239","heartbeat_front_addr":"172.21.15.84:6807/24239","state":["exists","up"]},{"osd":5,"uuid":"396b36e5-7226-4e8e-aa8a-749cb5cec101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":24276},{"type":"v1","addr":"172.21.15.84:6811","nonce":24276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":24276},{"type":"v1","addr":"172.21.15.84:6813","nonce":24276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":24276},{"type":"v1","addr":"172.21.15.84:6817","nonce":24276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":24276},{"type":"v1","addr":"172.21.15.84:6815","nonce":24276}]},"public_addr":"172.21.15.84:6811/24276","cluster_addr":"172.21.15.84:6813/24276","heartbeat_back_addr":"172.21.15.84:6817/24276","heartbeat_front_addr":"172.21.15.84:6815/24276","state":["exists","up"]},{"osd":6,"uuid":"884bb915-28c3-463d-8046-e2908f6e8e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":24319},{"type":"v1","addr":"172.21.15.84:6819","nonce":24319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":24319},{"type":"v1","addr":"172.21.15.84:6821","nonce":24319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":24319},{"type":"v1","addr":"172.21.15.84:6825","nonce":24319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":24319},{"type":"v1","addr":"172.21.15.84:6823","nonce":24319}]},"public_addr":"172.21.15.84:6819/24319","cluster_addr":"172.21.15.84:6821/24319","heartbeat_back_addr":"172.21.15.84:6825/24319","heartbeat_front_addr":"172.21.15.84:6823/24319","state":["exists","up"]},{"osd":7,"uuid":"70e90d1d-f081-4de5-af4b-e987c159e597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":24349},{"type":"v1","addr":"172.21.15.84:6827","nonce":24349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":24349},{"type":"v1","addr":"172.21.15.84:6829","nonce":24349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":24349},{"type":"v1","addr":"172.21.15.84:6833","nonce":24349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":24349},{"type":"v1","addr":"172.21.15.84:6831","nonce":24349}]},"public_addr":"172.21.15.84:6827/24349","cluster_addr":"172.21.15.84:6829/24349","heartbeat_back_addr":"172.21.15.84:6833/24349","heartbeat_front_addr":"172.21.15.84:6831/24349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.195657+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.241354+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.257764+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.368827+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.967296+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.991068+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.077047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.095727+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:24:48.737 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.734+0000 7fced7066700 1 -- 172.21.15.42:0/2103875921 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fceb004d450 msgr2=0x7fceb004f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:48.737 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.734+0000 7fced7066700 1 --2- 172.21.15.42:0/2103875921 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fceb004d450 0x7fceb004f910 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7fced005bc20 tx=0x7fcec4007a40).stop 2020-04-02T23:24:48.737 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.734+0000 7fced7066700 1 -- 172.21.15.42:0/2103875921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced00a2130 msgr2=0x7fced009cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:48.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.734+0000 7fced7066700 1 --2- 172.21.15.42:0/2103875921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced00a2130 0x7fced009cd10 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fcec80032b0 tx=0x7fcec8011060).stop 2020-04-02T23:24:48.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.734+0000 7fced7066700 1 -- 172.21.15.42:0/2103875921 shutdown_connections 2020-04-02T23:24:48.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.734+0000 7fced7066700 1 --2- 172.21.15.42:0/2103875921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced00a2130 0x7fced009cd10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:48.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.734+0000 7fced7066700 1 --2- 172.21.15.42:0/2103875921 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fceb004d450 0x7fceb004f910 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:48.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.734+0000 7fced7066700 1 --2- 172.21.15.42:0/2103875921 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fced00a6a90 0x7fced0090890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:48.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.734+0000 7fced7066700 1 -- 172.21.15.42:0/2103875921 >> 172.21.15.42:0/2103875921 conn(0x7fced005b720 msgr2=0x7fced00aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:48.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.734+0000 7fced7066700 1 -- 172.21.15.42:0/2103875921 shutdown_connections 2020-04-02T23:24:48.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.734+0000 7fced7066700 1 -- 172.21.15.42:0/2103875921 wait complete. 2020-04-02T23:24:48.747 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:48.761 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:24:48.913 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.911+0000 7f8ee180d700 1 Processor -- start 2020-04-02T23:24:48.914 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.911+0000 7f8ee180d700 1 -- start start 2020-04-02T23:24:48.921 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.912+0000 7f8ee180d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8edc0ab410 0x7f8edc0a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:48.921 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.912+0000 7f8ee180d700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8edc0a6a90 0x7f8edc0a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:48.922 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.912+0000 7f8ee180d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8edc0a31b0 con 0x7f8edc0a2130 2020-04-02T23:24:48.922 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.912+0000 7f8ee180d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8edc0a49f0 con 0x7f8edc0ab410 2020-04-02T23:24:48.922 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.912+0000 7f8ee180d700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc05ff40 con 0x7f8edc0a6a90 2020-04-02T23:24:48.922 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.912+0000 7f8edb7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8edc0a2130 0x7f8edc0a2580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:53602/0 (socket says 172.21.15.42:53602) 2020-04-02T23:24:48.923 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.912+0000 7f8edb7fe700 1 -- 172.21.15.42:0/4055841563 learned_addr learned my addr 172.21.15.42:0/4055841563 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:48.923 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.912+0000 7f8eda7fc700 1 --2- 172.21.15.42:0/4055841563 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8edc0a6a90 0x7f8edc0a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:48.923 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.912+0000 7f8edaffd700 1 --2- 172.21.15.42:0/4055841563 >> v2:172.21.15.84:3300/0 conn(0x7f8edc0ab410 0x7f8edc0a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:48.923 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.913+0000 7f8eda7fc700 1 -- 172.21.15.42:0/4055841563 >> v2:172.21.15.84:3300/0 conn(0x7f8edc0ab410 msgr2=0x7f8edc0a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:48.923 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.913+0000 7f8eda7fc700 1 --2- 172.21.15.42:0/4055841563 >> v2:172.21.15.84:3300/0 conn(0x7f8edc0ab410 0x7f8edc0a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:48.923 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.913+0000 7f8eda7fc700 1 -- 172.21.15.42:0/4055841563 >> v1:172.21.15.84:6789/0 conn(0x7f8edc0a2130 legacy=0x7f8edc0a2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:48.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.913+0000 7f8eda7fc700 1 -- 172.21.15.42:0/4055841563 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc0a3420 con 0x7f8edc0a6a90 2020-04-02T23:24:48.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.913+0000 7f8ed9ffb700 1 -- 172.21.15.42:0/4055841563 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954666355 0 0) 0x7f8edc0a31b0 con 0x7f8edc0a2130 2020-04-02T23:24:48.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.913+0000 7f8edaffd700 1 --2- 172.21.15.42:0/4055841563 >> v2:172.21.15.84:3300/0 conn(0x7f8edc0ab410 0x7f8edc0a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:48.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.913+0000 7f8eda7fc700 1 --2- 172.21.15.42:0/4055841563 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8edc0a6a90 0x7f8edc0a1cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8ecc002f30 tx=0x7f8ecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.913+0000 7f8eda7fc700 1 --2- 172.21.15.42:0/4055841563 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8edc0a6a90 0x7f8edc0a1cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8ecc002f30 tx=0x7f8ecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.913+0000 7f8eda7fc700 1 --2- 172.21.15.42:0/4055841563 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8edc0a6a90 0x7f8edc0a1cd0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f8ecc002f30 tx=0x7f8ecc007a40).ready entity=mon.2 client_cookie=5005d1511bcc4d18 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:48.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.913+0000 7f8eda7fc700 1 --2- 172.21.15.42:0/4055841563 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8edc0a6a90 0x7f8edc0a1cd0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f8ecc002f30 tx=0x7f8ecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.925 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.913+0000 7f8ed9ffb700 1 -- 172.21.15.42:0/4055841563 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ecc0113c0 con 0x7f8edc0a6a90 2020-04-02T23:24:48.925 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.913+0000 7f8eda7fc700 1 --2- 172.21.15.42:0/4055841563 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8edc0a6a90 0x7f8edc0a1cd0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f8ecc002f30 tx=0x7f8ecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.925 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.913+0000 7f8ed9ffb700 1 -- 172.21.15.42:0/4055841563 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc011520 con 0x7f8edc0a6a90 2020-04-02T23:24:48.925 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.913+0000 7f8eda7fc700 1 --2- 172.21.15.42:0/4055841563 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8edc0a6a90 0x7f8edc0a1cd0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f8ecc002f30 tx=0x7f8ecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.925 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.913+0000 7f8ed9ffb700 1 -- 172.21.15.42:0/4055841563 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ecc011900 con 0x7f8edc0a6a90 2020-04-02T23:24:48.925 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.913+0000 7f8ee180d700 1 -- 172.21.15.42:0/4055841563 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8edc0a6a90 msgr2=0x7f8edc0a1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:48.925 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.913+0000 7f8ee180d700 1 --2- 172.21.15.42:0/4055841563 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8edc0a6a90 0x7f8edc0a1cd0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f8ecc002f30 tx=0x7f8ecc007a40).stop 2020-04-02T23:24:48.925 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.914+0000 7f8ee180d700 1 -- 172.21.15.42:0/4055841563 shutdown_connections 2020-04-02T23:24:48.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.914+0000 7f8ee180d700 1 --2- 172.21.15.42:0/4055841563 >> v2:172.21.15.84:3300/0 conn(0x7f8edc0ab410 0x7f8edc0a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:48.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.914+0000 7f8ee180d700 1 --2- 172.21.15.42:0/4055841563 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8edc0a6a90 0x7f8edc0a1cd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:48.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.914+0000 7f8ee180d700 1 -- 172.21.15.42:0/4055841563 >> 172.21.15.42:0/4055841563 conn(0x7f8edc05b720 msgr2=0x7f8edc0aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:48.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.914+0000 7f8ee180d700 1 -- 172.21.15.42:0/4055841563 shutdown_connections 2020-04-02T23:24:48.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.914+0000 7f8ee180d700 1 -- 172.21.15.42:0/4055841563 wait complete. 2020-04-02T23:24:48.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.915+0000 7f8ee180d700 1 Processor -- start 2020-04-02T23:24:48.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.915+0000 7f8ee180d700 1 -- start start 2020-04-02T23:24:48.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.915+0000 7f8ee180d700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8edc0a2130 0x7f8edc062d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:48.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.915+0000 7f8ee180d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8edc0a6a90 0x7f8edc0633c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:48.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.915+0000 7f8ee180d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8edc09aab0 con 0x7f8edc0ab410 2020-04-02T23:24:48.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.915+0000 7f8ee180d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8edc061730 con 0x7f8edc0a6a90 2020-04-02T23:24:48.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.915+0000 7f8ee180d700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc0631d0 con 0x7f8edc0a2130 2020-04-02T23:24:48.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.915+0000 7f8eda7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8edc0a6a90 0x7f8edc0633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:48.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.915+0000 7f8edb7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8edc0ab410 0x7f8edc147890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:53610/0 (socket says 172.21.15.42:53610) 2020-04-02T23:24:48.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.915+0000 7f8eda7fc700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8edc0a6a90 0x7f8edc0633c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.42:34296/0 (socket says 172.21.15.42:34296) 2020-04-02T23:24:48.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.916+0000 7f8edb7fe700 1 -- 172.21.15.42:0/1440883393 learned_addr learned my addr 172.21.15.42:0/1440883393 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:48.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.916+0000 7f8edaffd700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8edc0a2130 0x7f8edc062d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:48.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.916+0000 7f8eda7fc700 1 -- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8edc0a2130 msgr2=0x7f8edc062d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:48.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.916+0000 7f8eda7fc700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8edc0a2130 0x7f8edc062d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:48.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.916+0000 7f8eda7fc700 1 -- 172.21.15.42:0/1440883393 >> v1:172.21.15.84:6789/0 conn(0x7f8edc0ab410 legacy=0x7f8edc147890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:48.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.916+0000 7f8ecbfff700 1 -- 172.21.15.42:0/1440883393 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709555827 0 0) 0x7f8edc09aab0 con 0x7f8edc0ab410 2020-04-02T23:24:48.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.916+0000 7f8eda7fc700 1 -- 172.21.15.42:0/1440883393 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc062550 con 0x7f8edc0a6a90 2020-04-02T23:24:48.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.916+0000 7f8edaffd700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8edc0a2130 0x7f8edc062d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:48.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.916+0000 7f8eda7fc700 1 --2- 172.21.15.42:0/1440883393 >> v2:172.21.15.84:3300/0 conn(0x7f8edc0a6a90 0x7f8edc0633c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ecc002f30 tx=0x7f8ecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.916+0000 7f8eda7fc700 1 --2- 172.21.15.42:0/1440883393 >> v2:172.21.15.84:3300/0 conn(0x7f8edc0a6a90 0x7f8edc0633c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ecc002f30 tx=0x7f8ecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.916+0000 7f8eda7fc700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc0a6a90 0x7f8edc0633c0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f8ecc002f30 tx=0x7f8ecc007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:48.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.916+0000 7f8eda7fc700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc0a6a90 0x7f8edc0633c0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f8ecc002f30 tx=0x7f8ecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.916+0000 7f8ecbfff700 1 -- 172.21.15.42:0/1440883393 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ecc011940 con 0x7f8edc0a6a90 2020-04-02T23:24:48.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.916+0000 7f8eda7fc700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc0a6a90 0x7f8edc0633c0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f8ecc002f30 tx=0x7f8ecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.916+0000 7f8ecbfff700 1 -- 172.21.15.42:0/1440883393 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc0070b0 con 0x7f8edc0a6a90 2020-04-02T23:24:48.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.916+0000 7f8ee180d700 1 -- 172.21.15.42:0/1440883393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8edc0a9950 con 0x7f8edc0a6a90 2020-04-02T23:24:48.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.916+0000 7f8eda7fc700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc0a6a90 0x7f8edc0633c0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f8ecc002f30 tx=0x7f8ecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.916+0000 7f8ecbfff700 1 -- 172.21.15.42:0/1440883393 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ecc007410 con 0x7f8edc0a6a90 2020-04-02T23:24:48.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.916+0000 7f8ee180d700 1 -- 172.21.15.42:0/1440883393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8edc09c3f0 con 0x7f8edc0a6a90 2020-04-02T23:24:48.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.917+0000 7f8eda7fc700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc0a6a90 0x7f8edc0633c0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f8ecc002f30 tx=0x7f8ecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.917+0000 7f8ee180d700 1 -- 172.21.15.42:0/1440883393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8edc05d2e0 con 0x7f8edc0a6a90 2020-04-02T23:24:48.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.917+0000 7f8ecbfff700 1 -- 172.21.15.42:0/1440883393 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f8ecc0080a0 con 0x7f8edc0a6a90 2020-04-02T23:24:48.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.917+0000 7f8eda7fc700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc0a6a90 0x7f8edc0633c0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f8ecc002f30 tx=0x7f8ecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.918+0000 7f8ecbfff700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8eb804d380 0x7f8eb804f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:48.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.918+0000 7f8ecbfff700 1 -- 172.21.15.42:0/1440883393 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8ecc061390 con 0x7f8edc0a6a90 2020-04-02T23:24:48.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.918+0000 7f8edaffd700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8eb804d380 0x7f8eb804f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:48.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.918+0000 7f8edaffd700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8eb804d380 0x7f8eb804f840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ed0002f30 tx=0x7f8ed00076e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.918+0000 7f8edaffd700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8eb804d380 0x7f8eb804f840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ed0002f30 tx=0x7f8ed00076e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.918+0000 7f8edaffd700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8eb804d380 0x7f8eb804f840 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f8ed0002f30 tx=0x7f8ed00076e0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:48.932 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.921+0000 7f8eda7fc700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc0a6a90 0x7f8edc0633c0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f8ecc002f30 tx=0x7f8ecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:48.932 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:48.921+0000 7f8ecbfff700 1 -- 172.21.15.42:0/1440883393 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f8ecc03cb90 con 0x7f8edc0a6a90 2020-04-02T23:24:49.072 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.070+0000 7f8ee180d700 1 -- 172.21.15.42:0/1440883393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8edc09c110 con 0x7f8edc0a6a90 2020-04-02T23:24:49.073 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.071+0000 7f8eda7fc700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc0a6a90 0x7f8edc0633c0 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f8ecc002f30 tx=0x7f8ecc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:49.073 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.071+0000 7f8ecbfff700 1 -- 172.21.15.42:0/1440883393 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f8ecc0401b0 con 0x7f8edc0a6a90 2020-04-02T23:24:49.073 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:24:49.074 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":26,"fsid":"571c521c-9ca7-4052-ba5b-7a77e18ff12c","created":"2020-04-02T23:24:23.980442+0000","modified":"2020-04-02T23:24:48.393847+0000","last_up_change":"2020-04-02T23:24:36.096260+0000","last_in_change":"2020-04-02T23:24:36.096260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:24:27.091980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:24:40.298468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:24:43.688260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:24:45.991301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"976aac36-1cf8-408b-bf56-9f0eefe43b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":24836},{"type":"v1","addr":"172.21.15.42:6801","nonce":24836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":24836},{"type":"v1","addr":"172.21.15.42:6803","nonce":24836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":24836},{"type":"v1","addr":"172.21.15.42:6807","nonce":24836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":24836},{"type":"v1","addr":"172.21.15.42:6805","nonce":24836}]},"public_addr":"172.21.15.42:6801/24836","cluster_addr":"172.21.15.42:6803/24836","heartbeat_back_addr":"172.21.15.42:6807/24836","heartbeat_front_addr":"172.21.15.42:6805/24836","state":["exists","up"]},{"osd":1,"uuid":"22c1e489-ab99-4205-ba9d-fbfc144d2a8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":24881},{"type":"v1","addr":"172.21.15.42:6809","nonce":24881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":24881},{"type":"v1","addr":"172.21.15.42:6811","nonce":24881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":24881},{"type":"v1","addr":"172.21.15.42:6815","nonce":24881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":24881},{"type":"v1","addr":"172.21.15.42:6813","nonce":24881}]},"public_addr":"172.21.15.42:6809/24881","cluster_addr":"172.21.15.42:6811/24881","heartbeat_back_addr":"172.21.15.42:6815/24881","heartbeat_front_addr":"172.21.15.42:6813/24881","state":["exists","up"]},{"osd":2,"uuid":"f0b18b09-93c0-4286-8d15-746611ba53cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":24917},{"type":"v1","addr":"172.21.15.42:6817","nonce":24917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":24917},{"type":"v1","addr":"172.21.15.42:6819","nonce":24917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":24917},{"type":"v1","addr":"172.21.15.42:6823","nonce":24917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":24917},{"type":"v1","addr":"172.21.15.42:6821","nonce":24917}]},"public_addr":"172.21.15.42:6817/24917","cluster_addr":"172.21.15.42:6819/24917","heartbeat_back_addr":"172.21.15.42:6823/24917","heartbeat_front_addr":"172.21.15.42:6821/24917","state":["exists","up"]},{"osd":3,"uuid":"989d4a69-9abe-44de-95f2-6c7cbbe07471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":24940},{"type":"v1","addr":"172.21.15.42:6825","nonce":24940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":24940},{"type":"v1","addr":"172.21.15.42:6827","nonce":24940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":24940},{"type":"v1","addr":"172.21.15.42:6831","nonce":24940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":24940},{"type":"v1","addr":"172.21.15.42:6829","nonce":24940}]},"public_addr":"172.21.15.42:6825/24940","cluster_addr":"172.21.15.42:6827/24940","heartbeat_back_addr":"172.21.15.42:6831/24940","heartbeat_front_addr":"172.21.15.42:6829/24940","state":["exists","up"]},{"osd":4,"uuid":"b1a2ce60-ae80-4f8a-97a3-4fbb1399fdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":24239},{"type":"v1","addr":"172.21.15.84:6803","nonce":24239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":24239},{"type":"v1","addr":"172.21.15.84:6805","nonce":24239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":24239},{"type":"v1","addr":"172.21.15.84:6809","nonce":24239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":24239},{"type":"v1","addr":"172.21.15.84:6807","nonce":24239}]},"public_addr":"172.21.15.84:6803/24239","cluster_addr":"172.21.15.84:6805/24239","heartbeat_back_addr":"172.21.15.84:6809/24239","heartbeat_front_addr":"172.21.15.84:6807/24239","state":["exists","up"]},{"osd":5,"uuid":"396b36e5-7226-4e8e-aa8a-749cb5cec101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":24276},{"type":"v1","addr":"172.21.15.84:6811","nonce":24276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":24276},{"type":"v1","addr":"172.21.15.84:6813","nonce":24276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":24276},{"type":"v1","addr":"172.21.15.84:6817","nonce":24276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":24276},{"type":"v1","addr":"172.21.15.84:6815","nonce":24276}]},"public_addr":"172.21.15.84:6811/24276","cluster_addr":"172.21.15.84:6813/24276","heartbeat_back_addr":"172.21.15.84:6817/24276","heartbeat_front_addr":"172.21.15.84:6815/24276","state":["exists","up"]},{"osd":6,"uuid":"884bb915-28c3-463d-8046-e2908f6e8e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":24319},{"type":"v1","addr":"172.21.15.84:6819","nonce":24319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":24319},{"type":"v1","addr":"172.21.15.84:6821","nonce":24319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":24319},{"type":"v1","addr":"172.21.15.84:6825","nonce":24319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":24319},{"type":"v1","addr":"172.21.15.84:6823","nonce":24319}]},"public_addr":"172.21.15.84:6819/24319","cluster_addr":"172.21.15.84:6821/24319","heartbeat_back_addr":"172.21.15.84:6825/24319","heartbeat_front_addr":"172.21.15.84:6823/24319","state":["exists","up"]},{"osd":7,"uuid":"70e90d1d-f081-4de5-af4b-e987c159e597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":24349},{"type":"v1","addr":"172.21.15.84:6827","nonce":24349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":24349},{"type":"v1","addr":"172.21.15.84:6829","nonce":24349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":24349},{"type":"v1","addr":"172.21.15.84:6833","nonce":24349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":24349},{"type":"v1","addr":"172.21.15.84:6831","nonce":24349}]},"public_addr":"172.21.15.84:6827/24349","cluster_addr":"172.21.15.84:6829/24349","heartbeat_back_addr":"172.21.15.84:6833/24349","heartbeat_front_addr":"172.21.15.84:6831/24349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.195657+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.241354+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.257764+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.368827+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.967296+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.991068+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.077047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.095727+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:24:49.076 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.072+0000 7f8ee180d700 1 -- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8eb804d380 msgr2=0x7f8eb804f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:49.076 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.072+0000 7f8ee180d700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8eb804d380 0x7f8eb804f840 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f8ed0002f30 tx=0x7f8ed00076e0).stop 2020-04-02T23:24:49.076 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.072+0000 7f8ee180d700 1 -- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc0a6a90 msgr2=0x7f8edc0633c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:49.076 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.072+0000 7f8ee180d700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc0a6a90 0x7f8edc0633c0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f8ecc002f30 tx=0x7f8ecc007a40).stop 2020-04-02T23:24:49.077 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.072+0000 7f8ee180d700 1 -- 172.21.15.42:0/1440883393 shutdown_connections 2020-04-02T23:24:49.077 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.072+0000 7f8ee180d700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8eb804d380 0x7f8eb804f840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:49.077 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.072+0000 7f8ee180d700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8edc0a2130 0x7f8edc062d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:49.077 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.072+0000 7f8ee180d700 1 --2- 172.21.15.42:0/1440883393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8edc0a6a90 0x7f8edc0633c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:49.077 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.072+0000 7f8ee180d700 1 -- 172.21.15.42:0/1440883393 >> 172.21.15.42:0/1440883393 conn(0x7f8edc05b720 msgr2=0x7f8edc0aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:49.077 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.073+0000 7f8ee180d700 1 -- 172.21.15.42:0/1440883393 shutdown_connections 2020-04-02T23:24:49.077 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.073+0000 7f8ee180d700 1 -- 172.21.15.42:0/1440883393 wait complete. 2020-04-02T23:24:49.086 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:49.100 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-04-02T23:24:49.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.254+0000 7fb24753f700 1 Processor -- start 2020-04-02T23:24:49.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.254+0000 7fb24753f700 1 -- start start 2020-04-02T23:24:49.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb24753f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb2400aa1a0 0x7fb240138720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:49.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb24753f700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb240138b80 0x7fb24005c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:49.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb24753f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2400a2980 con 0x7fb24005c4f0 2020-04-02T23:24:49.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb24753f700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2400aacd0 con 0x7fb240138b80 2020-04-02T23:24:49.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb24753f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24013c100 con 0x7fb2400aa1a0 2020-04-02T23:24:49.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb244ada700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb240138b80 0x7fb24005c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:49.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb244ada700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb240138b80 0x7fb24005c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39814/0 (socket says 172.21.15.42:39814) 2020-04-02T23:24:49.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb244ada700 1 -- 172.21.15.42:0/3327008627 learned_addr learned my addr 172.21.15.42:0/3327008627 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:49.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb2452db700 1 --2- 172.21.15.42:0/3327008627 >> v2:172.21.15.84:3300/0 conn(0x7fb2400aa1a0 0x7fb240138720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:49.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb244ada700 1 -- 172.21.15.42:0/3327008627 >> v2:172.21.15.84:3300/0 conn(0x7fb2400aa1a0 msgr2=0x7fb240138720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:49.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb244ada700 1 --2- 172.21.15.42:0/3327008627 >> v2:172.21.15.84:3300/0 conn(0x7fb2400aa1a0 0x7fb240138720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:49.264 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb244ada700 1 -- 172.21.15.42:0/3327008627 >> v1:172.21.15.84:6789/0 conn(0x7fb24005c4f0 legacy=0x7fb24009dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:49.264 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb244ada700 1 -- 172.21.15.42:0/3327008627 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24013c3a0 con 0x7fb240138b80 2020-04-02T23:24:49.264 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb2452db700 1 --2- 172.21.15.42:0/3327008627 >> v2:172.21.15.84:3300/0 conn(0x7fb2400aa1a0 0x7fb240138720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:24:49.264 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb244ada700 1 --2- 172.21.15.42:0/3327008627 >> v2:172.21.15.42:3300/0 conn(0x7fb240138b80 0x7fb24005c090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb230002f30 tx=0x7fb230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:49.264 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb244ada700 1 --2- 172.21.15.42:0/3327008627 >> v2:172.21.15.42:3300/0 conn(0x7fb240138b80 0x7fb24005c090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb230002f30 tx=0x7fb230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:49.264 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb244ada700 1 --2- 172.21.15.42:0/3327008627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb240138b80 0x7fb24005c090 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7fb230002f30 tx=0x7fb230007a40).ready entity=mon.0 client_cookie=363821b7e57ba21a server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:49.264 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb244ada700 1 --2- 172.21.15.42:0/3327008627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb240138b80 0x7fb24005c090 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fb230002f30 tx=0x7fb230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:49.265 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb22ffff700 1 -- 172.21.15.42:0/3327008627 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb230011720 con 0x7fb240138b80 2020-04-02T23:24:49.265 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb244ada700 1 --2- 172.21.15.42:0/3327008627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb240138b80 0x7fb24005c090 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fb230002f30 tx=0x7fb230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:49.265 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.255+0000 7fb244ada700 1 --2- 172.21.15.42:0/3327008627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb240138b80 0x7fb24005c090 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fb230002f30 tx=0x7fb230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:49.265 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.256+0000 7fb22ffff700 1 -- 172.21.15.42:0/3327008627 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb230011880 con 0x7fb240138b80 2020-04-02T23:24:49.265 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.256+0000 7fb22ffff700 1 -- 172.21.15.42:0/3327008627 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb230011c60 con 0x7fb240138b80 2020-04-02T23:24:49.265 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.256+0000 7fb24753f700 1 -- 172.21.15.42:0/3327008627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb240138b80 msgr2=0x7fb24005c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:49.266 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.256+0000 7fb24753f700 1 --2- 172.21.15.42:0/3327008627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb240138b80 0x7fb24005c090 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7fb230002f30 tx=0x7fb230007a40).stop 2020-04-02T23:24:49.266 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.256+0000 7fb24753f700 1 -- 172.21.15.42:0/3327008627 shutdown_connections 2020-04-02T23:24:49.266 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.256+0000 7fb24753f700 1 --2- 172.21.15.42:0/3327008627 >> v2:172.21.15.84:3300/0 conn(0x7fb2400aa1a0 0x7fb240138720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:49.266 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.256+0000 7fb24753f700 1 --2- 172.21.15.42:0/3327008627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb240138b80 0x7fb24005c090 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:49.266 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.256+0000 7fb24753f700 1 -- 172.21.15.42:0/3327008627 >> 172.21.15.42:0/3327008627 conn(0x7fb2400aedc0 msgr2=0x7fb2400af1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:49.266 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.256+0000 7fb24753f700 1 -- 172.21.15.42:0/3327008627 shutdown_connections 2020-04-02T23:24:49.266 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.256+0000 7fb24753f700 1 -- 172.21.15.42:0/3327008627 wait complete. 2020-04-02T23:24:49.266 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.257+0000 7fb24753f700 1 Processor -- start 2020-04-02T23:24:49.267 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.257+0000 7fb24753f700 1 -- start start 2020-04-02T23:24:49.267 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb24753f700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb2400aa1a0 0x7fb2400a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:49.267 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb24753f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb240138b80 0x7fb2400a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:49.267 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb24753f700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2400a0380 con 0x7fb24005c4f0 2020-04-02T23:24:49.267 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb24753f700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2400a56e0 con 0x7fb2400aa1a0 2020-04-02T23:24:49.267 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb24753f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2400a09c0 con 0x7fb240138b80 2020-04-02T23:24:49.267 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb2452db700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb24005c4f0 0x7fb2400a2170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59242/0 (socket says 172.21.15.42:59242) 2020-04-02T23:24:49.268 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb2452db700 1 -- 172.21.15.42:0/3232279753 learned_addr learned my addr 172.21.15.42:0/3232279753 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:49.268 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb244ada700 1 --2- 172.21.15.42:0/3232279753 >> v2:172.21.15.42:3300/0 conn(0x7fb2400aa1a0 0x7fb2400a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:49.268 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb245adc700 1 --2- 172.21.15.42:0/3232279753 >> v2:172.21.15.84:3300/0 conn(0x7fb240138b80 0x7fb2400a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:49.268 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb244ada700 1 -- 172.21.15.42:0/3232279753 >> v2:172.21.15.84:3300/0 conn(0x7fb240138b80 msgr2=0x7fb2400a1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:49.268 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb244ada700 1 --2- 172.21.15.42:0/3232279753 >> v2:172.21.15.84:3300/0 conn(0x7fb240138b80 0x7fb2400a1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:49.268 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb244ada700 1 -- 172.21.15.42:0/3232279753 >> v1:172.21.15.42:6789/0 conn(0x7fb24005c4f0 legacy=0x7fb2400a2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:49.268 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb244ada700 1 -- 172.21.15.42:0/3232279753 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2400a1b90 con 0x7fb2400aa1a0 2020-04-02T23:24:49.269 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb22e7fc700 1 -- 172.21.15.42:0/3232279753 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565943693 0 0) 0x7fb2400a0380 con 0x7fb24005c4f0 2020-04-02T23:24:49.269 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb244ada700 1 --2- 172.21.15.42:0/3232279753 >> v2:172.21.15.42:3300/0 conn(0x7fb2400aa1a0 0x7fb2400a5280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb230002f30 tx=0x7fb230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:49.269 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb244ada700 1 --2- 172.21.15.42:0/3232279753 >> v2:172.21.15.42:3300/0 conn(0x7fb2400aa1a0 0x7fb2400a5280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb230002f30 tx=0x7fb230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:49.269 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb244ada700 1 --2- 172.21.15.42:0/3232279753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2400aa1a0 0x7fb2400a5280 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7fb230002f30 tx=0x7fb230007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:49.270 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb244ada700 1 --2- 172.21.15.42:0/3232279753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2400aa1a0 0x7fb2400a5280 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fb230002f30 tx=0x7fb230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:49.270 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb22e7fc700 1 -- 172.21.15.42:0/3232279753 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb230011d20 con 0x7fb2400aa1a0 2020-04-02T23:24:49.270 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb244ada700 1 --2- 172.21.15.42:0/3232279753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2400aa1a0 0x7fb2400a5280 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fb230002f30 tx=0x7fb230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:49.270 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb244ada700 1 --2- 172.21.15.42:0/3232279753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2400aa1a0 0x7fb2400a5280 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fb230002f30 tx=0x7fb230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:49.270 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb22e7fc700 1 -- 172.21.15.42:0/3232279753 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2300072a0 con 0x7fb2400aa1a0 2020-04-02T23:24:49.270 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb24753f700 1 -- 172.21.15.42:0/3232279753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2400a5960 con 0x7fb2400aa1a0 2020-04-02T23:24:49.271 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb22e7fc700 1 -- 172.21.15.42:0/3232279753 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2300056c0 con 0x7fb2400aa1a0 2020-04-02T23:24:49.271 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.258+0000 7fb24753f700 1 -- 172.21.15.42:0/3232279753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2400ae8c0 con 0x7fb2400aa1a0 2020-04-02T23:24:49.271 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.259+0000 7fb244ada700 1 --2- 172.21.15.42:0/3232279753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2400aa1a0 0x7fb2400a5280 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fb230002f30 tx=0x7fb230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:49.271 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.259+0000 7fb22e7fc700 1 -- 172.21.15.42:0/3232279753 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fb230005930 con 0x7fb2400aa1a0 2020-04-02T23:24:49.271 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.259+0000 7fb244ada700 1 --2- 172.21.15.42:0/3232279753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2400aa1a0 0x7fb2400a5280 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fb230002f30 tx=0x7fb230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:49.271 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.259+0000 7fb24753f700 1 -- 172.21.15.42:0/3232279753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb240056c50 con 0x7fb2400aa1a0 2020-04-02T23:24:49.272 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.260+0000 7fb22e7fc700 1 --2- 172.21.15.42:0/3232279753 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb22004d4c0 0x7fb22004f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:49.272 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.260+0000 7fb22e7fc700 1 -- 172.21.15.42:0/3232279753 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb230061330 con 0x7fb2400aa1a0 2020-04-02T23:24:49.272 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.260+0000 7fb2452db700 1 --2- 172.21.15.42:0/3232279753 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb22004d4c0 0x7fb22004f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:49.272 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.260+0000 7fb2452db700 1 --2- 172.21.15.42:0/3232279753 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb22004d4c0 0x7fb22004f980 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb238007a40 tx=0x7fb238008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:49.272 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.260+0000 7fb2452db700 1 --2- 172.21.15.42:0/3232279753 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb22004d4c0 0x7fb22004f980 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb238007a40 tx=0x7fb238008000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:49.272 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.260+0000 7fb2452db700 1 --2- 172.21.15.42:0/3232279753 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb22004d4c0 0x7fb22004f980 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7fb238007a40 tx=0x7fb238008000).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:49.273 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.263+0000 7fb244ada700 1 --2- 172.21.15.42:0/3232279753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2400aa1a0 0x7fb2400a5280 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fb230002f30 tx=0x7fb230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:49.273 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.263+0000 7fb22e7fc700 1 -- 172.21.15.42:0/3232279753 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fb23003cb50 con 0x7fb2400aa1a0 2020-04-02T23:24:49.460 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:49.457+0000 7fb24753f700 1 -- 172.21.15.42:0/3232279753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb24005a6b0 con 0x7fb2400aa1a0 2020-04-02T23:24:50.003 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.001+0000 7fb244ada700 1 --2- 172.21.15.42:0/3232279753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2400aa1a0 0x7fb2400a5280 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fb230002f30 tx=0x7fb230007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.003 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.001+0000 7fb22e7fc700 1 -- 172.21.15.42:0/3232279753 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v3) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb230040170 con 0x7fb2400aa1a0 2020-04-02T23:24:50.005 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.003+0000 7fb24753f700 1 -- 172.21.15.42:0/3232279753 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb22004d4c0 msgr2=0x7fb22004f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:50.005 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.003+0000 7fb24753f700 1 --2- 172.21.15.42:0/3232279753 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb22004d4c0 0x7fb22004f980 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7fb238007a40 tx=0x7fb238008000).stop 2020-04-02T23:24:50.005 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.003+0000 7fb24753f700 1 -- 172.21.15.42:0/3232279753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2400aa1a0 msgr2=0x7fb2400a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:50.006 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.003+0000 7fb24753f700 1 --2- 172.21.15.42:0/3232279753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2400aa1a0 0x7fb2400a5280 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7fb230002f30 tx=0x7fb230007a40).stop 2020-04-02T23:24:50.006 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.003+0000 7fb24753f700 1 -- 172.21.15.42:0/3232279753 shutdown_connections 2020-04-02T23:24:50.006 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.003+0000 7fb24753f700 1 --2- 172.21.15.42:0/3232279753 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb22004d4c0 0x7fb22004f980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:50.006 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.003+0000 7fb24753f700 1 --2- 172.21.15.42:0/3232279753 >> v2:172.21.15.84:3300/0 conn(0x7fb240138b80 0x7fb2400a1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:50.006 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.003+0000 7fb24753f700 1 --2- 172.21.15.42:0/3232279753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2400aa1a0 0x7fb2400a5280 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:50.006 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.003+0000 7fb24753f700 1 -- 172.21.15.42:0/3232279753 >> 172.21.15.42:0/3232279753 conn(0x7fb2400aedc0 msgr2=0x7fb2400af1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:50.006 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.003+0000 7fb24753f700 1 -- 172.21.15.42:0/3232279753 shutdown_connections 2020-04-02T23:24:50.007 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.003+0000 7fb24753f700 1 -- 172.21.15.42:0/3232279753 wait complete. 2020-04-02T23:24:50.018 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:50.034 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:24:50.198 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.193+0000 7f65ba3f7700 1 Processor -- start 2020-04-02T23:24:50.198 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.193+0000 7f65ba3f7700 1 -- start start 2020-04-02T23:24:50.198 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.194+0000 7f65ba3f7700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f65b405c090 0x7f65b405c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:50.198 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.194+0000 7f65ba3f7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f65b4141060 0x7f65b4143450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:50.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.194+0000 7f65ba3f7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b405c950 con 0x7f65b40aa1a0 2020-04-02T23:24:50.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.194+0000 7f65ba3f7700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b40aacd0 con 0x7f65b405c090 2020-04-02T23:24:50.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.194+0000 7f65ba3f7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b40a2980 con 0x7f65b4141060 2020-04-02T23:24:50.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.194+0000 7f65b37fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f65b405c090 0x7f65b405c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:50.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.194+0000 7f65b37fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f65b405c090 0x7f65b405c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39830/0 (socket says 172.21.15.42:39830) 2020-04-02T23:24:50.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.194+0000 7f65b37fe700 1 -- 172.21.15.42:0/3471665190 learned_addr learned my addr 172.21.15.42:0/3471665190 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:50.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.194+0000 7f65b8994700 1 --2- 172.21.15.42:0/3471665190 >> v2:172.21.15.84:3300/0 conn(0x7f65b4141060 0x7f65b4143450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:50.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.194+0000 7f65b37fe700 1 -- 172.21.15.42:0/3471665190 >> v2:172.21.15.84:3300/0 conn(0x7f65b4141060 msgr2=0x7f65b4143450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:50.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.194+0000 7f65b37fe700 1 --2- 172.21.15.42:0/3471665190 >> v2:172.21.15.84:3300/0 conn(0x7f65b4141060 0x7f65b4143450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:50.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.194+0000 7f65b37fe700 1 -- 172.21.15.42:0/3471665190 >> v1:172.21.15.84:6789/0 conn(0x7f65b40aa1a0 legacy=0x7f65b4138720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:50.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.194+0000 7f65b37fe700 1 -- 172.21.15.42:0/3471665190 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b413c100 con 0x7f65b405c090 2020-04-02T23:24:50.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.194+0000 7f65b37fe700 1 --2- 172.21.15.42:0/3471665190 >> v2:172.21.15.42:3300/0 conn(0x7f65b405c090 0x7f65b405c4f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f65a8002f30 tx=0x7f65a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.195+0000 7f65b37fe700 1 --2- 172.21.15.42:0/3471665190 >> v2:172.21.15.42:3300/0 conn(0x7f65b405c090 0x7f65b405c4f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f65a8002f30 tx=0x7f65a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.195+0000 7f65b37fe700 1 --2- 172.21.15.42:0/3471665190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b405c090 0x7f65b405c4f0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f65a8002f30 tx=0x7f65a8007a40).ready entity=mon.0 client_cookie=320b3814b4f16a0e server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:50.201 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.195+0000 7f65b37fe700 1 --2- 172.21.15.42:0/3471665190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b405c090 0x7f65b405c4f0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f65a8002f30 tx=0x7f65a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.201 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.195+0000 7f65b2ffd700 1 -- 172.21.15.42:0/3471665190 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65a8011670 con 0x7f65b405c090 2020-04-02T23:24:50.201 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.195+0000 7f65b37fe700 1 --2- 172.21.15.42:0/3471665190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b405c090 0x7f65b405c4f0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f65a8002f30 tx=0x7f65a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.201 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.195+0000 7f65b37fe700 1 --2- 172.21.15.42:0/3471665190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b405c090 0x7f65b405c4f0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f65a8002f30 tx=0x7f65a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.201 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.195+0000 7f65b2ffd700 1 -- 172.21.15.42:0/3471665190 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a80117d0 con 0x7f65b405c090 2020-04-02T23:24:50.201 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.195+0000 7f65b2ffd700 1 -- 172.21.15.42:0/3471665190 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65a8011bb0 con 0x7f65b405c090 2020-04-02T23:24:50.201 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.195+0000 7f65ba3f7700 1 -- 172.21.15.42:0/3471665190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b405c090 msgr2=0x7f65b405c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:50.201 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.195+0000 7f65ba3f7700 1 --2- 172.21.15.42:0/3471665190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b405c090 0x7f65b405c4f0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f65a8002f30 tx=0x7f65a8007a40).stop 2020-04-02T23:24:50.202 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.195+0000 7f65ba3f7700 1 -- 172.21.15.42:0/3471665190 shutdown_connections 2020-04-02T23:24:50.202 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.195+0000 7f65ba3f7700 1 --2- 172.21.15.42:0/3471665190 >> v2:172.21.15.84:3300/0 conn(0x7f65b4141060 0x7f65b4143450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:50.202 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.195+0000 7f65ba3f7700 1 --2- 172.21.15.42:0/3471665190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b405c090 0x7f65b405c4f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:50.202 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.195+0000 7f65ba3f7700 1 -- 172.21.15.42:0/3471665190 >> 172.21.15.42:0/3471665190 conn(0x7f65b40aedc0 msgr2=0x7f65b40af1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:50.202 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.195+0000 7f65ba3f7700 1 -- 172.21.15.42:0/3471665190 shutdown_connections 2020-04-02T23:24:50.202 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.195+0000 7f65ba3f7700 1 -- 172.21.15.42:0/3471665190 wait complete. 2020-04-02T23:24:50.202 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.196+0000 7f65ba3f7700 1 Processor -- start 2020-04-02T23:24:50.203 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.196+0000 7f65ba3f7700 1 -- start start 2020-04-02T23:24:50.206 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.197+0000 7f65ba3f7700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f65b4141060 0x7f65b4132730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:50.206 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.197+0000 7f65ba3f7700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b4134bb0 con 0x7f65b405c090 2020-04-02T23:24:50.206 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.197+0000 7f65ba3f7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b41398d0 con 0x7f65b40aa1a0 2020-04-02T23:24:50.206 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.197+0000 7f65ba3f7700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b41357a0 con 0x7f65b4141060 2020-04-02T23:24:50.206 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.197+0000 7f65b8994700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f65b4141060 0x7f65b4132730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:50.206 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.197+0000 7f65b3fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f65b405c090 0x7f65b4132020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59256/0 (socket says 172.21.15.42:59256) 2020-04-02T23:24:50.207 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.197+0000 7f65b8994700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f65b4141060 0x7f65b4132730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39836/0 (socket says 172.21.15.42:39836) 2020-04-02T23:24:50.207 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.197+0000 7f65b3fff700 1 -- 172.21.15.42:0/2430033874 learned_addr learned my addr 172.21.15.42:0/2430033874 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:50.207 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.197+0000 7f65b8994700 1 -- 172.21.15.42:0/2430033874 >> v1:172.21.15.84:6789/0 conn(0x7f65b40aa1a0 legacy=0x7f65b40a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:50.207 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.197+0000 7f65b17fa700 1 -- 172.21.15.42:0/2430033874 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013647290 0 0) 0x7f65b4134bb0 con 0x7f65b405c090 2020-04-02T23:24:50.207 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.197+0000 7f65b8994700 1 -- 172.21.15.42:0/2430033874 >> v1:172.21.15.42:6789/0 conn(0x7f65b405c090 legacy=0x7f65b4132020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:50.207 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.197+0000 7f65b8994700 1 -- 172.21.15.42:0/2430033874 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b4135990 con 0x7f65b4141060 2020-04-02T23:24:50.207 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.197+0000 7f65b8994700 1 --2- 172.21.15.42:0/2430033874 >> v2:172.21.15.42:3300/0 conn(0x7f65b4141060 0x7f65b4132730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f65a8007ed0 tx=0x7f65ac010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.208 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.197+0000 7f65b8994700 1 --2- 172.21.15.42:0/2430033874 >> v2:172.21.15.42:3300/0 conn(0x7f65b4141060 0x7f65b4132730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f65a8007ed0 tx=0x7f65ac010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.208 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.197+0000 7f65b8994700 1 --2- 172.21.15.42:0/2430033874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b4141060 0x7f65b4132730 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f65a8007ed0 tx=0x7f65ac010ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:50.208 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.198+0000 7f65b8994700 1 --2- 172.21.15.42:0/2430033874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b4141060 0x7f65b4132730 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f65a8007ed0 tx=0x7f65ac010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.208 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.198+0000 7f65b17fa700 1 -- 172.21.15.42:0/2430033874 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65ac00e350 con 0x7f65b4141060 2020-04-02T23:24:50.208 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.198+0000 7f65b8994700 1 --2- 172.21.15.42:0/2430033874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b4141060 0x7f65b4132730 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f65a8007ed0 tx=0x7f65ac010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.208 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.198+0000 7f65b8994700 1 --2- 172.21.15.42:0/2430033874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b4141060 0x7f65b4132730 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f65a8007ed0 tx=0x7f65ac010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.208 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.198+0000 7f65b17fa700 1 -- 172.21.15.42:0/2430033874 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac005c30 con 0x7f65b4141060 2020-04-02T23:24:50.209 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.198+0000 7f65ba3f7700 1 -- 172.21.15.42:0/2430033874 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b41348f0 con 0x7f65b4141060 2020-04-02T23:24:50.209 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.198+0000 7f65b17fa700 1 -- 172.21.15.42:0/2430033874 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65ac00c900 con 0x7f65b4141060 2020-04-02T23:24:50.209 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.198+0000 7f65ba3f7700 1 -- 172.21.15.42:0/2430033874 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b40ae1a0 con 0x7f65b4141060 2020-04-02T23:24:50.209 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.198+0000 7f65b8994700 1 --2- 172.21.15.42:0/2430033874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b4141060 0x7f65b4132730 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f65a8007ed0 tx=0x7f65ac010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.209 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.199+0000 7f65ba3f7700 1 -- 172.21.15.42:0/2430033874 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b4056c50 con 0x7f65b4141060 2020-04-02T23:24:50.209 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.199+0000 7f65b17fa700 1 -- 172.21.15.42:0/2430033874 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f65ac00cb70 con 0x7f65b4141060 2020-04-02T23:24:50.209 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.199+0000 7f65b8994700 1 --2- 172.21.15.42:0/2430033874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b4141060 0x7f65b4132730 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f65a8007ed0 tx=0x7f65ac010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.210 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.199+0000 7f65b17fa700 1 --2- 172.21.15.42:0/2430033874 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f659404d390 0x7f659404f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:50.210 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.199+0000 7f65b17fa700 1 -- 172.21.15.42:0/2430033874 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f65ac060e70 con 0x7f65b4141060 2020-04-02T23:24:50.210 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.199+0000 7f65b3fff700 1 --2- 172.21.15.42:0/2430033874 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f659404d390 0x7f659404f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:50.210 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.200+0000 7f65b3fff700 1 --2- 172.21.15.42:0/2430033874 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f659404d390 0x7f659404f850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f65a4001260 tx=0x7f65a40017e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.210 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.200+0000 7f65b3fff700 1 --2- 172.21.15.42:0/2430033874 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f659404d390 0x7f659404f850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f65a4001260 tx=0x7f65a40017e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.210 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.200+0000 7f65b3fff700 1 --2- 172.21.15.42:0/2430033874 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f659404d390 0x7f659404f850 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f65a4001260 tx=0x7f65a40017e0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:50.210 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.203+0000 7f65b8994700 1 --2- 172.21.15.42:0/2430033874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b4141060 0x7f65b4132730 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f65a8007ed0 tx=0x7f65ac010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.211 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.203+0000 7f65b17fa700 1 -- 172.21.15.42:0/2430033874 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f65ac03c510 con 0x7f65b4141060 2020-04-02T23:24:50.398 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.396+0000 7f65ba3f7700 1 -- 172.21.15.42:0/2430033874 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65b4136110 con 0x7f65b4141060 2020-04-02T23:24:50.399 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.396+0000 7f65b8994700 1 --2- 172.21.15.42:0/2430033874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b4141060 0x7f65b4132730 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f65a8007ed0 tx=0x7f65ac010ef0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.399 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.396+0000 7f65b17fa700 1 -- 172.21.15.42:0/2430033874 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1420 (secure 0 0 0) 0x7f65ac00ce00 con 0x7f65b4141060 2020-04-02T23:24:50.399 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:24:50.399 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":3,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":3,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-02T23:24:48.394016+0000","modified":"2020-04-02T23:24:49.996532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:24:50.401 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.398+0000 7f65ba3f7700 1 -- 172.21.15.42:0/2430033874 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f659404d390 msgr2=0x7f659404f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:50.401 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.398+0000 7f65ba3f7700 1 --2- 172.21.15.42:0/2430033874 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f659404d390 0x7f659404f850 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f65a4001260 tx=0x7f65a40017e0).stop 2020-04-02T23:24:50.401 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.398+0000 7f65ba3f7700 1 -- 172.21.15.42:0/2430033874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b4141060 msgr2=0x7f65b4132730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:50.401 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.398+0000 7f65ba3f7700 1 --2- 172.21.15.42:0/2430033874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b4141060 0x7f65b4132730 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f65a8007ed0 tx=0x7f65ac010ef0).stop 2020-04-02T23:24:50.401 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.398+0000 7f65ba3f7700 1 -- 172.21.15.42:0/2430033874 shutdown_connections 2020-04-02T23:24:50.401 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.398+0000 7f65ba3f7700 1 --2- 172.21.15.42:0/2430033874 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f659404d390 0x7f659404f850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:50.402 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.398+0000 7f65ba3f7700 1 --2- 172.21.15.42:0/2430033874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b4141060 0x7f65b4132730 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:50.402 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.398+0000 7f65ba3f7700 1 -- 172.21.15.42:0/2430033874 >> 172.21.15.42:0/2430033874 conn(0x7f65b40aedc0 msgr2=0x7f65b40af1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:50.402 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.398+0000 7f65ba3f7700 1 -- 172.21.15.42:0/2430033874 shutdown_connections 2020-04-02T23:24:50.402 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.398+0000 7f65ba3f7700 1 -- 172.21.15.42:0/2430033874 wait complete. 2020-04-02T23:24:50.402 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 3 2020-04-02T23:24:50.410 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:50.424 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:24:50.578 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.576+0000 7f0809790700 1 Processor -- start 2020-04-02T23:24:50.578 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.576+0000 7f0809790700 1 -- start start 2020-04-02T23:24:50.581 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.577+0000 7f0809790700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f08040a6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:50.582 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.577+0000 7f0809790700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f08040a67a0 0x7f08040a5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:50.582 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.577+0000 7f0809790700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f080409a8f0 con 0x7f08040a20b0 2020-04-02T23:24:50.582 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.577+0000 7f0809790700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08040a2680 con 0x7f08040a67a0 2020-04-02T23:24:50.582 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.577+0000 7f0809790700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080409ab90 con 0x7f08040a1cd0 2020-04-02T23:24:50.582 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.577+0000 7f0802ffd700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f08040a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:50.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.577+0000 7f08037fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f08040a67a0 0x7f08040a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:50.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.577+0000 7f0802ffd700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f08040a6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.42:59592/0 (socket says 172.21.15.42:59592) 2020-04-02T23:24:50.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.577+0000 7f0802ffd700 1 -- 172.21.15.42:0/976207865 learned_addr learned my addr 172.21.15.42:0/976207865 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:50.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.577+0000 7f08027fc700 1 --1- 172.21.15.42:0/976207865 >> v1:172.21.15.84:6789/0 conn(0x7f08040a20b0 0x7f08040a5250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:53642/0 (socket says 172.21.15.42:53642) 2020-04-02T23:24:50.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.578+0000 7f0802ffd700 1 -- 172.21.15.42:0/976207865 >> v2:172.21.15.84:3300/0 conn(0x7f08040a67a0 msgr2=0x7f08040a5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:50.584 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.578+0000 7f0802ffd700 1 --2- 172.21.15.42:0/976207865 >> v2:172.21.15.84:3300/0 conn(0x7f08040a67a0 0x7f08040a5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:50.584 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.578+0000 7f0802ffd700 1 -- 172.21.15.42:0/976207865 >> v1:172.21.15.84:6789/0 conn(0x7f08040a20b0 legacy=0x7f08040a5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:50.584 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.578+0000 7f0802ffd700 1 -- 172.21.15.42:0/976207865 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080409ae30 con 0x7f08040a1cd0 2020-04-02T23:24:50.584 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.578+0000 7f0802ffd700 1 --2- 172.21.15.42:0/976207865 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f08040a6340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f07ec002f30 tx=0x7f07ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.584 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.578+0000 7f0802ffd700 1 --2- 172.21.15.42:0/976207865 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f08040a6340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f07ec002f30 tx=0x7f07ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.584 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.578+0000 7f0802ffd700 1 --2- 172.21.15.42:0/976207865 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f08040a6340 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f07ec002f30 tx=0x7f07ec007a40).ready entity=mon.2 client_cookie=26392197c8b4e6cc server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:50.585 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.578+0000 7f0802ffd700 1 --2- 172.21.15.42:0/976207865 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f08040a6340 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f07ec002f30 tx=0x7f07ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.585 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.578+0000 7f0801ffb700 1 -- 172.21.15.42:0/976207865 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07ec013880 con 0x7f08040a1cd0 2020-04-02T23:24:50.585 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.578+0000 7f0802ffd700 1 --2- 172.21.15.42:0/976207865 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f08040a6340 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f07ec002f30 tx=0x7f07ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.585 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.578+0000 7f0802ffd700 1 --2- 172.21.15.42:0/976207865 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f08040a6340 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f07ec002f30 tx=0x7f07ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.585 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.578+0000 7f0801ffb700 1 -- 172.21.15.42:0/976207865 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec0139e0 con 0x7f08040a1cd0 2020-04-02T23:24:50.586 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.578+0000 7f0801ffb700 1 -- 172.21.15.42:0/976207865 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07ec013e00 con 0x7f08040a1cd0 2020-04-02T23:24:50.586 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.578+0000 7f0809790700 1 -- 172.21.15.42:0/976207865 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 msgr2=0x7f08040a6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:50.586 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.578+0000 7f0809790700 1 --2- 172.21.15.42:0/976207865 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f08040a6340 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f07ec002f30 tx=0x7f07ec007a40).stop 2020-04-02T23:24:50.586 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.579+0000 7f0809790700 1 -- 172.21.15.42:0/976207865 shutdown_connections 2020-04-02T23:24:50.586 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.579+0000 7f0809790700 1 --2- 172.21.15.42:0/976207865 >> v2:172.21.15.84:3300/0 conn(0x7f08040a67a0 0x7f08040a5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:50.586 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.579+0000 7f0809790700 1 --2- 172.21.15.42:0/976207865 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f08040a6340 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:50.587 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.579+0000 7f0809790700 1 -- 172.21.15.42:0/976207865 >> 172.21.15.42:0/976207865 conn(0x7f080405b720 msgr2=0x7f08040aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:50.587 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.579+0000 7f0809790700 1 -- 172.21.15.42:0/976207865 shutdown_connections 2020-04-02T23:24:50.587 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.579+0000 7f0809790700 1 -- 172.21.15.42:0/976207865 wait complete. 2020-04-02T23:24:50.587 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.579+0000 7f0809790700 1 Processor -- start 2020-04-02T23:24:50.587 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.579+0000 7f0809790700 1 -- start start 2020-04-02T23:24:50.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.580+0000 7f0809790700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f0804091590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:50.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.580+0000 7f0809790700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0804066ba0 con 0x7f08040a67a0 2020-04-02T23:24:50.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.580+0000 7f0809790700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0804066e40 con 0x7f08040a20b0 2020-04-02T23:24:50.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.580+0000 7f0809790700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08040910f0 con 0x7f08040a1cd0 2020-04-02T23:24:50.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.580+0000 7f08037fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f08040a67a0 0x7f0804137590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59274/0 (socket says 172.21.15.42:59274) 2020-04-02T23:24:50.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.580+0000 7f08037fe700 1 -- 172.21.15.42:0/1303619600 learned_addr learned my addr 172.21.15.42:0/1303619600 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:50.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.580+0000 7f0802ffd700 1 --2- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f0804091590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:50.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.580+0000 7f07fbfff700 1 -- 172.21.15.42:0/1303619600 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625618900 0 0) 0x7f0804066ba0 con 0x7f08040a67a0 2020-04-02T23:24:50.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.580+0000 7f07fbfff700 1 -- 172.21.15.42:0/1303619600 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07e8002fe0 con 0x7f08040a67a0 2020-04-02T23:24:50.593 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.580+0000 7f07fbfff700 1 -- 172.21.15.42:0/1303619600 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339757931 0 0) 0x7f0804066e40 con 0x7f08040a20b0 2020-04-02T23:24:50.593 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.580+0000 7f0802ffd700 1 -- 172.21.15.42:0/1303619600 >> v1:172.21.15.84:6789/0 conn(0x7f08040a20b0 legacy=0x7f0804066070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:50.593 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.581+0000 7f0802ffd700 1 -- 172.21.15.42:0/1303619600 >> v1:172.21.15.42:6789/0 conn(0x7f08040a67a0 legacy=0x7f0804137590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:50.593 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.581+0000 7f0802ffd700 1 -- 172.21.15.42:0/1303619600 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0804066890 con 0x7f08040a1cd0 2020-04-02T23:24:50.593 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.581+0000 7f0802ffd700 1 --2- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f0804091590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f07ec002f30 tx=0x7f07ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.593 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.581+0000 7f0802ffd700 1 --2- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f0804091590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f07ec002f30 tx=0x7f07ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.593 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.581+0000 7f0802ffd700 1 --2- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f0804091590 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f07ec002f30 tx=0x7f07ec007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:50.594 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.581+0000 7f0802ffd700 1 --2- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f0804091590 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f07ec002f30 tx=0x7f07ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.594 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.581+0000 7f07fbfff700 1 -- 172.21.15.42:0/1303619600 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07ec013e40 con 0x7f08040a1cd0 2020-04-02T23:24:50.594 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.581+0000 7f0802ffd700 1 --2- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f0804091590 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f07ec002f30 tx=0x7f07ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.594 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.581+0000 7f0802ffd700 1 --2- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f0804091590 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f07ec002f30 tx=0x7f07ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.594 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.581+0000 7f07fbfff700 1 -- 172.21.15.42:0/1303619600 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec007340 con 0x7f08040a1cd0 2020-04-02T23:24:50.594 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.581+0000 7f07fbfff700 1 -- 172.21.15.42:0/1303619600 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07ec0056c0 con 0x7f08040a1cd0 2020-04-02T23:24:50.594 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.581+0000 7f0809790700 1 -- 172.21.15.42:0/1303619600 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08040aac50 con 0x7f08040a1cd0 2020-04-02T23:24:50.595 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.581+0000 7f0809790700 1 -- 172.21.15.42:0/1303619600 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0804137e60 con 0x7f08040a1cd0 2020-04-02T23:24:50.595 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.582+0000 7f0802ffd700 1 --2- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f0804091590 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f07ec002f30 tx=0x7f07ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.595 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.582+0000 7f0809790700 1 -- 172.21.15.42:0/1303619600 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f080405d2e0 con 0x7f08040a1cd0 2020-04-02T23:24:50.595 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.582+0000 7f07fbfff700 1 -- 172.21.15.42:0/1303619600 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f07ec00fba0 con 0x7f08040a1cd0 2020-04-02T23:24:50.595 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.582+0000 7f0802ffd700 1 --2- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f0804091590 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f07ec002f30 tx=0x7f07ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.595 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.582+0000 7f07fbfff700 1 --2- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f07e804d880 0x7f07e804fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:50.595 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.582+0000 7f07fbfff700 1 -- 172.21.15.42:0/1303619600 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f07ec060d20 con 0x7f08040a1cd0 2020-04-02T23:24:50.596 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.582+0000 7f08027fc700 1 --2- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f07e804d880 0x7f07e804fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:50.596 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.583+0000 7f08027fc700 1 --2- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f07e804d880 0x7f07e804fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f07f4001160 tx=0x7f07f40016b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.596 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.583+0000 7f08027fc700 1 --2- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f07e804d880 0x7f07e804fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f07f4001160 tx=0x7f07f40016b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.596 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.583+0000 7f08027fc700 1 --2- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f07e804d880 0x7f07e804fd40 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f07f4001160 tx=0x7f07f40016b0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:50.596 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.586+0000 7f0802ffd700 1 --2- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f0804091590 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f07ec002f30 tx=0x7f07ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.596 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.586+0000 7f07fbfff700 1 -- 172.21.15.42:0/1303619600 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f07ec03c540 con 0x7f08040a1cd0 2020-04-02T23:24:50.734 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.732+0000 7f0809790700 1 -- 172.21.15.42:0/1303619600 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0804056c50 con 0x7f08040a1cd0 2020-04-02T23:24:50.736 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.733+0000 7f0802ffd700 1 --2- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f0804091590 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f07ec002f30 tx=0x7f07ec007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:50.736 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.733+0000 7f07fbfff700 1 -- 172.21.15.42:0/1303619600 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f07ec03fb60 con 0x7f08040a1cd0 2020-04-02T23:24:50.736 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:24:50.736 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":26,"fsid":"571c521c-9ca7-4052-ba5b-7a77e18ff12c","created":"2020-04-02T23:24:23.980442+0000","modified":"2020-04-02T23:24:48.393847+0000","last_up_change":"2020-04-02T23:24:36.096260+0000","last_in_change":"2020-04-02T23:24:36.096260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:24:27.091980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:24:40.298468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:24:43.688260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:24:45.991301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"976aac36-1cf8-408b-bf56-9f0eefe43b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":24836},{"type":"v1","addr":"172.21.15.42:6801","nonce":24836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":24836},{"type":"v1","addr":"172.21.15.42:6803","nonce":24836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":24836},{"type":"v1","addr":"172.21.15.42:6807","nonce":24836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":24836},{"type":"v1","addr":"172.21.15.42:6805","nonce":24836}]},"public_addr":"172.21.15.42:6801/24836","cluster_addr":"172.21.15.42:6803/24836","heartbeat_back_addr":"172.21.15.42:6807/24836","heartbeat_front_addr":"172.21.15.42:6805/24836","state":["exists","up"]},{"osd":1,"uuid":"22c1e489-ab99-4205-ba9d-fbfc144d2a8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":24881},{"type":"v1","addr":"172.21.15.42:6809","nonce":24881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":24881},{"type":"v1","addr":"172.21.15.42:6811","nonce":24881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":24881},{"type":"v1","addr":"172.21.15.42:6815","nonce":24881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":24881},{"type":"v1","addr":"172.21.15.42:6813","nonce":24881}]},"public_addr":"172.21.15.42:6809/24881","cluster_addr":"172.21.15.42:6811/24881","heartbeat_back_addr":"172.21.15.42:6815/24881","heartbeat_front_addr":"172.21.15.42:6813/24881","state":["exists","up"]},{"osd":2,"uuid":"f0b18b09-93c0-4286-8d15-746611ba53cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":24917},{"type":"v1","addr":"172.21.15.42:6817","nonce":24917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":24917},{"type":"v1","addr":"172.21.15.42:6819","nonce":24917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":24917},{"type":"v1","addr":"172.21.15.42:6823","nonce":24917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":24917},{"type":"v1","addr":"172.21.15.42:6821","nonce":24917}]},"public_addr":"172.21.15.42:6817/24917","cluster_addr":"172.21.15.42:6819/24917","heartbeat_back_addr":"172.21.15.42:6823/24917","heartbeat_front_addr":"172.21.15.42:6821/24917","state":["exists","up"]},{"osd":3,"uuid":"989d4a69-9abe-44de-95f2-6c7cbbe07471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":24940},{"type":"v1","addr":"172.21.15.42:6825","nonce":24940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":24940},{"type":"v1","addr":"172.21.15.42:6827","nonce":24940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":24940},{"type":"v1","addr":"172.21.15.42:6831","nonce":24940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":24940},{"type":"v1","addr":"172.21.15.42:6829","nonce":24940}]},"public_addr":"172.21.15.42:6825/24940","cluster_addr":"172.21.15.42:6827/24940","heartbeat_back_addr":"172.21.15.42:6831/24940","heartbeat_front_addr":"172.21.15.42:6829/24940","state":["exists","up"]},{"osd":4,"uuid":"b1a2ce60-ae80-4f8a-97a3-4fbb1399fdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":24239},{"type":"v1","addr":"172.21.15.84:6803","nonce":24239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":24239},{"type":"v1","addr":"172.21.15.84:6805","nonce":24239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":24239},{"type":"v1","addr":"172.21.15.84:6809","nonce":24239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":24239},{"type":"v1","addr":"172.21.15.84:6807","nonce":24239}]},"public_addr":"172.21.15.84:6803/24239","cluster_addr":"172.21.15.84:6805/24239","heartbeat_back_addr":"172.21.15.84:6809/24239","heartbeat_front_addr":"172.21.15.84:6807/24239","state":["exists","up"]},{"osd":5,"uuid":"396b36e5-7226-4e8e-aa8a-749cb5cec101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":24276},{"type":"v1","addr":"172.21.15.84:6811","nonce":24276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":24276},{"type":"v1","addr":"172.21.15.84:6813","nonce":24276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":24276},{"type":"v1","addr":"172.21.15.84:6817","nonce":24276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":24276},{"type":"v1","addr":"172.21.15.84:6815","nonce":24276}]},"public_addr":"172.21.15.84:6811/24276","cluster_addr":"172.21.15.84:6813/24276","heartbeat_back_addr":"172.21.15.84:6817/24276","heartbeat_front_addr":"172.21.15.84:6815/24276","state":["exists","up"]},{"osd":6,"uuid":"884bb915-28c3-463d-8046-e2908f6e8e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":24319},{"type":"v1","addr":"172.21.15.84:6819","nonce":24319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":24319},{"type":"v1","addr":"172.21.15.84:6821","nonce":24319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":24319},{"type":"v1","addr":"172.21.15.84:6825","nonce":24319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":24319},{"type":"v1","addr":"172.21.15.84:6823","nonce":24319}]},"public_addr":"172.21.15.84:6819/24319","cluster_addr":"172.21.15.84:6821/24319","heartbeat_back_addr":"172.21.15.84:6825/24319","heartbeat_front_addr":"172.21.15.84:6823/24319","state":["exists","up"]},{"osd":7,"uuid":"70e90d1d-f081-4de5-af4b-e987c159e597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":24349},{"type":"v1","addr":"172.21.15.84:6827","nonce":24349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":24349},{"type":"v1","addr":"172.21.15.84:6829","nonce":24349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":24349},{"type":"v1","addr":"172.21.15.84:6833","nonce":24349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":24349},{"type":"v1","addr":"172.21.15.84:6831","nonce":24349}]},"public_addr":"172.21.15.84:6827/24349","cluster_addr":"172.21.15.84:6829/24349","heartbeat_back_addr":"172.21.15.84:6833/24349","heartbeat_front_addr":"172.21.15.84:6831/24349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.195657+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.241354+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.257764+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.368827+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.967296+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.991068+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.077047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.095727+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:24:50.737 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.735+0000 7f0809790700 1 -- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f07e804d880 msgr2=0x7f07e804fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:50.737 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.735+0000 7f0809790700 1 --2- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f07e804d880 0x7f07e804fd40 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f07f4001160 tx=0x7f07f40016b0).stop 2020-04-02T23:24:50.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.735+0000 7f0809790700 1 -- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 msgr2=0x7f0804091590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:50.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.735+0000 7f0809790700 1 --2- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f0804091590 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f07ec002f30 tx=0x7f07ec007a40).stop 2020-04-02T23:24:50.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.735+0000 7f0809790700 1 -- 172.21.15.42:0/1303619600 shutdown_connections 2020-04-02T23:24:50.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.735+0000 7f0809790700 1 --2- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f07e804d880 0x7f07e804fd40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:50.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.735+0000 7f0809790700 1 --2- 172.21.15.42:0/1303619600 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f08040a1cd0 0x7f0804091590 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:50.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.735+0000 7f0809790700 1 -- 172.21.15.42:0/1303619600 >> 172.21.15.42:0/1303619600 conn(0x7f080405b720 msgr2=0x7f08040a6000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:50.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.735+0000 7f0809790700 1 -- 172.21.15.42:0/1303619600 shutdown_connections 2020-04-02T23:24:50.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:50.735+0000 7f0809790700 1 -- 172.21.15.42:0/1303619600 wait complete. 2020-04-02T23:24:50.748 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-04-02T23:24:50.748 INFO:tasks.ceph.mds.b:Restarting daemon 2020-04-02T23:24:50.748 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:24:50.765 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-04-02T23:24:50.807 INFO:tasks.ceph.mds.b:Started 2020-04-02T23:24:50.807 INFO:tasks.ceph.mds.a:Restarting daemon 2020-04-02T23:24:50.808 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:50.821 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-04-02T23:24:50.865 INFO:tasks.ceph.mds.a:Started 2020-04-02T23:24:50.866 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:50.866 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-04-02T23:24:50.880 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:24:50.888 INFO:tasks.ceph.mds.b.smithi084.stdout:starting mds.b at 2020-04-02T23:24:50.948 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2020-04-02T23:24:51.041 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.039+0000 7f2baf276700 1 Processor -- start 2020-04-02T23:24:51.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.039+0000 7f2baf276700 1 -- start start 2020-04-02T23:24:51.048 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2baf276700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2ba80aa1a0 0x7f2ba8138720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:51.048 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2baf276700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2ba8138b80 0x7f2ba805c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:51.048 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2baf276700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2ba805c4f0 0x7f2ba809dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:51.049 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2baf276700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba80aacd0 con 0x7f2ba805c4f0 2020-04-02T23:24:51.049 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2baf276700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba805c960 con 0x7f2ba8138b80 2020-04-02T23:24:51.049 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2baf276700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba80a2980 con 0x7f2ba80aa1a0 2020-04-02T23:24:51.049 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2bad813700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2ba805c4f0 0x7f2ba809dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:51.049 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2bad813700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2ba805c4f0 0x7f2ba809dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39878/0 (socket says 172.21.15.42:39878) 2020-04-02T23:24:51.049 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2bad813700 1 -- 172.21.15.42:0/359263958 learned_addr learned my addr 172.21.15.42:0/359263958 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:51.049 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2bac811700 1 --2- 172.21.15.42:0/359263958 >> v2:172.21.15.84:3300/0 conn(0x7f2ba8138b80 0x7f2ba805c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:51.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2bad012700 1 --2- 172.21.15.42:0/359263958 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2ba80aa1a0 0x7f2ba8138720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:51.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2bad813700 1 -- 172.21.15.42:0/359263958 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2ba80aa1a0 msgr2=0x7f2ba8138720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:51.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2bad813700 1 --2- 172.21.15.42:0/359263958 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2ba80aa1a0 0x7f2ba8138720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:51.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2bad813700 1 -- 172.21.15.42:0/359263958 >> v2:172.21.15.84:3300/0 conn(0x7f2ba8138b80 msgr2=0x7f2ba805c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:51.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2bad813700 1 --2- 172.21.15.42:0/359263958 >> v2:172.21.15.84:3300/0 conn(0x7f2ba8138b80 0x7f2ba805c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:51.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2bad813700 1 -- 172.21.15.42:0/359263958 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba813c100 con 0x7f2ba805c4f0 2020-04-02T23:24:51.051 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2bac811700 1 --2- 172.21.15.42:0/359263958 >> v2:172.21.15.84:3300/0 conn(0x7f2ba8138b80 0x7f2ba805c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:24:51.051 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2bad012700 1 --2- 172.21.15.42:0/359263958 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2ba80aa1a0 0x7f2ba8138720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:24:51.051 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2bad813700 1 --2- 172.21.15.42:0/359263958 >> v2:172.21.15.42:3300/0 conn(0x7f2ba805c4f0 0x7f2ba809dc40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2ba00032b0 tx=0x7f2ba0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.051 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2bad813700 1 --2- 172.21.15.42:0/359263958 >> v2:172.21.15.42:3300/0 conn(0x7f2ba805c4f0 0x7f2ba809dc40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2ba00032b0 tx=0x7f2ba0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.051 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.040+0000 7f2bad813700 1 --2- 172.21.15.42:0/359263958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba805c4f0 0x7f2ba809dc40 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f2ba00032b0 tx=0x7f2ba0007dc0).ready entity=mon.0 client_cookie=8a0d6098c04e4ebb server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:51.053 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.041+0000 7f2bad813700 1 --2- 172.21.15.42:0/359263958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba805c4f0 0x7f2ba809dc40 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f2ba00032b0 tx=0x7f2ba0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.053 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.041+0000 7f2b9bfff700 1 -- 172.21.15.42:0/359263958 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ba000a160 con 0x7f2ba805c4f0 2020-04-02T23:24:51.053 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.041+0000 7f2bad813700 1 --2- 172.21.15.42:0/359263958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba805c4f0 0x7f2ba809dc40 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f2ba00032b0 tx=0x7f2ba0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.053 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.041+0000 7f2bad813700 1 --2- 172.21.15.42:0/359263958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba805c4f0 0x7f2ba809dc40 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7f2ba00032b0 tx=0x7f2ba0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.053 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.041+0000 7f2b9bfff700 1 -- 172.21.15.42:0/359263958 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba000a2c0 con 0x7f2ba805c4f0 2020-04-02T23:24:51.053 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.041+0000 7f2b9bfff700 1 -- 172.21.15.42:0/359263958 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ba000a660 con 0x7f2ba805c4f0 2020-04-02T23:24:51.054 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.041+0000 7f2baf276700 1 -- 172.21.15.42:0/359263958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba805c4f0 msgr2=0x7f2ba809dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:51.054 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.041+0000 7f2baf276700 1 --2- 172.21.15.42:0/359263958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba805c4f0 0x7f2ba809dc40 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f2ba00032b0 tx=0x7f2ba0007dc0).stop 2020-04-02T23:24:51.054 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.041+0000 7f2baf276700 1 -- 172.21.15.42:0/359263958 shutdown_connections 2020-04-02T23:24:51.054 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.041+0000 7f2baf276700 1 --2- 172.21.15.42:0/359263958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba805c4f0 0x7f2ba809dc40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:51.054 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.041+0000 7f2baf276700 1 --2- 172.21.15.42:0/359263958 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2ba80aa1a0 0x7f2ba8138720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:51.055 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.041+0000 7f2baf276700 1 --2- 172.21.15.42:0/359263958 >> v2:172.21.15.84:3300/0 conn(0x7f2ba8138b80 0x7f2ba805c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:51.055 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.041+0000 7f2baf276700 1 -- 172.21.15.42:0/359263958 >> 172.21.15.42:0/359263958 conn(0x7f2ba80aedc0 msgr2=0x7f2ba80af1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:51.055 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.041+0000 7f2baf276700 1 -- 172.21.15.42:0/359263958 shutdown_connections 2020-04-02T23:24:51.055 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.041+0000 7f2baf276700 1 -- 172.21.15.42:0/359263958 wait complete. 2020-04-02T23:24:51.055 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.042+0000 7f2baf276700 1 Processor -- start 2020-04-02T23:24:51.055 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.042+0000 7f2baf276700 1 -- start start 2020-04-02T23:24:51.055 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2baf276700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2ba805c4f0 0x7f2ba80a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:51.056 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2baf276700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2ba80aa1a0 0x7f2ba8132080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:51.056 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2baf276700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2ba8138b80 0x7f2ba81324e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:51.056 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2baf276700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba80a4a10 con 0x7f2ba80aa1a0 2020-04-02T23:24:51.056 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2baf276700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba80a4cb0 con 0x7f2ba8138b80 2020-04-02T23:24:51.056 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2baf276700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba80a4f50 con 0x7f2ba805c4f0 2020-04-02T23:24:51.056 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2bac811700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2ba80aa1a0 0x7f2ba8132080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:51.057 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2bac811700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2ba80aa1a0 0x7f2ba8132080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39884/0 (socket says 172.21.15.42:39884) 2020-04-02T23:24:51.057 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2bac811700 1 -- 172.21.15.42:0/885251283 learned_addr learned my addr 172.21.15.42:0/885251283 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:51.057 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2bad813700 1 --2- 172.21.15.42:0/885251283 >> v2:172.21.15.84:3300/0 conn(0x7f2ba8138b80 0x7f2ba81324e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:51.057 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2bad012700 1 --2- 172.21.15.42:0/885251283 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2ba805c4f0 0x7f2ba80a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:51.057 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2bac811700 1 -- 172.21.15.42:0/885251283 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2ba805c4f0 msgr2=0x7f2ba80a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:51.058 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2bac811700 1 --2- 172.21.15.42:0/885251283 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2ba805c4f0 0x7f2ba80a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:51.058 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2bac811700 1 -- 172.21.15.42:0/885251283 >> v2:172.21.15.84:3300/0 conn(0x7f2ba8138b80 msgr2=0x7f2ba81324e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:51.058 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2bac811700 1 --2- 172.21.15.42:0/885251283 >> v2:172.21.15.84:3300/0 conn(0x7f2ba8138b80 0x7f2ba81324e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:51.058 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2bac811700 1 -- 172.21.15.42:0/885251283 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba80a51f0 con 0x7f2ba80aa1a0 2020-04-02T23:24:51.058 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2bac811700 1 --2- 172.21.15.42:0/885251283 >> v2:172.21.15.42:3300/0 conn(0x7f2ba80aa1a0 0x7f2ba8132080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2ba4007920 tx=0x7f2ba4010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.058 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2bac811700 1 --2- 172.21.15.42:0/885251283 >> v2:172.21.15.42:3300/0 conn(0x7f2ba80aa1a0 0x7f2ba8132080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2ba4007920 tx=0x7f2ba4010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.059 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2bac811700 1 --2- 172.21.15.42:0/885251283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba80aa1a0 0x7f2ba8132080 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f2ba4007920 tx=0x7f2ba4010b10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:51.059 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2bac811700 1 --2- 172.21.15.42:0/885251283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba80aa1a0 0x7f2ba8132080 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f2ba4007920 tx=0x7f2ba4010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.059 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2b9a7fc700 1 -- 172.21.15.42:0/885251283 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ba400ea10 con 0x7f2ba80aa1a0 2020-04-02T23:24:51.059 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2bac811700 1 --2- 172.21.15.42:0/885251283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba80aa1a0 0x7f2ba8132080 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f2ba4007920 tx=0x7f2ba4010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.059 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2bac811700 1 --2- 172.21.15.42:0/885251283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba80aa1a0 0x7f2ba8132080 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f2ba4007920 tx=0x7f2ba4010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.059 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2b9a7fc700 1 -- 172.21.15.42:0/885251283 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba400eb70 con 0x7f2ba80aa1a0 2020-04-02T23:24:51.059 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2b9a7fc700 1 -- 172.21.15.42:0/885251283 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ba400a070 con 0x7f2ba80aa1a0 2020-04-02T23:24:51.060 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.043+0000 7f2baf276700 1 -- 172.21.15.42:0/885251283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba80a0730 con 0x7f2ba80aa1a0 2020-04-02T23:24:51.060 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.044+0000 7f2baf276700 1 -- 172.21.15.42:0/885251283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba80a20b0 con 0x7f2ba80aa1a0 2020-04-02T23:24:51.060 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.044+0000 7f2bac811700 1 --2- 172.21.15.42:0/885251283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba80aa1a0 0x7f2ba8132080 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f2ba4007920 tx=0x7f2ba4010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.060 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.045+0000 7f2b9a7fc700 1 -- 172.21.15.42:0/885251283 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f2ba4009170 con 0x7f2ba80aa1a0 2020-04-02T23:24:51.060 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.045+0000 7f2baf276700 1 -- 172.21.15.42:0/885251283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba80a5b00 con 0x7f2ba80aa1a0 2020-04-02T23:24:51.060 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.045+0000 7f2bac811700 1 --2- 172.21.15.42:0/885251283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba80aa1a0 0x7f2ba8132080 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f2ba4007920 tx=0x7f2ba4010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.061 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.045+0000 7f2b9a7fc700 1 --2- 172.21.15.42:0/885251283 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f2b8804d630 0x7f2b8804faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:51.061 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.045+0000 7f2b9a7fc700 1 -- 172.21.15.42:0/885251283 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f2ba4061050 con 0x7f2ba80aa1a0 2020-04-02T23:24:51.061 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.045+0000 7f2bad012700 1 --2- 172.21.15.42:0/885251283 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f2b8804d630 0x7f2b8804faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:51.061 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.045+0000 7f2bad012700 1 --2- 172.21.15.42:0/885251283 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f2b8804d630 0x7f2b8804faf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b9c002f30 tx=0x7f2b9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.061 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.045+0000 7f2bad012700 1 --2- 172.21.15.42:0/885251283 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f2b8804d630 0x7f2b8804faf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b9c002f30 tx=0x7f2b9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.061 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.045+0000 7f2bad012700 1 --2- 172.21.15.42:0/885251283 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f2b8804d630 0x7f2b8804faf0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f2b9c002f30 tx=0x7f2b9c007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:51.062 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.048+0000 7f2bac811700 1 --2- 172.21.15.42:0/885251283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba80aa1a0 0x7f2ba8132080 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f2ba4007920 tx=0x7f2ba4010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.062 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.048+0000 7f2b9a7fc700 1 -- 172.21.15.42:0/885251283 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f2ba403c750 con 0x7f2ba80aa1a0 2020-04-02T23:24:51.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.197+0000 7f2baf276700 1 -- 172.21.15.42:0/885251283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ba8056c50 con 0x7f2ba80aa1a0 2020-04-02T23:24:51.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.197+0000 7f2bac811700 1 --2- 172.21.15.42:0/885251283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba80aa1a0 0x7f2ba8132080 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7f2ba4007920 tx=0x7f2ba4010b10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.200 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.197+0000 7f2b9a7fc700 1 -- 172.21.15.42:0/885251283 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f2ba403fd70 con 0x7f2ba80aa1a0 2020-04-02T23:24:51.201 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:24:51.201 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":26,"fsid":"571c521c-9ca7-4052-ba5b-7a77e18ff12c","created":"2020-04-02T23:24:23.980442+0000","modified":"2020-04-02T23:24:48.393847+0000","last_up_change":"2020-04-02T23:24:36.096260+0000","last_in_change":"2020-04-02T23:24:36.096260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:24:27.091980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:24:40.298468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:24:43.688260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:24:45.991301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"976aac36-1cf8-408b-bf56-9f0eefe43b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":24836},{"type":"v1","addr":"172.21.15.42:6801","nonce":24836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":24836},{"type":"v1","addr":"172.21.15.42:6803","nonce":24836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":24836},{"type":"v1","addr":"172.21.15.42:6807","nonce":24836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":24836},{"type":"v1","addr":"172.21.15.42:6805","nonce":24836}]},"public_addr":"172.21.15.42:6801/24836","cluster_addr":"172.21.15.42:6803/24836","heartbeat_back_addr":"172.21.15.42:6807/24836","heartbeat_front_addr":"172.21.15.42:6805/24836","state":["exists","up"]},{"osd":1,"uuid":"22c1e489-ab99-4205-ba9d-fbfc144d2a8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":24881},{"type":"v1","addr":"172.21.15.42:6809","nonce":24881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":24881},{"type":"v1","addr":"172.21.15.42:6811","nonce":24881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":24881},{"type":"v1","addr":"172.21.15.42:6815","nonce":24881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":24881},{"type":"v1","addr":"172.21.15.42:6813","nonce":24881}]},"public_addr":"172.21.15.42:6809/24881","cluster_addr":"172.21.15.42:6811/24881","heartbeat_back_addr":"172.21.15.42:6815/24881","heartbeat_front_addr":"172.21.15.42:6813/24881","state":["exists","up"]},{"osd":2,"uuid":"f0b18b09-93c0-4286-8d15-746611ba53cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":24917},{"type":"v1","addr":"172.21.15.42:6817","nonce":24917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":24917},{"type":"v1","addr":"172.21.15.42:6819","nonce":24917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":24917},{"type":"v1","addr":"172.21.15.42:6823","nonce":24917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":24917},{"type":"v1","addr":"172.21.15.42:6821","nonce":24917}]},"public_addr":"172.21.15.42:6817/24917","cluster_addr":"172.21.15.42:6819/24917","heartbeat_back_addr":"172.21.15.42:6823/24917","heartbeat_front_addr":"172.21.15.42:6821/24917","state":["exists","up"]},{"osd":3,"uuid":"989d4a69-9abe-44de-95f2-6c7cbbe07471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":24940},{"type":"v1","addr":"172.21.15.42:6825","nonce":24940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":24940},{"type":"v1","addr":"172.21.15.42:6827","nonce":24940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":24940},{"type":"v1","addr":"172.21.15.42:6831","nonce":24940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":24940},{"type":"v1","addr":"172.21.15.42:6829","nonce":24940}]},"public_addr":"172.21.15.42:6825/24940","cluster_addr":"172.21.15.42:6827/24940","heartbeat_back_addr":"172.21.15.42:6831/24940","heartbeat_front_addr":"172.21.15.42:6829/24940","state":["exists","up"]},{"osd":4,"uuid":"b1a2ce60-ae80-4f8a-97a3-4fbb1399fdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":24239},{"type":"v1","addr":"172.21.15.84:6803","nonce":24239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":24239},{"type":"v1","addr":"172.21.15.84:6805","nonce":24239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":24239},{"type":"v1","addr":"172.21.15.84:6809","nonce":24239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":24239},{"type":"v1","addr":"172.21.15.84:6807","nonce":24239}]},"public_addr":"172.21.15.84:6803/24239","cluster_addr":"172.21.15.84:6805/24239","heartbeat_back_addr":"172.21.15.84:6809/24239","heartbeat_front_addr":"172.21.15.84:6807/24239","state":["exists","up"]},{"osd":5,"uuid":"396b36e5-7226-4e8e-aa8a-749cb5cec101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":24276},{"type":"v1","addr":"172.21.15.84:6811","nonce":24276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":24276},{"type":"v1","addr":"172.21.15.84:6813","nonce":24276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":24276},{"type":"v1","addr":"172.21.15.84:6817","nonce":24276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":24276},{"type":"v1","addr":"172.21.15.84:6815","nonce":24276}]},"public_addr":"172.21.15.84:6811/24276","cluster_addr":"172.21.15.84:6813/24276","heartbeat_back_addr":"172.21.15.84:6817/24276","heartbeat_front_addr":"172.21.15.84:6815/24276","state":["exists","up"]},{"osd":6,"uuid":"884bb915-28c3-463d-8046-e2908f6e8e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":24319},{"type":"v1","addr":"172.21.15.84:6819","nonce":24319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":24319},{"type":"v1","addr":"172.21.15.84:6821","nonce":24319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":24319},{"type":"v1","addr":"172.21.15.84:6825","nonce":24319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":24319},{"type":"v1","addr":"172.21.15.84:6823","nonce":24319}]},"public_addr":"172.21.15.84:6819/24319","cluster_addr":"172.21.15.84:6821/24319","heartbeat_back_addr":"172.21.15.84:6825/24319","heartbeat_front_addr":"172.21.15.84:6823/24319","state":["exists","up"]},{"osd":7,"uuid":"70e90d1d-f081-4de5-af4b-e987c159e597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":24349},{"type":"v1","addr":"172.21.15.84:6827","nonce":24349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":24349},{"type":"v1","addr":"172.21.15.84:6829","nonce":24349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":24349},{"type":"v1","addr":"172.21.15.84:6833","nonce":24349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":24349},{"type":"v1","addr":"172.21.15.84:6831","nonce":24349}]},"public_addr":"172.21.15.84:6827/24349","cluster_addr":"172.21.15.84:6829/24349","heartbeat_back_addr":"172.21.15.84:6833/24349","heartbeat_front_addr":"172.21.15.84:6831/24349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.195657+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.241354+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.257764+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.368827+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.967296+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.991068+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.077047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.095727+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:24:51.202 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.199+0000 7f2baf276700 1 -- 172.21.15.42:0/885251283 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f2b8804d630 msgr2=0x7f2b8804faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:51.202 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.199+0000 7f2baf276700 1 --2- 172.21.15.42:0/885251283 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f2b8804d630 0x7f2b8804faf0 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7f2b9c002f30 tx=0x7f2b9c007a40).stop 2020-04-02T23:24:51.202 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.199+0000 7f2baf276700 1 -- 172.21.15.42:0/885251283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba80aa1a0 msgr2=0x7f2ba8132080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:51.203 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.199+0000 7f2baf276700 1 --2- 172.21.15.42:0/885251283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba80aa1a0 0x7f2ba8132080 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7f2ba4007920 tx=0x7f2ba4010b10).stop 2020-04-02T23:24:51.203 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.199+0000 7f2baf276700 1 -- 172.21.15.42:0/885251283 shutdown_connections 2020-04-02T23:24:51.203 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.199+0000 7f2baf276700 1 --2- 172.21.15.42:0/885251283 >> v2:172.21.15.84:3300/0 conn(0x7f2ba8138b80 0x7f2ba81324e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:51.203 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.199+0000 7f2baf276700 1 --2- 172.21.15.42:0/885251283 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f2b8804d630 0x7f2b8804faf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:51.203 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.199+0000 7f2baf276700 1 --2- 172.21.15.42:0/885251283 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f2ba805c4f0 0x7f2ba80a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:51.203 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.199+0000 7f2baf276700 1 --2- 172.21.15.42:0/885251283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba80aa1a0 0x7f2ba8132080 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:51.204 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.199+0000 7f2baf276700 1 -- 172.21.15.42:0/885251283 >> 172.21.15.42:0/885251283 conn(0x7f2ba80aedc0 msgr2=0x7f2ba80af1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:51.204 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.199+0000 7f2baf276700 1 -- 172.21.15.42:0/885251283 shutdown_connections 2020-04-02T23:24:51.204 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.199+0000 7f2baf276700 1 -- 172.21.15.42:0/885251283 wait complete. 2020-04-02T23:24:51.212 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:24:27.091980+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:24:40.298468+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:24:43.688260+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'26', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:24:45.991301+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'26', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-02T23:24:51.213 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:51.265 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-02T23:24:51.421 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.419+0000 7f186dafe700 1 Processor -- start 2020-04-02T23:24:51.421 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.419+0000 7f186dafe700 1 -- start start 2020-04-02T23:24:51.427 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.420+0000 7f186dafe700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f18680a1cd0 0x7f18680a6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:51.428 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.420+0000 7f186dafe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f18680a67a0 0x7f18680a5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:51.428 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.420+0000 7f186dafe700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186809a8f0 con 0x7f18680a20b0 2020-04-02T23:24:51.428 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.420+0000 7f186dafe700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18680a2680 con 0x7f18680a67a0 2020-04-02T23:24:51.428 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.420+0000 7f186dafe700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186809ab90 con 0x7f18680a1cd0 2020-04-02T23:24:51.428 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.420+0000 7f1866ffd700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f18680a20b0 0x7f18680a5250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59314/0 (socket says 172.21.15.42:59314) 2020-04-02T23:24:51.428 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.420+0000 7f1866ffd700 1 -- 172.21.15.42:0/2617914167 learned_addr learned my addr 172.21.15.42:0/2617914167 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:51.429 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.420+0000 7f1867fff700 1 --2- 172.21.15.42:0/2617914167 >> v2:172.21.15.84:3300/0 conn(0x7f18680a67a0 0x7f18680a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:51.429 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.420+0000 7f18677fe700 1 --2- 172.21.15.42:0/2617914167 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f18680a1cd0 0x7f18680a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:51.429 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.420+0000 7f18667fc700 1 -- 172.21.15.42:0/2617914167 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011744158 0 0) 0x7f186809a8f0 con 0x7f18680a20b0 2020-04-02T23:24:51.429 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.420+0000 7f18667fc700 1 -- 172.21.15.42:0/2617914167 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1854003230 con 0x7f18680a20b0 2020-04-02T23:24:51.429 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.420+0000 7f1867fff700 1 -- 172.21.15.42:0/2617914167 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f18680a1cd0 msgr2=0x7f18680a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:51.429 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.420+0000 7f1867fff700 1 --2- 172.21.15.42:0/2617914167 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f18680a1cd0 0x7f18680a6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:51.429 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.420+0000 7f1867fff700 1 -- 172.21.15.42:0/2617914167 >> v1:172.21.15.42:6789/0 conn(0x7f18680a20b0 legacy=0x7f18680a5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:51.430 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.420+0000 7f1867fff700 1 -- 172.21.15.42:0/2617914167 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186809ae30 con 0x7f18680a67a0 2020-04-02T23:24:51.430 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.420+0000 7f18677fe700 1 --2- 172.21.15.42:0/2617914167 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f18680a1cd0 0x7f18680a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:51.430 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.420+0000 7f1867fff700 1 --2- 172.21.15.42:0/2617914167 >> v2:172.21.15.84:3300/0 conn(0x7f18680a67a0 0x7f18680a5960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f18600032b0 tx=0x7f1860007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.430 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.420+0000 7f1867fff700 1 --2- 172.21.15.42:0/2617914167 >> v2:172.21.15.84:3300/0 conn(0x7f18680a67a0 0x7f18680a5960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f18600032b0 tx=0x7f1860007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.430 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.420+0000 7f1867fff700 1 --2- 172.21.15.42:0/2617914167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18680a67a0 0x7f18680a5960 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f18600032b0 tx=0x7f1860007dc0).ready entity=mon.1 client_cookie=b93889e9f8ed66d2 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:51.430 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.421+0000 7f1867fff700 1 --2- 172.21.15.42:0/2617914167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18680a67a0 0x7f18680a5960 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f18600032b0 tx=0x7f1860007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.430 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.421+0000 7f18667fc700 1 -- 172.21.15.42:0/2617914167 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1860011d70 con 0x7f18680a67a0 2020-04-02T23:24:51.431 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.421+0000 7f1867fff700 1 --2- 172.21.15.42:0/2617914167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18680a67a0 0x7f18680a5960 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f18600032b0 tx=0x7f1860007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.431 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.421+0000 7f18667fc700 1 -- 172.21.15.42:0/2617914167 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186000a160 con 0x7f18680a67a0 2020-04-02T23:24:51.431 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.421+0000 7f1867fff700 1 --2- 172.21.15.42:0/2617914167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18680a67a0 0x7f18680a5960 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f18600032b0 tx=0x7f1860007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.431 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.421+0000 7f18667fc700 1 -- 172.21.15.42:0/2617914167 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f186000a580 con 0x7f18680a67a0 2020-04-02T23:24:51.431 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.421+0000 7f186dafe700 1 -- 172.21.15.42:0/2617914167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18680a67a0 msgr2=0x7f18680a5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:51.431 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.421+0000 7f186dafe700 1 --2- 172.21.15.42:0/2617914167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18680a67a0 0x7f18680a5960 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f18600032b0 tx=0x7f1860007dc0).stop 2020-04-02T23:24:51.431 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.421+0000 7f186dafe700 1 -- 172.21.15.42:0/2617914167 shutdown_connections 2020-04-02T23:24:51.432 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.421+0000 7f186dafe700 1 --2- 172.21.15.42:0/2617914167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18680a67a0 0x7f18680a5960 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:51.432 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.421+0000 7f186dafe700 1 --2- 172.21.15.42:0/2617914167 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f18680a1cd0 0x7f18680a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:51.432 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.421+0000 7f186dafe700 1 -- 172.21.15.42:0/2617914167 >> 172.21.15.42:0/2617914167 conn(0x7f186805b720 msgr2=0x7f18680aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:51.432 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.421+0000 7f186dafe700 1 -- 172.21.15.42:0/2617914167 shutdown_connections 2020-04-02T23:24:51.432 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.421+0000 7f186dafe700 1 -- 172.21.15.42:0/2617914167 wait complete. 2020-04-02T23:24:51.432 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.422+0000 7f186dafe700 1 Processor -- start 2020-04-02T23:24:51.432 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.422+0000 7f186dafe700 1 -- start start 2020-04-02T23:24:51.433 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.423+0000 7f186dafe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f18680a1cd0 0x7f186809ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:51.433 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.423+0000 7f186dafe700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f18680a67a0 0x7f18680668e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:51.433 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.423+0000 7f186dafe700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186809f180 con 0x7f18680a20b0 2020-04-02T23:24:51.433 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.423+0000 7f186dafe700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186809ee60 con 0x7f18680a1cd0 2020-04-02T23:24:51.433 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.423+0000 7f186dafe700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186809efa0 con 0x7f18680a67a0 2020-04-02T23:24:51.433 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.423+0000 7f18677fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f18680a1cd0 0x7f186809ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:51.433 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.423+0000 7f18677fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f18680a1cd0 0x7f186809ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39896/0 (socket says 172.21.15.42:39896) 2020-04-02T23:24:51.433 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.423+0000 7f1866ffd700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f18680a20b0 0x7f1868149950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59322/0 (socket says 172.21.15.42:59322) 2020-04-02T23:24:51.434 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.423+0000 7f18677fe700 1 -- 172.21.15.42:0/742470498 learned_addr learned my addr 172.21.15.42:0/742470498 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:51.434 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.423+0000 7f1867fff700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f18680a67a0 0x7f18680668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:51.434 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.423+0000 7f18677fe700 1 -- 172.21.15.42:0/742470498 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f18680a67a0 msgr2=0x7f18680668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:51.434 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.423+0000 7f18677fe700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f18680a67a0 0x7f18680668e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:51.434 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.423+0000 7f1864ff9700 1 -- 172.21.15.42:0/742470498 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265190117 0 0) 0x7f186809f180 con 0x7f18680a20b0 2020-04-02T23:24:51.434 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.423+0000 7f18677fe700 1 -- 172.21.15.42:0/742470498 >> v1:172.21.15.42:6789/0 conn(0x7f18680a20b0 legacy=0x7f1868149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:51.434 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.423+0000 7f18677fe700 1 -- 172.21.15.42:0/742470498 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186814a060 con 0x7f18680a1cd0 2020-04-02T23:24:51.435 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.423+0000 7f1867fff700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f18680a67a0 0x7f18680668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:24:51.435 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.423+0000 7f18677fe700 1 --2- 172.21.15.42:0/742470498 >> v2:172.21.15.42:3300/0 conn(0x7f18680a1cd0 0x7f186809ea00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1858002ef0 tx=0x7f1858010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.435 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.423+0000 7f18677fe700 1 --2- 172.21.15.42:0/742470498 >> v2:172.21.15.42:3300/0 conn(0x7f18680a1cd0 0x7f186809ea00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1858002ef0 tx=0x7f1858010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.435 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.423+0000 7f18677fe700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18680a1cd0 0x7f186809ea00 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f1858002ef0 tx=0x7f1858010f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:51.435 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.423+0000 7f18677fe700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18680a1cd0 0x7f186809ea00 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f1858002ef0 tx=0x7f1858010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.435 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.424+0000 7f1864ff9700 1 -- 172.21.15.42:0/742470498 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1858007540 con 0x7f18680a1cd0 2020-04-02T23:24:51.436 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.424+0000 7f18677fe700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18680a1cd0 0x7f186809ea00 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f1858002ef0 tx=0x7f1858010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.436 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.424+0000 7f18677fe700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18680a1cd0 0x7f186809ea00 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f1858002ef0 tx=0x7f1858010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.436 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.424+0000 7f1864ff9700 1 -- 172.21.15.42:0/742470498 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1858005a10 con 0x7f18680a1cd0 2020-04-02T23:24:51.436 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.424+0000 7f1864ff9700 1 -- 172.21.15.42:0/742470498 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1858005df0 con 0x7f18680a1cd0 2020-04-02T23:24:51.436 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.424+0000 7f186dafe700 1 -- 172.21.15.42:0/742470498 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18680a07b0 con 0x7f18680a1cd0 2020-04-02T23:24:51.436 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.424+0000 7f186dafe700 1 -- 172.21.15.42:0/742470498 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186809d580 con 0x7f18680a1cd0 2020-04-02T23:24:51.437 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.424+0000 7f18677fe700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18680a1cd0 0x7f186809ea00 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f1858002ef0 tx=0x7f1858010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.437 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.425+0000 7f186dafe700 1 -- 172.21.15.42:0/742470498 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186814a2b0 con 0x7f18680a1cd0 2020-04-02T23:24:51.437 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.425+0000 7f1864ff9700 1 -- 172.21.15.42:0/742470498 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f1858010180 con 0x7f18680a1cd0 2020-04-02T23:24:51.437 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.425+0000 7f18677fe700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18680a1cd0 0x7f186809ea00 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f1858002ef0 tx=0x7f1858010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.437 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.425+0000 7f1864ff9700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f184804d5c0 0x7f184804fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:51.437 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.425+0000 7f1864ff9700 1 -- 172.21.15.42:0/742470498 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1858061180 con 0x7f18680a1cd0 2020-04-02T23:24:51.438 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.425+0000 7f1866ffd700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f184804d5c0 0x7f184804fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:51.438 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.425+0000 7f1866ffd700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f184804d5c0 0x7f184804fa80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f185c001050 tx=0x7f185c001640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.438 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.426+0000 7f1866ffd700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f184804d5c0 0x7f184804fa80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f185c001050 tx=0x7f185c001640).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.438 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.426+0000 7f1866ffd700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f184804d5c0 0x7f184804fa80 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f185c001050 tx=0x7f185c001640).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:51.438 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.428+0000 7f18677fe700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18680a1cd0 0x7f186809ea00 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f1858002ef0 tx=0x7f1858010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.439 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.428+0000 7f1864ff9700 1 -- 172.21.15.42:0/742470498 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f185803c940 con 0x7f18680a1cd0 2020-04-02T23:24:51.577 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.575+0000 7f186dafe700 1 -- 172.21.15.42:0/742470498 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f186805d2e0 con 0x7f18680a1cd0 2020-04-02T23:24:51.577 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.575+0000 7f18677fe700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18680a1cd0 0x7f186809ea00 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f1858002ef0 tx=0x7f1858010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.577 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.575+0000 7f1864ff9700 1 -- 172.21.15.42:0/742470498 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7f185803ff60 con 0x7f18680a1cd0 2020-04-02T23:24:51.578 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2020-04-02T23:24:51.579 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.576+0000 7f186dafe700 1 -- 172.21.15.42:0/742470498 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f184804d5c0 msgr2=0x7f184804fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:51.579 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.576+0000 7f186dafe700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f184804d5c0 0x7f184804fa80 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7f185c001050 tx=0x7f185c001640).stop 2020-04-02T23:24:51.579 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.576+0000 7f186dafe700 1 -- 172.21.15.42:0/742470498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18680a1cd0 msgr2=0x7f186809ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:51.579 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.576+0000 7f186dafe700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18680a1cd0 0x7f186809ea00 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f1858002ef0 tx=0x7f1858010f60).stop 2020-04-02T23:24:51.579 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.576+0000 7f186dafe700 1 -- 172.21.15.42:0/742470498 shutdown_connections 2020-04-02T23:24:51.579 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.576+0000 7f186dafe700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f184804d5c0 0x7f184804fa80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:51.580 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.576+0000 7f186dafe700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f18680a67a0 0x7f18680668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:51.580 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.576+0000 7f186dafe700 1 --2- 172.21.15.42:0/742470498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18680a1cd0 0x7f186809ea00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:51.580 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.576+0000 7f186dafe700 1 -- 172.21.15.42:0/742470498 >> 172.21.15.42:0/742470498 conn(0x7f186805b720 msgr2=0x7f18680aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:51.580 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.576+0000 7f186dafe700 1 -- 172.21.15.42:0/742470498 shutdown_connections 2020-04-02T23:24:51.580 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.576+0000 7f186dafe700 1 -- 172.21.15.42:0/742470498 wait complete. 2020-04-02T23:24:51.588 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:51.603 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-02T23:24:51.758 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.756+0000 7fc548258700 1 Processor -- start 2020-04-02T23:24:51.759 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.756+0000 7fc548258700 1 -- start start 2020-04-02T23:24:51.764 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.757+0000 7fc548258700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc5400a6d40 0x7fc5401391c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:51.764 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.757+0000 7fc548258700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc540139620 0x7fc540139a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:51.764 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.757+0000 7fc548258700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5400a31b0 con 0x7fc5400ab410 2020-04-02T23:24:51.764 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.757+0000 7fc548258700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5400a49f0 con 0x7fc540139620 2020-04-02T23:24:51.764 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.757+0000 7fc548258700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54005ff40 con 0x7fc5400a6d40 2020-04-02T23:24:51.764 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.757+0000 7fc5467f5700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc540139620 0x7fc540139a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:51.764 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.757+0000 7fc5467f5700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc540139620 0x7fc540139a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39904/0 (socket says 172.21.15.42:39904) 2020-04-02T23:24:51.765 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.757+0000 7fc5467f5700 1 -- 172.21.15.42:0/402115004 learned_addr learned my addr 172.21.15.42:0/402115004 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:51.765 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.757+0000 7fc5457f3700 1 --2- 172.21.15.42:0/402115004 >> v2:172.21.15.84:3300/0 conn(0x7fc5400a6d40 0x7fc5401391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:51.765 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.757+0000 7fc5467f5700 1 -- 172.21.15.42:0/402115004 >> v2:172.21.15.84:3300/0 conn(0x7fc5400a6d40 msgr2=0x7fc5401391c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:51.765 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.757+0000 7fc5467f5700 1 --2- 172.21.15.42:0/402115004 >> v2:172.21.15.84:3300/0 conn(0x7fc5400a6d40 0x7fc5401391c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:51.765 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.757+0000 7fc5467f5700 1 -- 172.21.15.42:0/402115004 >> v1:172.21.15.84:6789/0 conn(0x7fc5400ab410 legacy=0x7fc5400a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:51.765 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.757+0000 7fc5467f5700 1 -- 172.21.15.42:0/402115004 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5400a3420 con 0x7fc540139620 2020-04-02T23:24:51.765 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.757+0000 7fc5467f5700 1 --2- 172.21.15.42:0/402115004 >> v2:172.21.15.42:3300/0 conn(0x7fc540139620 0x7fc540139a70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc5380032b0 tx=0x7fc538007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.766 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.758+0000 7fc5467f5700 1 --2- 172.21.15.42:0/402115004 >> v2:172.21.15.42:3300/0 conn(0x7fc540139620 0x7fc540139a70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc5380032b0 tx=0x7fc538007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.766 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.758+0000 7fc5467f5700 1 --2- 172.21.15.42:0/402115004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc540139620 0x7fc540139a70 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7fc5380032b0 tx=0x7fc538007dc0).ready entity=mon.0 client_cookie=819e23b363fd3b3d server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:51.766 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.758+0000 7fc5467f5700 1 --2- 172.21.15.42:0/402115004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc540139620 0x7fc540139a70 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fc5380032b0 tx=0x7fc538007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.766 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.758+0000 7fc544ff2700 1 -- 172.21.15.42:0/402115004 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc53800a160 con 0x7fc540139620 2020-04-02T23:24:51.766 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.758+0000 7fc5467f5700 1 --2- 172.21.15.42:0/402115004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc540139620 0x7fc540139a70 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fc5380032b0 tx=0x7fc538007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.766 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.758+0000 7fc5467f5700 1 --2- 172.21.15.42:0/402115004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc540139620 0x7fc540139a70 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fc5380032b0 tx=0x7fc538007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.766 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.758+0000 7fc544ff2700 1 -- 172.21.15.42:0/402115004 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53800a2c0 con 0x7fc540139620 2020-04-02T23:24:51.767 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.758+0000 7fc544ff2700 1 -- 172.21.15.42:0/402115004 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc53800a6a0 con 0x7fc540139620 2020-04-02T23:24:51.767 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.758+0000 7fc548258700 1 -- 172.21.15.42:0/402115004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc540139620 msgr2=0x7fc540139a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:51.767 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.758+0000 7fc548258700 1 --2- 172.21.15.42:0/402115004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc540139620 0x7fc540139a70 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7fc5380032b0 tx=0x7fc538007dc0).stop 2020-04-02T23:24:51.767 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.758+0000 7fc548258700 1 -- 172.21.15.42:0/402115004 shutdown_connections 2020-04-02T23:24:51.767 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.758+0000 7fc548258700 1 --2- 172.21.15.42:0/402115004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc540139620 0x7fc540139a70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:51.767 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.758+0000 7fc548258700 1 --2- 172.21.15.42:0/402115004 >> v2:172.21.15.84:3300/0 conn(0x7fc5400a6d40 0x7fc5401391c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:51.767 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.758+0000 7fc548258700 1 -- 172.21.15.42:0/402115004 >> 172.21.15.42:0/402115004 conn(0x7fc54005b720 msgr2=0x7fc5400aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:51.768 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.758+0000 7fc548258700 1 -- 172.21.15.42:0/402115004 shutdown_connections 2020-04-02T23:24:51.768 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.758+0000 7fc548258700 1 -- 172.21.15.42:0/402115004 wait complete. 2020-04-02T23:24:51.768 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.759+0000 7fc548258700 1 Processor -- start 2020-04-02T23:24:51.768 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.759+0000 7fc548258700 1 -- start start 2020-04-02T23:24:51.768 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.760+0000 7fc548258700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc5400a6d40 0x7fc54012e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:51.768 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.760+0000 7fc548258700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc5400ab410 0x7fc54009c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:51.768 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.760+0000 7fc548258700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54012ec80 con 0x7fc540139620 2020-04-02T23:24:51.770 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.760+0000 7fc548258700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54012daa0 con 0x7fc5400ab410 2020-04-02T23:24:51.770 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.760+0000 7fc548258700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54012ef20 con 0x7fc5400a6d40 2020-04-02T23:24:51.770 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.760+0000 7fc5457f3700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc5400ab410 0x7fc54009c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:51.770 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.760+0000 7fc5457f3700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc5400ab410 0x7fc54009c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39910/0 (socket says 172.21.15.42:39910) 2020-04-02T23:24:51.771 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.760+0000 7fc5467f5700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc540139620 0x7fc54012c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59336/0 (socket says 172.21.15.42:59336) 2020-04-02T23:24:51.771 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.760+0000 7fc5457f3700 1 -- 172.21.15.42:0/4031018565 learned_addr learned my addr 172.21.15.42:0/4031018565 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:51.771 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.760+0000 7fc545ff4700 1 --2- 172.21.15.42:0/4031018565 >> v2:172.21.15.84:3300/0 conn(0x7fc5400a6d40 0x7fc54012e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:51.771 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.760+0000 7fc5457f3700 1 -- 172.21.15.42:0/4031018565 >> v2:172.21.15.84:3300/0 conn(0x7fc5400a6d40 msgr2=0x7fc54012e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:51.771 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.760+0000 7fc5457f3700 1 --2- 172.21.15.42:0/4031018565 >> v2:172.21.15.84:3300/0 conn(0x7fc5400a6d40 0x7fc54012e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:51.771 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.760+0000 7fc5457f3700 1 -- 172.21.15.42:0/4031018565 >> v1:172.21.15.42:6789/0 conn(0x7fc540139620 legacy=0x7fc54012c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:51.771 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.760+0000 7fc5457f3700 1 -- 172.21.15.42:0/4031018565 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54009bf10 con 0x7fc5400ab410 2020-04-02T23:24:51.772 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.760+0000 7fc532ffd700 1 -- 172.21.15.42:0/4031018565 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160775935 0 0) 0x7fc54012ec80 con 0x7fc540139620 2020-04-02T23:24:51.772 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.760+0000 7fc5457f3700 1 --2- 172.21.15.42:0/4031018565 >> v2:172.21.15.42:3300/0 conn(0x7fc5400ab410 0x7fc54009c3b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc534003070 tx=0x7fc534010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.772 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.760+0000 7fc5457f3700 1 --2- 172.21.15.42:0/4031018565 >> v2:172.21.15.42:3300/0 conn(0x7fc5400ab410 0x7fc54009c3b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc534003070 tx=0x7fc534010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.772 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.760+0000 7fc5457f3700 1 --2- 172.21.15.42:0/4031018565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5400ab410 0x7fc54009c3b0 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fc534003070 tx=0x7fc534010c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:51.772 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.761+0000 7fc5457f3700 1 --2- 172.21.15.42:0/4031018565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5400ab410 0x7fc54009c3b0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fc534003070 tx=0x7fc534010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.772 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.761+0000 7fc532ffd700 1 -- 172.21.15.42:0/4031018565 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc534012a80 con 0x7fc5400ab410 2020-04-02T23:24:51.772 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.761+0000 7fc5457f3700 1 --2- 172.21.15.42:0/4031018565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5400ab410 0x7fc54009c3b0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fc534003070 tx=0x7fc534010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.773 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.761+0000 7fc5457f3700 1 --2- 172.21.15.42:0/4031018565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5400ab410 0x7fc54009c3b0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fc534003070 tx=0x7fc534010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.773 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.761+0000 7fc532ffd700 1 -- 172.21.15.42:0/4031018565 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc534012be0 con 0x7fc5400ab410 2020-04-02T23:24:51.773 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.761+0000 7fc548258700 1 -- 172.21.15.42:0/4031018565 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc54009aab0 con 0x7fc5400ab410 2020-04-02T23:24:51.773 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.761+0000 7fc532ffd700 1 -- 172.21.15.42:0/4031018565 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5340091a0 con 0x7fc5400ab410 2020-04-02T23:24:51.773 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.761+0000 7fc548258700 1 -- 172.21.15.42:0/4031018565 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5400a0030 con 0x7fc5400ab410 2020-04-02T23:24:51.773 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.761+0000 7fc5457f3700 1 --2- 172.21.15.42:0/4031018565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5400ab410 0x7fc54009c3b0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fc534003070 tx=0x7fc534010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.775 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.762+0000 7fc532ffd700 1 -- 172.21.15.42:0/4031018565 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fc534007170 con 0x7fc5400ab410 2020-04-02T23:24:51.775 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.762+0000 7fc5457f3700 1 --2- 172.21.15.42:0/4031018565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5400ab410 0x7fc54009c3b0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fc534003070 tx=0x7fc534010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.775 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.762+0000 7fc548258700 1 -- 172.21.15.42:0/4031018565 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc54005d2e0 con 0x7fc5400ab410 2020-04-02T23:24:51.775 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.762+0000 7fc532ffd700 1 --2- 172.21.15.42:0/4031018565 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc52004d420 0x7fc52004f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:51.775 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.762+0000 7fc532ffd700 1 -- 172.21.15.42:0/4031018565 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc5340613c0 con 0x7fc5400ab410 2020-04-02T23:24:51.775 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.763+0000 7fc545ff4700 1 --2- 172.21.15.42:0/4031018565 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc52004d420 0x7fc52004f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:51.776 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.763+0000 7fc545ff4700 1 --2- 172.21.15.42:0/4031018565 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc52004d420 0x7fc52004f8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc54005bc20 tx=0x7fc53c003e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.776 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.763+0000 7fc545ff4700 1 --2- 172.21.15.42:0/4031018565 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc52004d420 0x7fc52004f8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc54005bc20 tx=0x7fc53c003e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.776 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.763+0000 7fc545ff4700 1 --2- 172.21.15.42:0/4031018565 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc52004d420 0x7fc52004f8e0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7fc54005bc20 tx=0x7fc53c003e20).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:51.776 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.766+0000 7fc5457f3700 1 --2- 172.21.15.42:0/4031018565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5400ab410 0x7fc54009c3b0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fc534003070 tx=0x7fc534010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.776 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.766+0000 7fc532ffd700 1 -- 172.21.15.42:0/4031018565 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fc53403caa0 con 0x7fc5400ab410 2020-04-02T23:24:51.915 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.913+0000 7fc548258700 1 -- 172.21.15.42:0/4031018565 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc540056c50 con 0x7fc5400ab410 2020-04-02T23:24:51.915 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.913+0000 7fc5457f3700 1 --2- 172.21.15.42:0/4031018565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5400ab410 0x7fc54009c3b0 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fc534003070 tx=0x7fc534010c90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:51.915 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.913+0000 7fc532ffd700 1 -- 172.21.15.42:0/4031018565 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc5340400c0 con 0x7fc5400ab410 2020-04-02T23:24:51.916 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 8 2020-04-02T23:24:51.917 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.914+0000 7fc548258700 1 -- 172.21.15.42:0/4031018565 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc52004d420 msgr2=0x7fc52004f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:51.917 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.914+0000 7fc548258700 1 --2- 172.21.15.42:0/4031018565 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc52004d420 0x7fc52004f8e0 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7fc54005bc20 tx=0x7fc53c003e20).stop 2020-04-02T23:24:51.917 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.914+0000 7fc548258700 1 -- 172.21.15.42:0/4031018565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5400ab410 msgr2=0x7fc54009c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:51.918 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.914+0000 7fc548258700 1 --2- 172.21.15.42:0/4031018565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5400ab410 0x7fc54009c3b0 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fc534003070 tx=0x7fc534010c90).stop 2020-04-02T23:24:51.918 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.914+0000 7fc548258700 1 -- 172.21.15.42:0/4031018565 shutdown_connections 2020-04-02T23:24:51.918 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.914+0000 7fc548258700 1 --2- 172.21.15.42:0/4031018565 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc52004d420 0x7fc52004f8e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:51.918 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.914+0000 7fc548258700 1 --2- 172.21.15.42:0/4031018565 >> v2:172.21.15.84:3300/0 conn(0x7fc5400a6d40 0x7fc54012e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:51.918 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.914+0000 7fc548258700 1 --2- 172.21.15.42:0/4031018565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5400ab410 0x7fc54009c3b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:51.918 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.914+0000 7fc548258700 1 -- 172.21.15.42:0/4031018565 >> 172.21.15.42:0/4031018565 conn(0x7fc54005b720 msgr2=0x7fc5400aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:51.918 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.914+0000 7fc548258700 1 -- 172.21.15.42:0/4031018565 shutdown_connections 2020-04-02T23:24:51.919 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:51.914+0000 7fc548258700 1 -- 172.21.15.42:0/4031018565 wait complete. 2020-04-02T23:24:51.927 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:51.940 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-02T23:24:52.098 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.096+0000 7f456f96b700 1 Processor -- start 2020-04-02T23:24:52.098 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.096+0000 7f456f96b700 1 -- start start 2020-04-02T23:24:52.101 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.097+0000 7f456f96b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f45680ab410 0x7f45680a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:52.101 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.097+0000 7f456f96b700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45680a6a90 0x7f45680a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:52.102 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.097+0000 7f456f96b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f45680a2130 0x7f45680a2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:52.102 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.097+0000 7f456f96b700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45680a31b0 con 0x7f45680a2130 2020-04-02T23:24:52.102 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.097+0000 7f456f96b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45680a49f0 con 0x7f45680ab410 2020-04-02T23:24:52.102 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.097+0000 7f456f96b700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456805ff40 con 0x7f45680a6a90 2020-04-02T23:24:52.102 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.097+0000 7f456df08700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f45680a2130 0x7f45680a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:52.102 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.097+0000 7f456df08700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f45680a2130 0x7f45680a2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39920/0 (socket says 172.21.15.42:39920) 2020-04-02T23:24:52.102 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.097+0000 7f456df08700 1 -- 172.21.15.42:0/516132078 learned_addr learned my addr 172.21.15.42:0/516132078 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:52.103 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.097+0000 7f456d707700 1 --2- 172.21.15.42:0/516132078 >> v2:172.21.15.84:3300/0 conn(0x7f45680ab410 0x7f45680a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:52.103 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.097+0000 7f456cf06700 1 --2- 172.21.15.42:0/516132078 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45680a6a90 0x7f45680a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:52.103 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.097+0000 7f456df08700 1 -- 172.21.15.42:0/516132078 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45680a6a90 msgr2=0x7f45680a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:52.103 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.097+0000 7f456df08700 1 --2- 172.21.15.42:0/516132078 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45680a6a90 0x7f45680a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:52.103 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.097+0000 7f456df08700 1 -- 172.21.15.42:0/516132078 >> v2:172.21.15.84:3300/0 conn(0x7f45680ab410 msgr2=0x7f45680a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:52.103 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.097+0000 7f456df08700 1 --2- 172.21.15.42:0/516132078 >> v2:172.21.15.84:3300/0 conn(0x7f45680ab410 0x7f45680a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:52.104 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.097+0000 7f456df08700 1 -- 172.21.15.42:0/516132078 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45680a3420 con 0x7f45680a2130 2020-04-02T23:24:52.104 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.097+0000 7f456d707700 1 --2- 172.21.15.42:0/516132078 >> v2:172.21.15.84:3300/0 conn(0x7f45680ab410 0x7f45680a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:24:52.104 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.097+0000 7f456df08700 1 --2- 172.21.15.42:0/516132078 >> v2:172.21.15.42:3300/0 conn(0x7f45680a2130 0x7f45680a2580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f45600032b0 tx=0x7f4560007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.104 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.097+0000 7f456df08700 1 --2- 172.21.15.42:0/516132078 >> v2:172.21.15.42:3300/0 conn(0x7f45680a2130 0x7f45680a2580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f45600032b0 tx=0x7f4560007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.104 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.097+0000 7f456df08700 1 --2- 172.21.15.42:0/516132078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45680a2130 0x7f45680a2580 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f45600032b0 tx=0x7f4560007dc0).ready entity=mon.0 client_cookie=ca71e3e54c8d6f57 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:52.104 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.098+0000 7f456df08700 1 --2- 172.21.15.42:0/516132078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45680a2130 0x7f45680a2580 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f45600032b0 tx=0x7f4560007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.105 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.098+0000 7f456df08700 1 --2- 172.21.15.42:0/516132078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45680a2130 0x7f45680a2580 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f45600032b0 tx=0x7f4560007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.105 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.098+0000 7f455bfff700 1 -- 172.21.15.42:0/516132078 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f456000a160 con 0x7f45680a2130 2020-04-02T23:24:52.105 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.098+0000 7f456df08700 1 --2- 172.21.15.42:0/516132078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45680a2130 0x7f45680a2580 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f45600032b0 tx=0x7f4560007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.105 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.098+0000 7f455bfff700 1 -- 172.21.15.42:0/516132078 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456000a2c0 con 0x7f45680a2130 2020-04-02T23:24:52.105 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.098+0000 7f455bfff700 1 -- 172.21.15.42:0/516132078 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f456000a6a0 con 0x7f45680a2130 2020-04-02T23:24:52.105 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.098+0000 7f456f96b700 1 -- 172.21.15.42:0/516132078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45680a2130 msgr2=0x7f45680a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.106 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.098+0000 7f456f96b700 1 --2- 172.21.15.42:0/516132078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45680a2130 0x7f45680a2580 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f45600032b0 tx=0x7f4560007dc0).stop 2020-04-02T23:24:52.106 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.098+0000 7f456f96b700 1 -- 172.21.15.42:0/516132078 shutdown_connections 2020-04-02T23:24:52.106 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.098+0000 7f456f96b700 1 --2- 172.21.15.42:0/516132078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45680a2130 0x7f45680a2580 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:52.106 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.098+0000 7f456f96b700 1 --2- 172.21.15.42:0/516132078 >> v2:172.21.15.84:3300/0 conn(0x7f45680ab410 0x7f45680a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:52.106 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.098+0000 7f456f96b700 1 --2- 172.21.15.42:0/516132078 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45680a6a90 0x7f45680a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:52.106 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.098+0000 7f456f96b700 1 -- 172.21.15.42:0/516132078 >> 172.21.15.42:0/516132078 conn(0x7f456805b720 msgr2=0x7f45680aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:52.106 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.098+0000 7f456f96b700 1 -- 172.21.15.42:0/516132078 shutdown_connections 2020-04-02T23:24:52.107 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.098+0000 7f456f96b700 1 -- 172.21.15.42:0/516132078 wait complete. 2020-04-02T23:24:52.107 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.099+0000 7f456f96b700 1 Processor -- start 2020-04-02T23:24:52.107 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.099+0000 7f456f96b700 1 -- start start 2020-04-02T23:24:52.111 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.100+0000 7f456f96b700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45680ab410 0x7f4568137600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:52.111 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.100+0000 7f456f96b700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4568063de0 con 0x7f45680a6a90 2020-04-02T23:24:52.111 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.100+0000 7f456f96b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f456809dc80 con 0x7f45680a2130 2020-04-02T23:24:52.111 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.100+0000 7f456f96b700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456809df20 con 0x7f45680ab410 2020-04-02T23:24:52.111 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.100+0000 7f456cf06700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f45680a6a90 0x7f4568061890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59348/0 (socket says 172.21.15.42:59348) 2020-04-02T23:24:52.112 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.100+0000 7f456cf06700 1 -- 172.21.15.42:0/1760562889 learned_addr learned my addr 172.21.15.42:0/1760562889 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:52.112 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.100+0000 7f456df08700 1 --2- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45680ab410 0x7f4568137600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:52.112 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.100+0000 7f455a7fc700 1 -- 172.21.15.42:0/1760562889 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923335394 0 0) 0x7f4568063de0 con 0x7f45680a6a90 2020-04-02T23:24:52.112 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.100+0000 7f455a7fc700 1 -- 172.21.15.42:0/1760562889 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4548002fe0 con 0x7f45680a6a90 2020-04-02T23:24:52.112 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.100+0000 7f455a7fc700 1 -- 172.21.15.42:0/1760562889 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604281447 0 0) 0x7f456809dc80 con 0x7f45680a2130 2020-04-02T23:24:52.112 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.100+0000 7f455a7fc700 1 -- 172.21.15.42:0/1760562889 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4568063de0 con 0x7f45680a2130 2020-04-02T23:24:52.112 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.100+0000 7f455a7fc700 1 -- 172.21.15.42:0/1760562889 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3594661185 0 0) 0x7f4548002fe0 con 0x7f45680a6a90 2020-04-02T23:24:52.113 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.100+0000 7f455a7fc700 1 -- 172.21.15.42:0/1760562889 --> v1:172.21.15.42:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f456809dc80 con 0x7f45680a6a90 2020-04-02T23:24:52.113 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.100+0000 7f455a7fc700 1 -- 172.21.15.42:0/1760562889 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7f455c0025c0 con 0x7f45680a6a90 2020-04-02T23:24:52.113 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.100+0000 7f456df08700 1 -- 172.21.15.42:0/1760562889 >> v1:172.21.15.84:6789/0 conn(0x7f45680a2130 legacy=0x7f45680636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.113 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.100+0000 7f456df08700 1 -- 172.21.15.42:0/1760562889 >> v1:172.21.15.42:6789/0 conn(0x7f45680a6a90 legacy=0x7f4568061890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.113 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.100+0000 7f456df08700 1 -- 172.21.15.42:0/1760562889 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456809cf00 con 0x7f45680ab410 2020-04-02T23:24:52.113 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.101+0000 7f456df08700 1 --2- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45680ab410 0x7f4568137600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f45600032b0 tx=0x7f4560007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.113 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.101+0000 7f456df08700 1 --2- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45680ab410 0x7f4568137600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f45600032b0 tx=0x7f4560007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.114 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.101+0000 7f456df08700 1 --2- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45680ab410 0x7f4568137600 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f45600032b0 tx=0x7f4560007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:52.114 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.101+0000 7f456df08700 1 --2- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45680ab410 0x7f4568137600 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f45600032b0 tx=0x7f4560007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.114 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.101+0000 7f455a7fc700 1 -- 172.21.15.42:0/1760562889 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4560008a90 con 0x7f45680ab410 2020-04-02T23:24:52.114 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.101+0000 7f456df08700 1 --2- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45680ab410 0x7f4568137600 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f45600032b0 tx=0x7f4560007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.114 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.101+0000 7f456df08700 1 --2- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45680ab410 0x7f4568137600 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f45600032b0 tx=0x7f4560007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.114 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.101+0000 7f455a7fc700 1 -- 172.21.15.42:0/1760562889 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4560005c30 con 0x7f45680ab410 2020-04-02T23:24:52.114 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.101+0000 7f456f96b700 1 -- 172.21.15.42:0/1760562889 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45680a0130 con 0x7f45680ab410 2020-04-02T23:24:52.115 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.101+0000 7f455a7fc700 1 -- 172.21.15.42:0/1760562889 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4560007150 con 0x7f45680ab410 2020-04-02T23:24:52.115 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.101+0000 7f456f96b700 1 -- 172.21.15.42:0/1760562889 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45680621e0 con 0x7f45680ab410 2020-04-02T23:24:52.115 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.102+0000 7f456df08700 1 --2- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45680ab410 0x7f4568137600 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f45600032b0 tx=0x7f4560007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.115 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.102+0000 7f456f96b700 1 -- 172.21.15.42:0/1760562889 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456809dae0 con 0x7f45680ab410 2020-04-02T23:24:52.115 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.102+0000 7f455a7fc700 1 -- 172.21.15.42:0/1760562889 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f4560007350 con 0x7f45680ab410 2020-04-02T23:24:52.115 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.102+0000 7f456df08700 1 --2- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45680ab410 0x7f4568137600 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f45600032b0 tx=0x7f4560007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.115 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.102+0000 7f455a7fc700 1 --2- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f454804dc80 0x7f4548050140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:52.116 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.102+0000 7f455a7fc700 1 -- 172.21.15.42:0/1760562889 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f45600614b0 con 0x7f45680ab410 2020-04-02T23:24:52.117 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.102+0000 7f456d707700 1 --2- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f454804dc80 0x7f4548050140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:52.117 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.103+0000 7f456d707700 1 --2- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f454804dc80 0x7f4548050140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4564007720 tx=0x7f4564008d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.117 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.103+0000 7f456d707700 1 --2- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f454804dc80 0x7f4548050140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4564007720 tx=0x7f4564008d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.117 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.103+0000 7f456d707700 1 --2- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f454804dc80 0x7f4548050140 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f4564007720 tx=0x7f4564008d70).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:52.117 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.106+0000 7f456df08700 1 --2- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45680ab410 0x7f4568137600 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f45600032b0 tx=0x7f4560007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.118 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.106+0000 7f455a7fc700 1 -- 172.21.15.42:0/1760562889 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f456809dae0 con 0x7f45680ab410 2020-04-02T23:24:52.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.258+0000 7f456f96b700 1 -- 172.21.15.42:0/1760562889 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f456809dae0 con 0x7f45680ab410 2020-04-02T23:24:52.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.258+0000 7f456df08700 1 --2- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45680ab410 0x7f4568137600 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f45600032b0 tx=0x7f4560007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.258+0000 7f455a7fc700 1 -- 172.21.15.42:0/1760562889 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+10 (secure 0 0 0) 0x7f456809dae0 con 0x7f45680ab410 2020-04-02T23:24:52.261 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 8 2020-04-02T23:24:52.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.260+0000 7f456f96b700 1 -- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f454804dc80 msgr2=0x7f4548050140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.260+0000 7f456f96b700 1 --2- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f454804dc80 0x7f4548050140 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f4564007720 tx=0x7f4564008d70).stop 2020-04-02T23:24:52.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.260+0000 7f456f96b700 1 -- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45680ab410 msgr2=0x7f4568137600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.260+0000 7f456f96b700 1 --2- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45680ab410 0x7f4568137600 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f45600032b0 tx=0x7f4560007dc0).stop 2020-04-02T23:24:52.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.260+0000 7f456f96b700 1 -- 172.21.15.42:0/1760562889 shutdown_connections 2020-04-02T23:24:52.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.260+0000 7f456f96b700 1 --2- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f454804dc80 0x7f4548050140 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:52.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.260+0000 7f456f96b700 1 --2- 172.21.15.42:0/1760562889 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f45680ab410 0x7f4568137600 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:52.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.260+0000 7f456f96b700 1 -- 172.21.15.42:0/1760562889 >> 172.21.15.42:0/1760562889 conn(0x7f456805b720 msgr2=0x7f4568069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:52.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.260+0000 7f456f96b700 1 -- 172.21.15.42:0/1760562889 shutdown_connections 2020-04-02T23:24:52.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.260+0000 7f456f96b700 1 -- 172.21.15.42:0/1760562889 wait complete. 2020-04-02T23:24:52.272 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:52.286 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-02T23:24:52.442 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.440+0000 7f5c17967700 1 Processor -- start 2020-04-02T23:24:52.442 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.440+0000 7f5c17967700 1 -- start start 2020-04-02T23:24:52.449 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c17967700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5c100ab410 0x7f5c100a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:52.449 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c17967700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5c100a6a90 0x7f5c100a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:52.449 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c17967700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c100a31b0 con 0x7f5c100a2130 2020-04-02T23:24:52.450 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c17967700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c100a49f0 con 0x7f5c100ab410 2020-04-02T23:24:52.450 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c17967700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1005ff40 con 0x7f5c100a6a90 2020-04-02T23:24:52.450 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c15703700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5c100ab410 0x7f5c100a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:52.450 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c15f04700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f5c100a2130 0x7f5c100a2580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59356/0 (socket says 172.21.15.42:59356) 2020-04-02T23:24:52.450 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c15f04700 1 -- 172.21.15.42:0/2343008315 learned_addr learned my addr 172.21.15.42:0/2343008315 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:52.451 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c14f02700 1 --2- 172.21.15.42:0/2343008315 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5c100a6a90 0x7f5c100a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:52.451 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c15703700 1 -- 172.21.15.42:0/2343008315 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5c100a6a90 msgr2=0x7f5c100a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:52.451 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c15703700 1 --2- 172.21.15.42:0/2343008315 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5c100a6a90 0x7f5c100a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:52.451 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c15703700 1 -- 172.21.15.42:0/2343008315 >> v1:172.21.15.42:6789/0 conn(0x7f5c100a2130 legacy=0x7f5c100a2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.451 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c15703700 1 -- 172.21.15.42:0/2343008315 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c100a3420 con 0x7f5c100ab410 2020-04-02T23:24:52.451 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c03fff700 1 -- 172.21.15.42:0/2343008315 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974550067 0 0) 0x7f5c100a31b0 con 0x7f5c100a2130 2020-04-02T23:24:52.451 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c14f02700 1 --2- 172.21.15.42:0/2343008315 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5c100a6a90 0x7f5c100a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:24:52.451 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c15703700 1 --2- 172.21.15.42:0/2343008315 >> v2:172.21.15.42:3300/0 conn(0x7f5c100ab410 0x7f5c100a6630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5c0c002f30 tx=0x7f5c0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.452 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c15703700 1 --2- 172.21.15.42:0/2343008315 >> v2:172.21.15.42:3300/0 conn(0x7f5c100ab410 0x7f5c100a6630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5c0c002f30 tx=0x7f5c0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.452 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c15703700 1 --2- 172.21.15.42:0/2343008315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c100ab410 0x7f5c100a6630 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f5c0c002f30 tx=0x7f5c0c007a40).ready entity=mon.0 client_cookie=55f3553e5cf6fe54 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:52.452 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c15703700 1 --2- 172.21.15.42:0/2343008315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c100ab410 0x7f5c100a6630 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f5c0c002f30 tx=0x7f5c0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.452 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c03fff700 1 -- 172.21.15.42:0/2343008315 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c0c011470 con 0x7f5c100ab410 2020-04-02T23:24:52.452 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c15703700 1 --2- 172.21.15.42:0/2343008315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c100ab410 0x7f5c100a6630 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f5c0c002f30 tx=0x7f5c0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.452 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c15703700 1 --2- 172.21.15.42:0/2343008315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c100ab410 0x7f5c100a6630 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f5c0c002f30 tx=0x7f5c0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.452 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.441+0000 7f5c03fff700 1 -- 172.21.15.42:0/2343008315 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0c0115d0 con 0x7f5c100ab410 2020-04-02T23:24:52.453 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.442+0000 7f5c03fff700 1 -- 172.21.15.42:0/2343008315 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c0c0119b0 con 0x7f5c100ab410 2020-04-02T23:24:52.453 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.442+0000 7f5c17967700 1 -- 172.21.15.42:0/2343008315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c100ab410 msgr2=0x7f5c100a6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.453 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.442+0000 7f5c17967700 1 --2- 172.21.15.42:0/2343008315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c100ab410 0x7f5c100a6630 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f5c0c002f30 tx=0x7f5c0c007a40).stop 2020-04-02T23:24:52.453 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.442+0000 7f5c17967700 1 -- 172.21.15.42:0/2343008315 shutdown_connections 2020-04-02T23:24:52.453 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.442+0000 7f5c17967700 1 --2- 172.21.15.42:0/2343008315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5c100ab410 0x7f5c100a6630 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:52.453 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.442+0000 7f5c17967700 1 --2- 172.21.15.42:0/2343008315 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5c100a6a90 0x7f5c100a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:52.453 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.442+0000 7f5c17967700 1 -- 172.21.15.42:0/2343008315 >> 172.21.15.42:0/2343008315 conn(0x7f5c1005b720 msgr2=0x7f5c100aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:52.454 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.442+0000 7f5c17967700 1 -- 172.21.15.42:0/2343008315 shutdown_connections 2020-04-02T23:24:52.454 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.442+0000 7f5c17967700 1 -- 172.21.15.42:0/2343008315 wait complete. 2020-04-02T23:24:52.454 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.443+0000 7f5c17967700 1 Processor -- start 2020-04-02T23:24:52.454 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.443+0000 7f5c17967700 1 -- start start 2020-04-02T23:24:52.454 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c17967700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5c100a6a90 0x7f5c10147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:52.454 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c17967700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c1009aab0 con 0x7f5c100a2130 2020-04-02T23:24:52.454 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c17967700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c1013ffe0 con 0x7f5c100ab410 2020-04-02T23:24:52.454 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c17967700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1013c350 con 0x7f5c100a6a90 2020-04-02T23:24:52.455 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c15703700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f5c100a2130 0x7f5c1009dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59358/0 (socket says 172.21.15.42:59358) 2020-04-02T23:24:52.455 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c15703700 1 -- 172.21.15.42:0/3161052230 learned_addr learned my addr 172.21.15.42:0/3161052230 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:52.455 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c14f02700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5c100a6a90 0x7f5c10147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:52.455 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c027fc700 1 -- 172.21.15.42:0/3161052230 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206347450 0 0) 0x7f5c1009aab0 con 0x7f5c100a2130 2020-04-02T23:24:52.455 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c027fc700 1 -- 172.21.15.42:0/3161052230 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bf0002fe0 con 0x7f5c100a2130 2020-04-02T23:24:52.455 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c027fc700 1 -- 172.21.15.42:0/3161052230 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1428189617 0 0) 0x7f5bf0002fe0 con 0x7f5c100a2130 2020-04-02T23:24:52.455 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c027fc700 1 -- 172.21.15.42:0/3161052230 --> v1:172.21.15.42:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5c1009aab0 con 0x7f5c100a2130 2020-04-02T23:24:52.456 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c027fc700 1 -- 172.21.15.42:0/3161052230 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7f5c0c008e10 con 0x7f5c100a2130 2020-04-02T23:24:52.456 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c027fc700 1 -- 172.21.15.42:0/3161052230 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5c100a6a90 msgr2=0x7f5c10147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.456 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c027fc700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5c100a6a90 0x7f5c10147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:52.456 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c027fc700 1 -- 172.21.15.42:0/3161052230 >> v1:172.21.15.84:6789/0 conn(0x7f5c100ab410 legacy=0x7f5c10147ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.456 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c027fc700 1 -- 172.21.15.42:0/3161052230 >> v1:172.21.15.42:6789/0 conn(0x7f5c100a2130 legacy=0x7f5c1009dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.456 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c027fc700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bf00049b0 0x7f5bf0004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:52.456 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c027fc700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf0005210 0x7f5bf0003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:52.456 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c027fc700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5c100a6a90 0x7f5bf0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:52.457 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c027fc700 1 -- 172.21.15.42:0/3161052230 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1013c350 con 0x7f5bf00049b0 2020-04-02T23:24:52.457 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c027fc700 1 -- 172.21.15.42:0/3161052230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf00042f0 con 0x7f5bf0005210 2020-04-02T23:24:52.457 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c027fc700 1 -- 172.21.15.42:0/3161052230 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf00044b0 con 0x7f5c100a6a90 2020-04-02T23:24:52.457 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c15703700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bf00049b0 0x7f5bf0004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:52.457 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c14f02700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf0005210 0x7f5bf0003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:52.458 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.444+0000 7f5c15f04700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5c100a6a90 0x7f5bf0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:52.458 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.445+0000 7f5c15703700 1 -- 172.21.15.42:0/3161052230 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5c100a6a90 msgr2=0x7f5bf0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.458 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.445+0000 7f5c15703700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f5c100a6a90 0x7f5bf0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:52.458 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.445+0000 7f5c15703700 1 -- 172.21.15.42:0/3161052230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf0005210 msgr2=0x7f5bf0003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.458 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.445+0000 7f5c15703700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf0005210 0x7f5bf0003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:52.458 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.445+0000 7f5c15703700 1 -- 172.21.15.42:0/3161052230 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1009bec0 con 0x7f5bf00049b0 2020-04-02T23:24:52.459 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.445+0000 7f5c17967700 1 -- 172.21.15.42:0/3161052230 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c1009ca10 con 0x7f5bf00049b0 2020-04-02T23:24:52.459 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.445+0000 7f5c15703700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bf00049b0 0x7f5bf0004d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5c0c010200 tx=0x7f5c0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.459 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.445+0000 7f5c15703700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bf00049b0 0x7f5bf0004d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5c0c010200 tx=0x7f5c0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.459 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.445+0000 7f5c15703700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bf00049b0 0x7f5bf0004d90 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f5c0c010200 tx=0x7f5c0c007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:52.459 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.445+0000 7f5c15703700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bf00049b0 0x7f5bf0004d90 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f5c0c010200 tx=0x7f5c0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.459 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.445+0000 7f5c027fc700 1 -- 172.21.15.42:0/3161052230 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c0c007340 con 0x7f5bf00049b0 2020-04-02T23:24:52.459 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.445+0000 7f5c15703700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bf00049b0 0x7f5bf0004d90 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f5c0c010200 tx=0x7f5c0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.460 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.445+0000 7f5c15703700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bf00049b0 0x7f5bf0004d90 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f5c0c010200 tx=0x7f5c0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.460 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.445+0000 7f5c027fc700 1 -- 172.21.15.42:0/3161052230 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0c0074e0 con 0x7f5bf00049b0 2020-04-02T23:24:52.460 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.445+0000 7f5c17967700 1 -- 172.21.15.42:0/3161052230 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1013a6e0 con 0x7f5bf00049b0 2020-04-02T23:24:52.460 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.445+0000 7f5c027fc700 1 -- 172.21.15.42:0/3161052230 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c0c00aa50 con 0x7f5bf00049b0 2020-04-02T23:24:52.460 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.445+0000 7f5c15703700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bf00049b0 0x7f5bf0004d90 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f5c0c010200 tx=0x7f5c0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.460 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.446+0000 7f5c17967700 1 -- 172.21.15.42:0/3161052230 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1009db30 con 0x7f5bf00049b0 2020-04-02T23:24:52.460 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.446+0000 7f5c027fc700 1 -- 172.21.15.42:0/3161052230 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f5c0c00abb0 con 0x7f5bf00049b0 2020-04-02T23:24:52.461 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.446+0000 7f5c15703700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bf00049b0 0x7f5bf0004d90 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f5c0c010200 tx=0x7f5c0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.461 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.446+0000 7f5c027fc700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f5bf0055650 0x7f5bf0057b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:52.461 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.446+0000 7f5c027fc700 1 -- 172.21.15.42:0/3161052230 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f5c0c061e40 con 0x7f5bf00049b0 2020-04-02T23:24:52.461 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.446+0000 7f5c14f02700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f5bf0055650 0x7f5bf0057b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:52.461 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.447+0000 7f5c14f02700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f5bf0055650 0x7f5bf0057b10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5c04002f30 tx=0x7f5c0400eb50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.461 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.447+0000 7f5c14f02700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f5bf0055650 0x7f5bf0057b10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5c04002f30 tx=0x7f5c0400eb50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.461 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.447+0000 7f5c14f02700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f5bf0055650 0x7f5bf0057b10 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f5c04002f30 tx=0x7f5c0400eb50).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:52.462 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.449+0000 7f5c15703700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bf00049b0 0x7f5bf0004d90 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f5c0c010200 tx=0x7f5c0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.462 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.449+0000 7f5c027fc700 1 -- 172.21.15.42:0/3161052230 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f5c0c03d640 con 0x7f5bf00049b0 2020-04-02T23:24:52.598 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.595+0000 7f5c17967700 1 -- 172.21.15.42:0/3161052230 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c1013c190 con 0x7f5bf00049b0 2020-04-02T23:24:52.598 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.596+0000 7f5c15703700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bf00049b0 0x7f5bf0004d90 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7f5c0c010200 tx=0x7f5c0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.598 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.596+0000 7f5c027fc700 1 -- 172.21.15.42:0/3161052230 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5c0c040c60 con 0x7f5bf00049b0 2020-04-02T23:24:52.598 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 8 2020-04-02T23:24:52.599 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.597+0000 7f5c17967700 1 -- 172.21.15.42:0/3161052230 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f5bf0055650 msgr2=0x7f5bf0057b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.599 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.597+0000 7f5c17967700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f5bf0055650 0x7f5bf0057b10 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7f5c04002f30 tx=0x7f5c0400eb50).stop 2020-04-02T23:24:52.600 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.597+0000 7f5c17967700 1 -- 172.21.15.42:0/3161052230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bf00049b0 msgr2=0x7f5bf0004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.600 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.597+0000 7f5c17967700 1 --2- 172.21.15.42:0/3161052230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bf00049b0 0x7f5bf0004d90 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7f5c0c010200 tx=0x7f5c0c007a40).stop 2020-04-02T23:24:52.600 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.597+0000 7f5c15f04700 1 -- 172.21.15.42:0/3161052230 reap_dead start 2020-04-02T23:24:52.600 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.597+0000 7f5c15f04700 1 -- 172.21.15.42:0/3161052230 reap_dead start 2020-04-02T23:24:52.600 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.597+0000 7f5c17967700 1 -- 172.21.15.42:0/3161052230 shutdown_connections 2020-04-02T23:24:52.600 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.597+0000 7f5c17967700 1 -- 172.21.15.42:0/3161052230 >> 172.21.15.42:0/3161052230 conn(0x7f5c1005b720 msgr2=0x7f5c100a5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:52.600 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.597+0000 7f5c17967700 1 -- 172.21.15.42:0/3161052230 shutdown_connections 2020-04-02T23:24:52.601 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.597+0000 7f5c17967700 1 -- 172.21.15.42:0/3161052230 wait complete. 2020-04-02T23:24:52.609 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-04-02T23:24:52.609 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-04-02T23:24:52.609 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:52.623 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-04-02T23:24:52.776 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.774+0000 7fca84724700 1 Processor -- start 2020-04-02T23:24:52.777 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.774+0000 7fca84724700 1 -- start start 2020-04-02T23:24:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.775+0000 7fca84724700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca7c0ab410 0x7fca7c0a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.775+0000 7fca84724700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7c0a45f0 con 0x7fca7c13a1d0 2020-04-02T23:24:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.775+0000 7fca84724700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7c09f460 con 0x7fca7c067380 2020-04-02T23:24:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.775+0000 7fca84724700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c05ff40 con 0x7fca7c0ab410 2020-04-02T23:24:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.775+0000 7fca82cc1700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fca7c13a1d0 0x7fca7c13a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59372/0 (socket says 172.21.15.42:59372) 2020-04-02T23:24:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.775+0000 7fca82cc1700 1 -- 172.21.15.42:0/18588063 learned_addr learned my addr 172.21.15.42:0/18588063 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.775+0000 7fca824c0700 1 --2- 172.21.15.42:0/18588063 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca7c0ab410 0x7fca7c0a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:52.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.776+0000 7fca814be700 1 -- 172.21.15.42:0/18588063 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958215508 0 0) 0x7fca7c0a45f0 con 0x7fca7c13a1d0 2020-04-02T23:24:52.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.776+0000 7fca814be700 1 -- 172.21.15.42:0/18588063 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca64003230 con 0x7fca7c13a1d0 2020-04-02T23:24:52.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.776+0000 7fca814be700 1 -- 172.21.15.42:0/18588063 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679784527 0 0) 0x7fca7c09f460 con 0x7fca7c067380 2020-04-02T23:24:52.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.776+0000 7fca814be700 1 -- 172.21.15.42:0/18588063 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca7c0a45f0 con 0x7fca7c067380 2020-04-02T23:24:52.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.776+0000 7fca824c0700 1 -- 172.21.15.42:0/18588063 >> v1:172.21.15.84:6789/0 conn(0x7fca7c067380 legacy=0x7fca7c0a6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.776+0000 7fca824c0700 1 -- 172.21.15.42:0/18588063 >> v1:172.21.15.42:6789/0 conn(0x7fca7c13a1d0 legacy=0x7fca7c13a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.776+0000 7fca824c0700 1 -- 172.21.15.42:0/18588063 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c0a4850 con 0x7fca7c0ab410 2020-04-02T23:24:52.785 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.776+0000 7fca824c0700 1 --2- 172.21.15.42:0/18588063 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca7c0ab410 0x7fca7c0a6630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fca70002f30 tx=0x7fca700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.785 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.776+0000 7fca824c0700 1 --2- 172.21.15.42:0/18588063 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca7c0ab410 0x7fca7c0a6630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fca70002f30 tx=0x7fca700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.785 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.776+0000 7fca824c0700 1 --2- 172.21.15.42:0/18588063 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca7c0ab410 0x7fca7c0a6630 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7fca70002f30 tx=0x7fca700088e0).ready entity=mon.2 client_cookie=57cf45d072a812a server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:52.785 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.776+0000 7fca824c0700 1 --2- 172.21.15.42:0/18588063 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca7c0ab410 0x7fca7c0a6630 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fca70002f30 tx=0x7fca700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.785 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.776+0000 7fca814be700 1 -- 172.21.15.42:0/18588063 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca70008e40 con 0x7fca7c0ab410 2020-04-02T23:24:52.785 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.776+0000 7fca824c0700 1 --2- 172.21.15.42:0/18588063 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca7c0ab410 0x7fca7c0a6630 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fca70002f30 tx=0x7fca700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.785 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.776+0000 7fca824c0700 1 --2- 172.21.15.42:0/18588063 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca7c0ab410 0x7fca7c0a6630 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7fca70002f30 tx=0x7fca700088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.776+0000 7fca814be700 1 -- 172.21.15.42:0/18588063 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca70011540 con 0x7fca7c0ab410 2020-04-02T23:24:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.776+0000 7fca814be700 1 -- 172.21.15.42:0/18588063 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca70011920 con 0x7fca7c0ab410 2020-04-02T23:24:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.776+0000 7fca84724700 1 -- 172.21.15.42:0/18588063 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca7c0ab410 msgr2=0x7fca7c0a6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.776+0000 7fca84724700 1 --2- 172.21.15.42:0/18588063 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca7c0ab410 0x7fca7c0a6630 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7fca70002f30 tx=0x7fca700088e0).stop 2020-04-02T23:24:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.777+0000 7fca84724700 1 -- 172.21.15.42:0/18588063 shutdown_connections 2020-04-02T23:24:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.777+0000 7fca84724700 1 --2- 172.21.15.42:0/18588063 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca7c0ab410 0x7fca7c0a6630 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.777+0000 7fca84724700 1 -- 172.21.15.42:0/18588063 >> 172.21.15.42:0/18588063 conn(0x7fca7c05b720 msgr2=0x7fca7c0aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.777+0000 7fca84724700 1 -- 172.21.15.42:0/18588063 shutdown_connections 2020-04-02T23:24:52.787 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.777+0000 7fca84724700 1 -- 172.21.15.42:0/18588063 wait complete. 2020-04-02T23:24:52.787 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.777+0000 7fca84724700 1 Processor -- start 2020-04-02T23:24:52.787 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.778+0000 7fca84724700 1 -- start start 2020-04-02T23:24:52.787 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.778+0000 7fca84724700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fca7c0ab410 0x7fca7c066100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:52.787 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.778+0000 7fca84724700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca7c13a1d0 0x7fca7c1397e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:52.787 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.778+0000 7fca84724700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7c0641a0 con 0x7fca7c067380 2020-04-02T23:24:52.787 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.778+0000 7fca84724700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca7c064440 con 0x7fca7c0ab410 2020-04-02T23:24:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.778+0000 7fca84724700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c0646e0 con 0x7fca7c13a1d0 2020-04-02T23:24:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.778+0000 7fca81cbf700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fca7c0ab410 0x7fca7c066100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.778+0000 7fca81cbf700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fca7c0ab410 0x7fca7c066100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39956/0 (socket says 172.21.15.42:39956) 2020-04-02T23:24:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.778+0000 7fca81cbf700 1 -- 172.21.15.42:0/2812166714 learned_addr learned my addr 172.21.15.42:0/2812166714 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.778+0000 7fca82cc1700 1 --2- 172.21.15.42:0/2812166714 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca7c13a1d0 0x7fca7c1397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.778+0000 7fca81cbf700 1 -- 172.21.15.42:0/2812166714 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca7c13a1d0 msgr2=0x7fca7c1397e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.779+0000 7fca81cbf700 1 --2- 172.21.15.42:0/2812166714 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca7c13a1d0 0x7fca7c1397e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:52.789 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.778+0000 7fca6f7fe700 1 -- 172.21.15.42:0/2812166714 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236868005 0 0) 0x7fca7c0641a0 con 0x7fca7c067380 2020-04-02T23:24:52.789 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.779+0000 7fca81cbf700 1 -- 172.21.15.42:0/2812166714 >> v1:172.21.15.84:6789/0 conn(0x7fca7c067380 legacy=0x7fca7c0667e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.789 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.779+0000 7fca81cbf700 1 -- 172.21.15.42:0/2812166714 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c066ef0 con 0x7fca7c0ab410 2020-04-02T23:24:52.789 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.779+0000 7fca81cbf700 1 --2- 172.21.15.42:0/2812166714 >> v2:172.21.15.42:3300/0 conn(0x7fca7c0ab410 0x7fca7c066100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca78001190 tx=0x7fca78002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.789 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.779+0000 7fca81cbf700 1 --2- 172.21.15.42:0/2812166714 >> v2:172.21.15.42:3300/0 conn(0x7fca7c0ab410 0x7fca7c066100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca78001190 tx=0x7fca78002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.789 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.779+0000 7fca81cbf700 1 --2- 172.21.15.42:0/2812166714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca7c0ab410 0x7fca7c066100 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7fca78001190 tx=0x7fca78002490).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:52.789 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.779+0000 7fca81cbf700 1 --2- 172.21.15.42:0/2812166714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca7c0ab410 0x7fca7c066100 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fca78001190 tx=0x7fca78002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.790 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.779+0000 7fca6f7fe700 1 -- 172.21.15.42:0/2812166714 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca780035d0 con 0x7fca7c0ab410 2020-04-02T23:24:52.790 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.779+0000 7fca81cbf700 1 --2- 172.21.15.42:0/2812166714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca7c0ab410 0x7fca7c066100 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fca78001190 tx=0x7fca78002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.790 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.779+0000 7fca81cbf700 1 --2- 172.21.15.42:0/2812166714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca7c0ab410 0x7fca7c066100 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fca78001190 tx=0x7fca78002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.790 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.779+0000 7fca6f7fe700 1 -- 172.21.15.42:0/2812166714 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca78003730 con 0x7fca7c0ab410 2020-04-02T23:24:52.790 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.779+0000 7fca6f7fe700 1 -- 172.21.15.42:0/2812166714 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca78003b50 con 0x7fca7c0ab410 2020-04-02T23:24:52.790 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.779+0000 7fca84724700 1 -- 172.21.15.42:0/2812166714 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7c063e20 con 0x7fca7c0ab410 2020-04-02T23:24:52.790 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.779+0000 7fca84724700 1 -- 172.21.15.42:0/2812166714 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7c063c40 con 0x7fca7c0ab410 2020-04-02T23:24:52.790 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.779+0000 7fca81cbf700 1 --2- 172.21.15.42:0/2812166714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca7c0ab410 0x7fca7c066100 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fca78001190 tx=0x7fca78002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.780+0000 7fca6f7fe700 1 -- 172.21.15.42:0/2812166714 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fca780064e0 con 0x7fca7c0ab410 2020-04-02T23:24:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.780+0000 7fca81cbf700 1 --2- 172.21.15.42:0/2812166714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca7c0ab410 0x7fca7c066100 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fca78001190 tx=0x7fca78002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.780+0000 7fca84724700 1 -- 172.21.15.42:0/2812166714 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7c05d2e0 con 0x7fca7c0ab410 2020-04-02T23:24:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.780+0000 7fca6f7fe700 1 --2- 172.21.15.42:0/2812166714 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fca5c04d3d0 0x7fca5c04f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.780+0000 7fca6f7fe700 1 -- 172.21.15.42:0/2812166714 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fca780608c0 con 0x7fca7c0ab410 2020-04-02T23:24:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.780+0000 7fca824c0700 1 --2- 172.21.15.42:0/2812166714 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fca5c04d3d0 0x7fca5c04f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.781+0000 7fca824c0700 1 --2- 172.21.15.42:0/2812166714 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fca5c04d3d0 0x7fca5c04f890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca700082e0 tx=0x7fca700112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.781+0000 7fca824c0700 1 --2- 172.21.15.42:0/2812166714 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fca5c04d3d0 0x7fca5c04f890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca700082e0 tx=0x7fca700112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.781+0000 7fca824c0700 1 --2- 172.21.15.42:0/2812166714 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fca5c04d3d0 0x7fca5c04f890 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7fca700082e0 tx=0x7fca700112f0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.783+0000 7fca81cbf700 1 --2- 172.21.15.42:0/2812166714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca7c0ab410 0x7fca7c066100 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fca78001190 tx=0x7fca78002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.784+0000 7fca6f7fe700 1 -- 172.21.15.42:0/2812166714 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fca7803c000 con 0x7fca7c0ab410 2020-04-02T23:24:52.969 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.967+0000 7fca84724700 1 -- 172.21.15.42:0/2812166714 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fca7c056c50 con 0x7fca7c0ab410 2020-04-02T23:24:52.971 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.969+0000 7fca81cbf700 1 --2- 172.21.15.42:0/2812166714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca7c0ab410 0x7fca7c066100 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7fca78001190 tx=0x7fca78002490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:52.971 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.969+0000 7fca6f7fe700 1 -- 172.21.15.42:0/2812166714 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+119888 (secure 0 0 0) 0x7fca7803f620 con 0x7fca7c0ab410 2020-04-02T23:24:52.973 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:24:52.974 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.971+0000 7fca84724700 1 -- 172.21.15.42:0/2812166714 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fca5c04d3d0 msgr2=0x7fca5c04f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.974 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.971+0000 7fca84724700 1 --2- 172.21.15.42:0/2812166714 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fca5c04d3d0 0x7fca5c04f890 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7fca700082e0 tx=0x7fca700112f0).stop 2020-04-02T23:24:52.974 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.971+0000 7fca84724700 1 -- 172.21.15.42:0/2812166714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca7c0ab410 msgr2=0x7fca7c066100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:52.975 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.971+0000 7fca84724700 1 --2- 172.21.15.42:0/2812166714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca7c0ab410 0x7fca7c066100 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7fca78001190 tx=0x7fca78002490).stop 2020-04-02T23:24:52.975 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.971+0000 7fca84724700 1 -- 172.21.15.42:0/2812166714 shutdown_connections 2020-04-02T23:24:52.975 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.971+0000 7fca84724700 1 --2- 172.21.15.42:0/2812166714 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fca5c04d3d0 0x7fca5c04f890 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:52.975 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.971+0000 7fca84724700 1 --2- 172.21.15.42:0/2812166714 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fca7c13a1d0 0x7fca7c1397e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:52.975 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.971+0000 7fca84724700 1 --2- 172.21.15.42:0/2812166714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca7c0ab410 0x7fca7c066100 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:52.975 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.971+0000 7fca84724700 1 -- 172.21.15.42:0/2812166714 >> 172.21.15.42:0/2812166714 conn(0x7fca7c05b720 msgr2=0x7fca7c069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:52.975 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.971+0000 7fca84724700 1 -- 172.21.15.42:0/2812166714 shutdown_connections 2020-04-02T23:24:52.976 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:52.971+0000 7fca84724700 1 -- 172.21.15.42:0/2812166714 wait complete. 2020-04-02T23:24:52.983 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":4,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":23437},{"type":"v1","addr":"172.21.15.84:6801","nonce":23437}]},"active_addr":"172.21.15.84:6801/23437","active_change":"2020-04-02T23:24:27.066997+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4105,"name":"y","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2842263095}]},{"addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":1189092375}]},{"addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":3607723779}]}]}} 2020-04-02T23:24:52.990 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-04-02T23:24:52.990 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-04-02T23:24:52.990 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:53.004 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:24:53.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.154+0000 7f1f507b7700 1 Processor -- start 2020-04-02T23:24:53.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.154+0000 7f1f507b7700 1 -- start start 2020-04-02T23:24:53.159 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.155+0000 7f1f507b7700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1f48067380 0x7f1f480a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:53.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.155+0000 7f1f507b7700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f4813a1d0 0x7f1f4813a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:53.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.155+0000 7f1f507b7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f480a45f0 con 0x7f1f480ab410 2020-04-02T23:24:53.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.155+0000 7f1f507b7700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4809f460 con 0x7f1f48067380 2020-04-02T23:24:53.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.155+0000 7f1f507b7700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4805ff40 con 0x7f1f4813a1d0 2020-04-02T23:24:53.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.155+0000 7f1f4dd52700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1f48067380 0x7f1f480a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:53.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.155+0000 7f1f4dd52700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1f48067380 0x7f1f480a6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39964/0 (socket says 172.21.15.42:39964) 2020-04-02T23:24:53.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.155+0000 7f1f4dd52700 1 -- 172.21.15.42:0/2572223692 learned_addr learned my addr 172.21.15.42:0/2572223692 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:53.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.156+0000 7f1f4dd52700 1 -- 172.21.15.42:0/2572223692 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f4813a1d0 msgr2=0x7f1f4813a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:53.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.156+0000 7f1f4ed54700 1 --2- 172.21.15.42:0/2572223692 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f4813a1d0 0x7f1f4813a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:53.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.156+0000 7f1f4dd52700 1 --2- 172.21.15.42:0/2572223692 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f4813a1d0 0x7f1f4813a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:53.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.156+0000 7f1f4dd52700 1 -- 172.21.15.42:0/2572223692 >> v1:172.21.15.84:6789/0 conn(0x7f1f480ab410 legacy=0x7f1f480a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:53.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.156+0000 7f1f4dd52700 1 -- 172.21.15.42:0/2572223692 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f480a4850 con 0x7f1f48067380 2020-04-02T23:24:53.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.156+0000 7f1f4dd52700 1 --2- 172.21.15.42:0/2572223692 >> v2:172.21.15.42:3300/0 conn(0x7f1f48067380 0x7f1f480a6d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1f4805bc20 tx=0x7f1f44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.156+0000 7f1f4dd52700 1 --2- 172.21.15.42:0/2572223692 >> v2:172.21.15.42:3300/0 conn(0x7f1f48067380 0x7f1f480a6d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1f4805bc20 tx=0x7f1f44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.156+0000 7f1f4dd52700 1 --2- 172.21.15.42:0/2572223692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f48067380 0x7f1f480a6d40 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f1f4805bc20 tx=0x7f1f44007a40).ready entity=mon.0 client_cookie=15e93e993074fd00 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:53.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.156+0000 7f1f4dd52700 1 --2- 172.21.15.42:0/2572223692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f48067380 0x7f1f480a6d40 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f1f4805bc20 tx=0x7f1f44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.156+0000 7f1f4dd52700 1 --2- 172.21.15.42:0/2572223692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f48067380 0x7f1f480a6d40 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f1f4805bc20 tx=0x7f1f44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.156+0000 7f1f4d551700 1 -- 172.21.15.42:0/2572223692 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f440116e0 con 0x7f1f48067380 2020-04-02T23:24:53.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.156+0000 7f1f4dd52700 1 --2- 172.21.15.42:0/2572223692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f48067380 0x7f1f480a6d40 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f1f4805bc20 tx=0x7f1f44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.156+0000 7f1f4d551700 1 -- 172.21.15.42:0/2572223692 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f44011840 con 0x7f1f48067380 2020-04-02T23:24:53.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.156+0000 7f1f4d551700 1 -- 172.21.15.42:0/2572223692 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f44011c60 con 0x7f1f48067380 2020-04-02T23:24:53.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.156+0000 7f1f507b7700 1 -- 172.21.15.42:0/2572223692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f48067380 msgr2=0x7f1f480a6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:53.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.156+0000 7f1f507b7700 1 --2- 172.21.15.42:0/2572223692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f48067380 0x7f1f480a6d40 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f1f4805bc20 tx=0x7f1f44007a40).stop 2020-04-02T23:24:53.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.157+0000 7f1f507b7700 1 -- 172.21.15.42:0/2572223692 shutdown_connections 2020-04-02T23:24:53.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.157+0000 7f1f507b7700 1 --2- 172.21.15.42:0/2572223692 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f4813a1d0 0x7f1f4813a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:53.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.157+0000 7f1f507b7700 1 --2- 172.21.15.42:0/2572223692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f48067380 0x7f1f480a6d40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:53.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.157+0000 7f1f507b7700 1 -- 172.21.15.42:0/2572223692 >> 172.21.15.42:0/2572223692 conn(0x7f1f4805b720 msgr2=0x7f1f480aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:53.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.157+0000 7f1f507b7700 1 -- 172.21.15.42:0/2572223692 shutdown_connections 2020-04-02T23:24:53.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.157+0000 7f1f507b7700 1 -- 172.21.15.42:0/2572223692 wait complete. 2020-04-02T23:24:53.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.157+0000 7f1f507b7700 1 Processor -- start 2020-04-02T23:24:53.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.157+0000 7f1f507b7700 1 -- start start 2020-04-02T23:24:53.167 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.158+0000 7f1f507b7700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f480ab410 0x7f1f48066290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:53.167 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.158+0000 7f1f507b7700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f4813a1d0 0x7f1f48139620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:53.168 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.158+0000 7f1f507b7700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4809a6f0 con 0x7f1f48067380 2020-04-02T23:24:53.168 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.158+0000 7f1f507b7700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f480666f0 con 0x7f1f480ab410 2020-04-02T23:24:53.168 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.158+0000 7f1f507b7700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f48063010 con 0x7f1f4813a1d0 2020-04-02T23:24:53.168 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.158+0000 7f1f4dd52700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f480ab410 0x7f1f48066290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:53.168 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.158+0000 7f1f4dd52700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f480ab410 0x7f1f48066290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.42:34460/0 (socket says 172.21.15.42:34460) 2020-04-02T23:24:53.168 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.158+0000 7f1f4dd52700 1 -- 172.21.15.42:0/2089251204 learned_addr learned my addr 172.21.15.42:0/2089251204 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:53.168 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.158+0000 7f1f4e553700 1 --1- 172.21.15.42:0/2089251204 >> v1:172.21.15.84:6789/0 conn(0x7f1f48067380 0x7f1f48064020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:53770/0 (socket says 172.21.15.42:53770) 2020-04-02T23:24:53.169 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.158+0000 7f1f4ed54700 1 --2- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f4813a1d0 0x7f1f48139620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:53.169 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.159+0000 7f1f4dd52700 1 -- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f4813a1d0 msgr2=0x7f1f48139620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:53.169 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.159+0000 7f1f4dd52700 1 --2- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f4813a1d0 0x7f1f48139620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:53.169 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.159+0000 7f1f4dd52700 1 -- 172.21.15.42:0/2089251204 >> v1:172.21.15.84:6789/0 conn(0x7f1f48067380 legacy=0x7f1f48064020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:53.169 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.159+0000 7f1f3b7fe700 1 -- 172.21.15.42:0/2089251204 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471688385 0 0) 0x7f1f4809a6f0 con 0x7f1f48067380 2020-04-02T23:24:53.169 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.159+0000 7f1f4dd52700 1 -- 172.21.15.42:0/2089251204 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f480632b0 con 0x7f1f480ab410 2020-04-02T23:24:53.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.159+0000 7f1f4dd52700 1 --2- 172.21.15.42:0/2089251204 >> v2:172.21.15.84:3300/0 conn(0x7f1f480ab410 0x7f1f48066290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f4805bc20 tx=0x7f1f44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.159+0000 7f1f4dd52700 1 --2- 172.21.15.42:0/2089251204 >> v2:172.21.15.84:3300/0 conn(0x7f1f480ab410 0x7f1f48066290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f4805bc20 tx=0x7f1f44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.159+0000 7f1f4dd52700 1 --2- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f480ab410 0x7f1f48066290 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f1f4805bc20 tx=0x7f1f44007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:53.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.159+0000 7f1f4dd52700 1 --2- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f480ab410 0x7f1f48066290 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f1f4805bc20 tx=0x7f1f44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.159+0000 7f1f3b7fe700 1 -- 172.21.15.42:0/2089251204 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f44007150 con 0x7f1f480ab410 2020-04-02T23:24:53.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.159+0000 7f1f4dd52700 1 --2- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f480ab410 0x7f1f48066290 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f1f4805bc20 tx=0x7f1f44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.159+0000 7f1f3b7fe700 1 -- 172.21.15.42:0/2089251204 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f440072b0 con 0x7f1f480ab410 2020-04-02T23:24:53.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.159+0000 7f1f4dd52700 1 --2- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f480ab410 0x7f1f48066290 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f1f4805bc20 tx=0x7f1f44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.159+0000 7f1f3b7fe700 1 -- 172.21.15.42:0/2089251204 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f440056c0 con 0x7f1f480ab410 2020-04-02T23:24:53.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.159+0000 7f1f507b7700 1 -- 172.21.15.42:0/2089251204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f48064730 con 0x7f1f480ab410 2020-04-02T23:24:53.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.159+0000 7f1f507b7700 1 -- 172.21.15.42:0/2089251204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4809a3c0 con 0x7f1f480ab410 2020-04-02T23:24:53.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.160+0000 7f1f4dd52700 1 --2- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f480ab410 0x7f1f48066290 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f1f4805bc20 tx=0x7f1f44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.160+0000 7f1f507b7700 1 -- 172.21.15.42:0/2089251204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f48066aa0 con 0x7f1f480ab410 2020-04-02T23:24:53.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.160+0000 7f1f3b7fe700 1 -- 172.21.15.42:0/2089251204 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f1f440058c0 con 0x7f1f480ab410 2020-04-02T23:24:53.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.160+0000 7f1f4dd52700 1 --2- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f480ab410 0x7f1f48066290 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f1f4805bc20 tx=0x7f1f44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.160+0000 7f1f3b7fe700 1 --2- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1f2804d3d0 0x7f1f2804f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:53.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.161+0000 7f1f3b7fe700 1 -- 172.21.15.42:0/2089251204 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1f44061660 con 0x7f1f480ab410 2020-04-02T23:24:53.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.161+0000 7f1f4e553700 1 --2- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1f2804d3d0 0x7f1f2804f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:53.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.161+0000 7f1f4e553700 1 --2- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1f2804d3d0 0x7f1f2804f890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1f3c0021c0 tx=0x7f1f3c002720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.161+0000 7f1f4e553700 1 --2- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1f2804d3d0 0x7f1f2804f890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1f3c0021c0 tx=0x7f1f3c002720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.161+0000 7f1f4e553700 1 --2- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1f2804d3d0 0x7f1f2804f890 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f1f3c0021c0 tx=0x7f1f3c002720).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:53.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.164+0000 7f1f4dd52700 1 --2- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f480ab410 0x7f1f48066290 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f1f4805bc20 tx=0x7f1f44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.164+0000 7f1f3b7fe700 1 -- 172.21.15.42:0/2089251204 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f1f4403cda0 con 0x7f1f480ab410 2020-04-02T23:24:53.313 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.311+0000 7f1f507b7700 1 -- 172.21.15.42:0/2089251204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f4805d2e0 con 0x7f1f480ab410 2020-04-02T23:24:53.314 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.312+0000 7f1f4dd52700 1 --2- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f480ab410 0x7f1f48066290 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7f1f4805bc20 tx=0x7f1f44007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.314 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.312+0000 7f1f3b7fe700 1 -- 172.21.15.42:0/2089251204 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f1f440403c0 con 0x7f1f480ab410 2020-04-02T23:24:53.315 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:24:53.315 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":26,"fsid":"571c521c-9ca7-4052-ba5b-7a77e18ff12c","created":"2020-04-02T23:24:23.980442+0000","modified":"2020-04-02T23:24:48.393847+0000","last_up_change":"2020-04-02T23:24:36.096260+0000","last_in_change":"2020-04-02T23:24:36.096260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:24:27.091980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:24:40.298468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:24:43.688260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:24:45.991301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"976aac36-1cf8-408b-bf56-9f0eefe43b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":24836},{"type":"v1","addr":"172.21.15.42:6801","nonce":24836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":24836},{"type":"v1","addr":"172.21.15.42:6803","nonce":24836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":24836},{"type":"v1","addr":"172.21.15.42:6807","nonce":24836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":24836},{"type":"v1","addr":"172.21.15.42:6805","nonce":24836}]},"public_addr":"172.21.15.42:6801/24836","cluster_addr":"172.21.15.42:6803/24836","heartbeat_back_addr":"172.21.15.42:6807/24836","heartbeat_front_addr":"172.21.15.42:6805/24836","state":["exists","up"]},{"osd":1,"uuid":"22c1e489-ab99-4205-ba9d-fbfc144d2a8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":24881},{"type":"v1","addr":"172.21.15.42:6809","nonce":24881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":24881},{"type":"v1","addr":"172.21.15.42:6811","nonce":24881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":24881},{"type":"v1","addr":"172.21.15.42:6815","nonce":24881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":24881},{"type":"v1","addr":"172.21.15.42:6813","nonce":24881}]},"public_addr":"172.21.15.42:6809/24881","cluster_addr":"172.21.15.42:6811/24881","heartbeat_back_addr":"172.21.15.42:6815/24881","heartbeat_front_addr":"172.21.15.42:6813/24881","state":["exists","up"]},{"osd":2,"uuid":"f0b18b09-93c0-4286-8d15-746611ba53cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":24917},{"type":"v1","addr":"172.21.15.42:6817","nonce":24917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":24917},{"type":"v1","addr":"172.21.15.42:6819","nonce":24917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":24917},{"type":"v1","addr":"172.21.15.42:6823","nonce":24917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":24917},{"type":"v1","addr":"172.21.15.42:6821","nonce":24917}]},"public_addr":"172.21.15.42:6817/24917","cluster_addr":"172.21.15.42:6819/24917","heartbeat_back_addr":"172.21.15.42:6823/24917","heartbeat_front_addr":"172.21.15.42:6821/24917","state":["exists","up"]},{"osd":3,"uuid":"989d4a69-9abe-44de-95f2-6c7cbbe07471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":24940},{"type":"v1","addr":"172.21.15.42:6825","nonce":24940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":24940},{"type":"v1","addr":"172.21.15.42:6827","nonce":24940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":24940},{"type":"v1","addr":"172.21.15.42:6831","nonce":24940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":24940},{"type":"v1","addr":"172.21.15.42:6829","nonce":24940}]},"public_addr":"172.21.15.42:6825/24940","cluster_addr":"172.21.15.42:6827/24940","heartbeat_back_addr":"172.21.15.42:6831/24940","heartbeat_front_addr":"172.21.15.42:6829/24940","state":["exists","up"]},{"osd":4,"uuid":"b1a2ce60-ae80-4f8a-97a3-4fbb1399fdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":24239},{"type":"v1","addr":"172.21.15.84:6803","nonce":24239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":24239},{"type":"v1","addr":"172.21.15.84:6805","nonce":24239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":24239},{"type":"v1","addr":"172.21.15.84:6809","nonce":24239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":24239},{"type":"v1","addr":"172.21.15.84:6807","nonce":24239}]},"public_addr":"172.21.15.84:6803/24239","cluster_addr":"172.21.15.84:6805/24239","heartbeat_back_addr":"172.21.15.84:6809/24239","heartbeat_front_addr":"172.21.15.84:6807/24239","state":["exists","up"]},{"osd":5,"uuid":"396b36e5-7226-4e8e-aa8a-749cb5cec101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":24276},{"type":"v1","addr":"172.21.15.84:6811","nonce":24276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":24276},{"type":"v1","addr":"172.21.15.84:6813","nonce":24276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":24276},{"type":"v1","addr":"172.21.15.84:6817","nonce":24276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":24276},{"type":"v1","addr":"172.21.15.84:6815","nonce":24276}]},"public_addr":"172.21.15.84:6811/24276","cluster_addr":"172.21.15.84:6813/24276","heartbeat_back_addr":"172.21.15.84:6817/24276","heartbeat_front_addr":"172.21.15.84:6815/24276","state":["exists","up"]},{"osd":6,"uuid":"884bb915-28c3-463d-8046-e2908f6e8e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":24319},{"type":"v1","addr":"172.21.15.84:6819","nonce":24319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":24319},{"type":"v1","addr":"172.21.15.84:6821","nonce":24319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":24319},{"type":"v1","addr":"172.21.15.84:6825","nonce":24319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":24319},{"type":"v1","addr":"172.21.15.84:6823","nonce":24319}]},"public_addr":"172.21.15.84:6819/24319","cluster_addr":"172.21.15.84:6821/24319","heartbeat_back_addr":"172.21.15.84:6825/24319","heartbeat_front_addr":"172.21.15.84:6823/24319","state":["exists","up"]},{"osd":7,"uuid":"70e90d1d-f081-4de5-af4b-e987c159e597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":24349},{"type":"v1","addr":"172.21.15.84:6827","nonce":24349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":24349},{"type":"v1","addr":"172.21.15.84:6829","nonce":24349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":24349},{"type":"v1","addr":"172.21.15.84:6833","nonce":24349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":24349},{"type":"v1","addr":"172.21.15.84:6831","nonce":24349}]},"public_addr":"172.21.15.84:6827/24349","cluster_addr":"172.21.15.84:6829/24349","heartbeat_back_addr":"172.21.15.84:6833/24349","heartbeat_front_addr":"172.21.15.84:6831/24349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.195657+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.241354+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.257764+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.368827+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.967296+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.991068+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.077047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.095727+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:24:53.316 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.313+0000 7f1f507b7700 1 -- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1f2804d3d0 msgr2=0x7f1f2804f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:53.316 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.313+0000 7f1f507b7700 1 --2- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1f2804d3d0 0x7f1f2804f890 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f1f3c0021c0 tx=0x7f1f3c002720).stop 2020-04-02T23:24:53.316 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.313+0000 7f1f507b7700 1 -- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f480ab410 msgr2=0x7f1f48066290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:53.317 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.313+0000 7f1f507b7700 1 --2- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f480ab410 0x7f1f48066290 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f1f4805bc20 tx=0x7f1f44007a40).stop 2020-04-02T23:24:53.317 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.313+0000 7f1f507b7700 1 -- 172.21.15.42:0/2089251204 shutdown_connections 2020-04-02T23:24:53.317 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.313+0000 7f1f507b7700 1 --2- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1f2804d3d0 0x7f1f2804f890 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:53.317 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.313+0000 7f1f507b7700 1 --2- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1f4813a1d0 0x7f1f48139620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:53.317 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.313+0000 7f1f507b7700 1 --2- 172.21.15.42:0/2089251204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f480ab410 0x7f1f48066290 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:53.317 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.314+0000 7f1f507b7700 1 -- 172.21.15.42:0/2089251204 >> 172.21.15.42:0/2089251204 conn(0x7f1f4805b720 msgr2=0x7f1f48069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:53.317 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.314+0000 7f1f507b7700 1 -- 172.21.15.42:0/2089251204 shutdown_connections 2020-04-02T23:24:53.318 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.314+0000 7f1f507b7700 1 -- 172.21.15.42:0/2089251204 wait complete. 2020-04-02T23:24:53.326 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-04-02T23:24:53.327 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:53.340 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:24:53.494 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.492+0000 7f32a48cb700 1 Processor -- start 2020-04-02T23:24:53.494 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.492+0000 7f32a48cb700 1 -- start start 2020-04-02T23:24:53.497 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f32a48cb700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f32a00ab410 0x7f32a00a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:53.497 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f32a48cb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f32a00a6a90 0x7f32a00a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:53.497 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f32a48cb700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a00a31b0 con 0x7f32a00a2130 2020-04-02T23:24:53.497 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f32a48cb700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a00a49f0 con 0x7f32a00ab410 2020-04-02T23:24:53.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f32a48cb700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a005ff40 con 0x7f32a00a6a90 2020-04-02T23:24:53.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f329e59c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f32a00ab410 0x7f32a00a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:53.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f329e59c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f32a00ab410 0x7f32a00a6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39976/0 (socket says 172.21.15.42:39976) 2020-04-02T23:24:53.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f329e59c700 1 -- 172.21.15.42:0/1116302368 learned_addr learned my addr 172.21.15.42:0/1116302368 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:53.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f329dd9b700 1 --2- 172.21.15.42:0/1116302368 >> v2:172.21.15.84:3300/0 conn(0x7f32a00a6a90 0x7f32a00a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:53.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f329e59c700 1 -- 172.21.15.42:0/1116302368 >> v2:172.21.15.84:3300/0 conn(0x7f32a00a6a90 msgr2=0x7f32a00a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:53.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f329e59c700 1 --2- 172.21.15.42:0/1116302368 >> v2:172.21.15.84:3300/0 conn(0x7f32a00a6a90 0x7f32a00a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:53.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f329e59c700 1 -- 172.21.15.42:0/1116302368 >> v1:172.21.15.84:6789/0 conn(0x7f32a00a2130 legacy=0x7f32a00a2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:53.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f329e59c700 1 -- 172.21.15.42:0/1116302368 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a00a3420 con 0x7f32a00ab410 2020-04-02T23:24:53.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f329e59c700 1 --2- 172.21.15.42:0/1116302368 >> v2:172.21.15.42:3300/0 conn(0x7f32a00ab410 0x7f32a00a6630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f32a005bc20 tx=0x7f3298007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f329e59c700 1 --2- 172.21.15.42:0/1116302368 >> v2:172.21.15.42:3300/0 conn(0x7f32a00ab410 0x7f32a00a6630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f32a005bc20 tx=0x7f3298007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f329e59c700 1 --2- 172.21.15.42:0/1116302368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32a00ab410 0x7f32a00a6630 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f32a005bc20 tx=0x7f3298007a40).ready entity=mon.0 client_cookie=65cb1294d7370d15 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:53.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f329e59c700 1 --2- 172.21.15.42:0/1116302368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32a00ab410 0x7f32a00a6630 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f32a005bc20 tx=0x7f3298007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f329e59c700 1 --2- 172.21.15.42:0/1116302368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32a00ab410 0x7f32a00a6630 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f32a005bc20 tx=0x7f3298007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f329d59a700 1 -- 172.21.15.42:0/1116302368 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32980116e0 con 0x7f32a00ab410 2020-04-02T23:24:53.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f329e59c700 1 --2- 172.21.15.42:0/1116302368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32a00ab410 0x7f32a00a6630 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7f32a005bc20 tx=0x7f3298007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f329d59a700 1 -- 172.21.15.42:0/1116302368 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3298011840 con 0x7f32a00ab410 2020-04-02T23:24:53.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f329d59a700 1 -- 172.21.15.42:0/1116302368 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3298011c20 con 0x7f32a00ab410 2020-04-02T23:24:53.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f32a48cb700 1 -- 172.21.15.42:0/1116302368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32a00ab410 msgr2=0x7f32a00a6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:53.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.493+0000 7f32a48cb700 1 --2- 172.21.15.42:0/1116302368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32a00ab410 0x7f32a00a6630 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7f32a005bc20 tx=0x7f3298007a40).stop 2020-04-02T23:24:53.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.494+0000 7f32a48cb700 1 -- 172.21.15.42:0/1116302368 shutdown_connections 2020-04-02T23:24:53.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.494+0000 7f32a48cb700 1 --2- 172.21.15.42:0/1116302368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32a00ab410 0x7f32a00a6630 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:53.501 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.494+0000 7f32a48cb700 1 --2- 172.21.15.42:0/1116302368 >> v2:172.21.15.84:3300/0 conn(0x7f32a00a6a90 0x7f32a00a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:53.501 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.494+0000 7f32a48cb700 1 -- 172.21.15.42:0/1116302368 >> 172.21.15.42:0/1116302368 conn(0x7f32a005b720 msgr2=0x7f32a00aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:53.501 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.494+0000 7f32a48cb700 1 -- 172.21.15.42:0/1116302368 shutdown_connections 2020-04-02T23:24:53.501 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.494+0000 7f32a48cb700 1 -- 172.21.15.42:0/1116302368 wait complete. 2020-04-02T23:24:53.501 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.495+0000 7f32a48cb700 1 Processor -- start 2020-04-02T23:24:53.501 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.495+0000 7f32a48cb700 1 -- start start 2020-04-02T23:24:53.504 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.495+0000 7f32a48cb700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f32a00a6a90 0x7f32a00658f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:53.504 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.495+0000 7f32a48cb700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32a00ab410 0x7f32a009d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.495+0000 7f32a48cb700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a00634e0 con 0x7f32a00a2130 2020-04-02T23:24:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.495+0000 7f32a48cb700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a0063780 con 0x7f32a00a6a90 2020-04-02T23:24:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.495+0000 7f32a48cb700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a0063a20 con 0x7f32a00ab410 2020-04-02T23:24:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f329dd9b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f32a00a6a90 0x7f32a00658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f329e59c700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f32a00a2130 0x7f32a0136650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59406/0 (socket says 172.21.15.42:59406) 2020-04-02T23:24:53.506 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f329e59c700 1 -- 172.21.15.42:0/4045140490 learned_addr learned my addr 172.21.15.42:0/4045140490 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:53.506 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f329dd9b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f32a00a6a90 0x7f32a00658f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39984/0 (socket says 172.21.15.42:39984) 2020-04-02T23:24:53.506 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f329ed9d700 1 --2- 172.21.15.42:0/4045140490 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32a00ab410 0x7f32a009d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:53.506 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f329dd9b700 1 -- 172.21.15.42:0/4045140490 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32a00ab410 msgr2=0x7f32a009d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:53.506 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f329dd9b700 1 --2- 172.21.15.42:0/4045140490 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32a00ab410 0x7f32a009d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:53.506 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f329dd9b700 1 -- 172.21.15.42:0/4045140490 >> v1:172.21.15.42:6789/0 conn(0x7f32a00a2130 legacy=0x7f32a0136650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:53.506 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f32977fe700 1 -- 172.21.15.42:0/4045140490 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465295882 0 0) 0x7f32a00634e0 con 0x7f32a00a2130 2020-04-02T23:24:53.507 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f329dd9b700 1 -- 172.21.15.42:0/4045140490 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a0063cc0 con 0x7f32a00a6a90 2020-04-02T23:24:53.507 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f329dd9b700 1 --2- 172.21.15.42:0/4045140490 >> v2:172.21.15.42:3300/0 conn(0x7f32a00a6a90 0x7f32a00658f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f32880032b0 tx=0x7f3288010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.507 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f329dd9b700 1 --2- 172.21.15.42:0/4045140490 >> v2:172.21.15.42:3300/0 conn(0x7f32a00a6a90 0x7f32a00658f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f32880032b0 tx=0x7f3288010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.507 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f329dd9b700 1 --2- 172.21.15.42:0/4045140490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32a00a6a90 0x7f32a00658f0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f32880032b0 tx=0x7f3288010f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:53.507 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f329dd9b700 1 --2- 172.21.15.42:0/4045140490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32a00a6a90 0x7f32a00658f0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f32880032b0 tx=0x7f3288010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.507 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f32977fe700 1 -- 172.21.15.42:0/4045140490 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3288005e30 con 0x7f32a00a6a90 2020-04-02T23:24:53.507 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f329dd9b700 1 --2- 172.21.15.42:0/4045140490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32a00a6a90 0x7f32a00658f0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f32880032b0 tx=0x7f3288010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.508 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f329dd9b700 1 --2- 172.21.15.42:0/4045140490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32a00a6a90 0x7f32a00658f0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f32880032b0 tx=0x7f3288010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.508 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f32977fe700 1 -- 172.21.15.42:0/4045140490 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3288007540 con 0x7f32a00a6a90 2020-04-02T23:24:53.508 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f32a48cb700 1 -- 172.21.15.42:0/4045140490 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a009a490 con 0x7f32a00a6a90 2020-04-02T23:24:53.508 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f32977fe700 1 -- 172.21.15.42:0/4045140490 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32880078e0 con 0x7f32a00a6a90 2020-04-02T23:24:53.508 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.496+0000 7f32a48cb700 1 -- 172.21.15.42:0/4045140490 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a0136f20 con 0x7f32a00a6a90 2020-04-02T23:24:53.508 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.497+0000 7f329dd9b700 1 --2- 172.21.15.42:0/4045140490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32a00a6a90 0x7f32a00658f0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f32880032b0 tx=0x7f3288010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.508 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.497+0000 7f32977fe700 1 -- 172.21.15.42:0/4045140490 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f3288010180 con 0x7f32a00a6a90 2020-04-02T23:24:53.509 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.497+0000 7f32a48cb700 1 -- 172.21.15.42:0/4045140490 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a005d2e0 con 0x7f32a00a6a90 2020-04-02T23:24:53.509 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.497+0000 7f329dd9b700 1 --2- 172.21.15.42:0/4045140490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32a00a6a90 0x7f32a00658f0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f32880032b0 tx=0x7f3288010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.509 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.498+0000 7f32977fe700 1 --2- 172.21.15.42:0/4045140490 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f328404d470 0x7f328404f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:53.509 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.498+0000 7f32977fe700 1 -- 172.21.15.42:0/4045140490 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f3288061030 con 0x7f32a00a6a90 2020-04-02T23:24:53.509 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.498+0000 7f329e59c700 1 --2- 172.21.15.42:0/4045140490 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f328404d470 0x7f328404f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:53.509 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.498+0000 7f329e59c700 1 --2- 172.21.15.42:0/4045140490 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f328404d470 0x7f328404f930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3298008320 tx=0x7f3298007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.509 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.498+0000 7f329e59c700 1 --2- 172.21.15.42:0/4045140490 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f328404d470 0x7f328404f930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3298008320 tx=0x7f3298007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.510 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.498+0000 7f329e59c700 1 --2- 172.21.15.42:0/4045140490 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f328404d470 0x7f328404f930 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f3298008320 tx=0x7f3298007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:53.510 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.501+0000 7f329dd9b700 1 --2- 172.21.15.42:0/4045140490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32a00a6a90 0x7f32a00658f0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f32880032b0 tx=0x7f3288010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.510 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.501+0000 7f32977fe700 1 -- 172.21.15.42:0/4045140490 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f328803c730 con 0x7f32a00a6a90 2020-04-02T23:24:53.651 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.649+0000 7f32a48cb700 1 -- 172.21.15.42:0/4045140490 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32a0056c50 con 0x7f32a00a6a90 2020-04-02T23:24:53.652 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.650+0000 7f329dd9b700 1 --2- 172.21.15.42:0/4045140490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32a00a6a90 0x7f32a00658f0 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7f32880032b0 tx=0x7f3288010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.652 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.650+0000 7f32977fe700 1 -- 172.21.15.42:0/4045140490 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f328803fd50 con 0x7f32a00a6a90 2020-04-02T23:24:53.653 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:24:53.653 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":26,"fsid":"571c521c-9ca7-4052-ba5b-7a77e18ff12c","created":"2020-04-02T23:24:23.980442+0000","modified":"2020-04-02T23:24:48.393847+0000","last_up_change":"2020-04-02T23:24:36.096260+0000","last_in_change":"2020-04-02T23:24:36.096260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:24:27.091980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:24:40.298468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:24:43.688260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:24:45.991301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"976aac36-1cf8-408b-bf56-9f0eefe43b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":24836},{"type":"v1","addr":"172.21.15.42:6801","nonce":24836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":24836},{"type":"v1","addr":"172.21.15.42:6803","nonce":24836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":24836},{"type":"v1","addr":"172.21.15.42:6807","nonce":24836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":24836},{"type":"v1","addr":"172.21.15.42:6805","nonce":24836}]},"public_addr":"172.21.15.42:6801/24836","cluster_addr":"172.21.15.42:6803/24836","heartbeat_back_addr":"172.21.15.42:6807/24836","heartbeat_front_addr":"172.21.15.42:6805/24836","state":["exists","up"]},{"osd":1,"uuid":"22c1e489-ab99-4205-ba9d-fbfc144d2a8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":24881},{"type":"v1","addr":"172.21.15.42:6809","nonce":24881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":24881},{"type":"v1","addr":"172.21.15.42:6811","nonce":24881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":24881},{"type":"v1","addr":"172.21.15.42:6815","nonce":24881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":24881},{"type":"v1","addr":"172.21.15.42:6813","nonce":24881}]},"public_addr":"172.21.15.42:6809/24881","cluster_addr":"172.21.15.42:6811/24881","heartbeat_back_addr":"172.21.15.42:6815/24881","heartbeat_front_addr":"172.21.15.42:6813/24881","state":["exists","up"]},{"osd":2,"uuid":"f0b18b09-93c0-4286-8d15-746611ba53cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":24917},{"type":"v1","addr":"172.21.15.42:6817","nonce":24917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":24917},{"type":"v1","addr":"172.21.15.42:6819","nonce":24917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":24917},{"type":"v1","addr":"172.21.15.42:6823","nonce":24917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":24917},{"type":"v1","addr":"172.21.15.42:6821","nonce":24917}]},"public_addr":"172.21.15.42:6817/24917","cluster_addr":"172.21.15.42:6819/24917","heartbeat_back_addr":"172.21.15.42:6823/24917","heartbeat_front_addr":"172.21.15.42:6821/24917","state":["exists","up"]},{"osd":3,"uuid":"989d4a69-9abe-44de-95f2-6c7cbbe07471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":24940},{"type":"v1","addr":"172.21.15.42:6825","nonce":24940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":24940},{"type":"v1","addr":"172.21.15.42:6827","nonce":24940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":24940},{"type":"v1","addr":"172.21.15.42:6831","nonce":24940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":24940},{"type":"v1","addr":"172.21.15.42:6829","nonce":24940}]},"public_addr":"172.21.15.42:6825/24940","cluster_addr":"172.21.15.42:6827/24940","heartbeat_back_addr":"172.21.15.42:6831/24940","heartbeat_front_addr":"172.21.15.42:6829/24940","state":["exists","up"]},{"osd":4,"uuid":"b1a2ce60-ae80-4f8a-97a3-4fbb1399fdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":24239},{"type":"v1","addr":"172.21.15.84:6803","nonce":24239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":24239},{"type":"v1","addr":"172.21.15.84:6805","nonce":24239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":24239},{"type":"v1","addr":"172.21.15.84:6809","nonce":24239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":24239},{"type":"v1","addr":"172.21.15.84:6807","nonce":24239}]},"public_addr":"172.21.15.84:6803/24239","cluster_addr":"172.21.15.84:6805/24239","heartbeat_back_addr":"172.21.15.84:6809/24239","heartbeat_front_addr":"172.21.15.84:6807/24239","state":["exists","up"]},{"osd":5,"uuid":"396b36e5-7226-4e8e-aa8a-749cb5cec101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":24276},{"type":"v1","addr":"172.21.15.84:6811","nonce":24276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":24276},{"type":"v1","addr":"172.21.15.84:6813","nonce":24276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":24276},{"type":"v1","addr":"172.21.15.84:6817","nonce":24276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":24276},{"type":"v1","addr":"172.21.15.84:6815","nonce":24276}]},"public_addr":"172.21.15.84:6811/24276","cluster_addr":"172.21.15.84:6813/24276","heartbeat_back_addr":"172.21.15.84:6817/24276","heartbeat_front_addr":"172.21.15.84:6815/24276","state":["exists","up"]},{"osd":6,"uuid":"884bb915-28c3-463d-8046-e2908f6e8e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":24319},{"type":"v1","addr":"172.21.15.84:6819","nonce":24319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":24319},{"type":"v1","addr":"172.21.15.84:6821","nonce":24319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":24319},{"type":"v1","addr":"172.21.15.84:6825","nonce":24319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":24319},{"type":"v1","addr":"172.21.15.84:6823","nonce":24319}]},"public_addr":"172.21.15.84:6819/24319","cluster_addr":"172.21.15.84:6821/24319","heartbeat_back_addr":"172.21.15.84:6825/24319","heartbeat_front_addr":"172.21.15.84:6823/24319","state":["exists","up"]},{"osd":7,"uuid":"70e90d1d-f081-4de5-af4b-e987c159e597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":24349},{"type":"v1","addr":"172.21.15.84:6827","nonce":24349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":24349},{"type":"v1","addr":"172.21.15.84:6829","nonce":24349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":24349},{"type":"v1","addr":"172.21.15.84:6833","nonce":24349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":24349},{"type":"v1","addr":"172.21.15.84:6831","nonce":24349}]},"public_addr":"172.21.15.84:6827/24349","cluster_addr":"172.21.15.84:6829/24349","heartbeat_back_addr":"172.21.15.84:6833/24349","heartbeat_front_addr":"172.21.15.84:6831/24349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.195657+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.241354+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.257764+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.368827+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.967296+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.991068+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.077047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.095727+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:24:53.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.652+0000 7f32a48cb700 1 -- 172.21.15.42:0/4045140490 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f328404d470 msgr2=0x7f328404f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:53.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.652+0000 7f32a48cb700 1 --2- 172.21.15.42:0/4045140490 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f328404d470 0x7f328404f930 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f3298008320 tx=0x7f3298007a40).stop 2020-04-02T23:24:53.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.652+0000 7f32a48cb700 1 -- 172.21.15.42:0/4045140490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32a00a6a90 msgr2=0x7f32a00658f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:53.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.652+0000 7f32a48cb700 1 --2- 172.21.15.42:0/4045140490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32a00a6a90 0x7f32a00658f0 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7f32880032b0 tx=0x7f3288010f30).stop 2020-04-02T23:24:53.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.652+0000 7f32a48cb700 1 -- 172.21.15.42:0/4045140490 shutdown_connections 2020-04-02T23:24:53.655 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.652+0000 7f32a48cb700 1 --2- 172.21.15.42:0/4045140490 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f328404d470 0x7f328404f930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:53.655 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.652+0000 7f32a48cb700 1 --2- 172.21.15.42:0/4045140490 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f32a00ab410 0x7f32a009d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:53.655 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.652+0000 7f32a48cb700 1 --2- 172.21.15.42:0/4045140490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32a00a6a90 0x7f32a00658f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:53.655 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.652+0000 7f32a48cb700 1 -- 172.21.15.42:0/4045140490 >> 172.21.15.42:0/4045140490 conn(0x7f32a005b720 msgr2=0x7f32a00aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:53.655 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.652+0000 7f32a48cb700 1 -- 172.21.15.42:0/4045140490 shutdown_connections 2020-04-02T23:24:53.655 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.652+0000 7f32a48cb700 1 -- 172.21.15.42:0/4045140490 wait complete. 2020-04-02T23:24:53.665 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:53.678 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-04-02T23:24:53.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.831+0000 7f48e6950700 1 Processor -- start 2020-04-02T23:24:53.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.831+0000 7f48e6950700 1 -- start start 2020-04-02T23:24:53.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.831+0000 7f48e6950700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48e00ab410 0x7f48e00a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:53.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.831+0000 7f48e6950700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f48e0067380 0x7f48e00a6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:53.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.831+0000 7f48e6950700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e00a45f0 con 0x7f48e00a5250 2020-04-02T23:24:53.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.831+0000 7f48e6950700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e009f460 con 0x7f48e0067380 2020-04-02T23:24:53.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.831+0000 7f48e6950700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e005ff40 con 0x7f48e00ab410 2020-04-02T23:24:53.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.831+0000 7f48df7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f48e0067380 0x7f48e00a6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:53.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.831+0000 7f48e4eed700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f48e00a5250 0x7f48e00a56e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59418/0 (socket says 172.21.15.42:59418) 2020-04-02T23:24:53.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.831+0000 7f48e4eed700 1 -- 172.21.15.42:0/3914635809 learned_addr learned my addr 172.21.15.42:0/3914635809 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:53.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48dffff700 1 --2- 172.21.15.42:0/3914635809 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48e00ab410 0x7f48e00a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:53.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48df7fe700 1 -- 172.21.15.42:0/3914635809 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48e00ab410 msgr2=0x7f48e00a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:53.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48df7fe700 1 --2- 172.21.15.42:0/3914635809 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48e00ab410 0x7f48e00a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:53.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48df7fe700 1 -- 172.21.15.42:0/3914635809 >> v1:172.21.15.42:6789/0 conn(0x7f48e00a5250 legacy=0x7f48e00a56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:53.838 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48deffd700 1 -- 172.21.15.42:0/3914635809 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261530920 0 0) 0x7f48e00a45f0 con 0x7f48e00a5250 2020-04-02T23:24:53.838 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48df7fe700 1 -- 172.21.15.42:0/3914635809 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e00a4850 con 0x7f48e0067380 2020-04-02T23:24:53.838 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48df7fe700 1 --2- 172.21.15.42:0/3914635809 >> v2:172.21.15.42:3300/0 conn(0x7f48e0067380 0x7f48e00a6a90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f48d4002f30 tx=0x7f48d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.838 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48df7fe700 1 --2- 172.21.15.42:0/3914635809 >> v2:172.21.15.42:3300/0 conn(0x7f48e0067380 0x7f48e00a6a90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f48d4002f30 tx=0x7f48d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.838 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48df7fe700 1 --2- 172.21.15.42:0/3914635809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48e0067380 0x7f48e00a6a90 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f48d4002f30 tx=0x7f48d4007a40).ready entity=mon.0 client_cookie=a7e122a73bd232aa server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:53.838 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48df7fe700 1 --2- 172.21.15.42:0/3914635809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48e0067380 0x7f48e00a6a90 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f48d4002f30 tx=0x7f48d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.838 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48deffd700 1 -- 172.21.15.42:0/3914635809 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48d4011470 con 0x7f48e0067380 2020-04-02T23:24:53.839 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48df7fe700 1 --2- 172.21.15.42:0/3914635809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48e0067380 0x7f48e00a6a90 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f48d4002f30 tx=0x7f48d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.839 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48df7fe700 1 --2- 172.21.15.42:0/3914635809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48e0067380 0x7f48e00a6a90 secure :-1 s=THROTTLE_DONE pgs=116 cs=0 l=1 rx=0x7f48d4002f30 tx=0x7f48d4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.839 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48deffd700 1 -- 172.21.15.42:0/3914635809 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d40115d0 con 0x7f48e0067380 2020-04-02T23:24:53.839 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48deffd700 1 -- 172.21.15.42:0/3914635809 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48d40119b0 con 0x7f48e0067380 2020-04-02T23:24:53.839 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48e6950700 1 -- 172.21.15.42:0/3914635809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48e0067380 msgr2=0x7f48e00a6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:53.839 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48e6950700 1 --2- 172.21.15.42:0/3914635809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48e0067380 0x7f48e00a6a90 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7f48d4002f30 tx=0x7f48d4007a40).stop 2020-04-02T23:24:53.839 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48e6950700 1 -- 172.21.15.42:0/3914635809 shutdown_connections 2020-04-02T23:24:53.839 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48e6950700 1 --2- 172.21.15.42:0/3914635809 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48e00ab410 0x7f48e00a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:53.840 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48e6950700 1 --2- 172.21.15.42:0/3914635809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48e0067380 0x7f48e00a6a90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:53.840 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.832+0000 7f48e6950700 1 -- 172.21.15.42:0/3914635809 >> 172.21.15.42:0/3914635809 conn(0x7f48e005b720 msgr2=0x7f48e00aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:53.840 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.833+0000 7f48e6950700 1 -- 172.21.15.42:0/3914635809 shutdown_connections 2020-04-02T23:24:53.840 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.833+0000 7f48e6950700 1 -- 172.21.15.42:0/3914635809 wait complete. 2020-04-02T23:24:53.840 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.833+0000 7f48e6950700 1 Processor -- start 2020-04-02T23:24:53.840 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.833+0000 7f48e6950700 1 -- start start 2020-04-02T23:24:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.834+0000 7f48e6950700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f48e0067380 0x7f48e00663a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.834+0000 7f48e6950700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e00670d0 con 0x7f48e00a5250 2020-04-02T23:24:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.834+0000 7f48e6950700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e0062410 con 0x7f48e00ab410 2020-04-02T23:24:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.834+0000 7f48e6950700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e0066e30 con 0x7f48e0067380 2020-04-02T23:24:53.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.834+0000 7f48df7fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f48e00a5250 0x7f48e0138910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59422/0 (socket says 172.21.15.42:59422) 2020-04-02T23:24:53.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.834+0000 7f48df7fe700 1 -- 172.21.15.42:0/3058018891 learned_addr learned my addr 172.21.15.42:0/3058018891 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:53.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.834+0000 7f48dd7fa700 1 -- 172.21.15.42:0/3058018891 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111056322 0 0) 0x7f48e00670d0 con 0x7f48e00a5250 2020-04-02T23:24:53.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.834+0000 7f48dd7fa700 1 -- 172.21.15.42:0/3058018891 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48c0002fe0 con 0x7f48e00a5250 2020-04-02T23:24:53.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48dffff700 1 --2- 172.21.15.42:0/3058018891 >> v2:172.21.15.84:3300/0 conn(0x7f48e0067380 0x7f48e00663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:53.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48dd7fa700 1 -- 172.21.15.42:0/3058018891 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2903076711 0 0) 0x7f48c0002fe0 con 0x7f48e00a5250 2020-04-02T23:24:53.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48dd7fa700 1 -- 172.21.15.42:0/3058018891 --> v1:172.21.15.42:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f48e00670d0 con 0x7f48e00a5250 2020-04-02T23:24:53.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48dd7fa700 1 -- 172.21.15.42:0/3058018891 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7f48d4008e10 con 0x7f48e00a5250 2020-04-02T23:24:53.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48dd7fa700 1 -- 172.21.15.42:0/3058018891 >> v2:172.21.15.84:3300/0 conn(0x7f48e0067380 msgr2=0x7f48e00663a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:53.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48dd7fa700 1 --2- 172.21.15.42:0/3058018891 >> v2:172.21.15.84:3300/0 conn(0x7f48e0067380 0x7f48e00663a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:53.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48dd7fa700 1 -- 172.21.15.42:0/3058018891 >> v1:172.21.15.84:6789/0 conn(0x7f48e00ab410 legacy=0x7f48e014e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:53.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48dd7fa700 1 -- 172.21.15.42:0/3058018891 >> v1:172.21.15.42:6789/0 conn(0x7f48e00a5250 legacy=0x7f48e0138910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:53.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48dd7fa700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c00049b0 0x7f48c0004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:53.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48dd7fa700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48c00052a0 0x7f48c0003980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:53.848 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48dd7fa700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c0003f80 0x7f48c0004400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:53.848 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48dd7fa700 1 -- 172.21.15.42:0/3058018891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0066e30 con 0x7f48c0003f80 2020-04-02T23:24:53.848 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48dd7fa700 1 -- 172.21.15.42:0/3058018891 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c000b910 con 0x7f48c00052a0 2020-04-02T23:24:53.848 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48dd7fa700 1 -- 172.21.15.42:0/3058018891 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c000fee0 con 0x7f48c00049b0 2020-04-02T23:24:53.848 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48dffff700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c00049b0 0x7f48c0004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:53.848 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48e4eed700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c0003f80 0x7f48c0004400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:53.849 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48df7fe700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48c00052a0 0x7f48c0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:53.849 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48e4eed700 1 -- 172.21.15.42:0/3058018891 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c00049b0 msgr2=0x7f48c0004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:53.849 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48e4eed700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c00049b0 0x7f48c0004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:53.849 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48e4eed700 1 -- 172.21.15.42:0/3058018891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48c00052a0 msgr2=0x7f48c0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:53.849 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48e4eed700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48c00052a0 0x7f48c0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:53.849 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48e4eed700 1 -- 172.21.15.42:0/3058018891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e0064120 con 0x7f48c0003f80 2020-04-02T23:24:53.849 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48e6950700 1 -- 172.21.15.42:0/3058018891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e0139020 con 0x7f48c0003f80 2020-04-02T23:24:53.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48e4eed700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c0003f80 0x7f48c0004400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f48e0065d30 tx=0x7f48d8010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48e6950700 1 -- 172.21.15.42:0/3058018891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e009dbd0 con 0x7f48c0003f80 2020-04-02T23:24:53.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.835+0000 7f48e4eed700 1 -- 172.21.15.42:0/3058018891 reap_dead start 2020-04-02T23:24:53.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.836+0000 7f48e4eed700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c0003f80 0x7f48c0004400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f48e0065d30 tx=0x7f48d8010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.836+0000 7f48e4eed700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c0003f80 0x7f48c0004400 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f48e0065d30 tx=0x7f48d8010bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:53.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.836+0000 7f48e4eed700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c0003f80 0x7f48c0004400 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f48e0065d30 tx=0x7f48d8010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.836+0000 7f48dd7fa700 1 -- 172.21.15.42:0/3058018891 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48d8005d20 con 0x7f48c0003f80 2020-04-02T23:24:53.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.836+0000 7f48e4eed700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c0003f80 0x7f48c0004400 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f48e0065d30 tx=0x7f48d8010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.836+0000 7f48e4eed700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c0003f80 0x7f48c0004400 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f48e0065d30 tx=0x7f48d8010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.836+0000 7f48dd7fa700 1 -- 172.21.15.42:0/3058018891 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d8005e80 con 0x7f48c0003f80 2020-04-02T23:24:53.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.836+0000 7f48dd7fa700 1 -- 172.21.15.42:0/3058018891 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48d800a510 con 0x7f48c0003f80 2020-04-02T23:24:53.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.836+0000 7f48e6950700 1 -- 172.21.15.42:0/3058018891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f48bc003580 con 0x7f48c0003f80 2020-04-02T23:24:53.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.836+0000 7f48e4eed700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c0003f80 0x7f48c0004400 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f48e0065d30 tx=0x7f48d8010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.837+0000 7f48dd7fa700 1 -- 172.21.15.42:0/3058018891 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f48d800a670 con 0x7f48c0003f80 2020-04-02T23:24:53.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.837+0000 7f48e4eed700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c0003f80 0x7f48c0004400 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f48e0065d30 tx=0x7f48d8010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.852 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.837+0000 7f48e4eed700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c0003f80 0x7f48c0004400 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7f48e0065d30 tx=0x7f48d8010bf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.852 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.837+0000 7f48dd7fa700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f48c00558b0 0x7f48c0057d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:53.852 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.837+0000 7f48dd7fa700 1 -- 172.21.15.42:0/3058018891 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f48d8060c70 con 0x7f48c0003f80 2020-04-02T23:24:53.852 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.837+0000 7f48dd7fa700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.42:6800/24836,v1:172.21.15.42:6801/24836] conn(0x7f48c005c910 0x7f48c005ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:53.852 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.837+0000 7f48dd7fa700 1 -- 172.21.15.42:0/3058018891 --> [v2:172.21.15.42:6800/24836,v1:172.21.15.42:6801/24836] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f48c005f2f0 con 0x7f48c005c910 2020-04-02T23:24:53.852 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.837+0000 7f48dd7fa700 1 -- 172.21.15.42:0/3058018891 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48d8061050 con 0x7f48c0003f80 2020-04-02T23:24:53.852 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.837+0000 7f48dffff700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f48c00558b0 0x7f48c0057d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:53.853 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.837+0000 7f48df7fe700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.42:6800/24836,v1:172.21.15.42:6801/24836] conn(0x7f48c005c910 0x7f48c005ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:53.853 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.837+0000 7f48dffff700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f48c00558b0 0x7f48c0057d70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f48d0002f30 tx=0x7f48d0006de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.853 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.837+0000 7f48dffff700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f48c00558b0 0x7f48c0057d70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f48d0002f30 tx=0x7f48d0006de0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:53.853 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.837+0000 7f48dffff700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f48c00558b0 0x7f48c0057d70 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f48d0002f30 tx=0x7f48d0006de0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:53.853 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.837+0000 7f48df7fe700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.42:6800/24836,v1:172.21.15.42:6801/24836] conn(0x7f48c005c910 0x7f48c005ed30 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:53.853 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.838+0000 7f48dd7fa700 1 -- 172.21.15.42:0/3058018891 <== osd.0 v2:172.21.15.42:6800/24836 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f48c005f2f0 con 0x7f48c005c910 2020-04-02T23:24:53.858 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.856+0000 7f48e6950700 1 -- 172.21.15.42:0/3058018891 --> [v2:172.21.15.42:6800/24836,v1:172.21.15.42:6801/24836] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f48bc0026c0 con 0x7f48c005c910 2020-04-02T23:24:53.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.856+0000 7f48dd7fa700 1 -- 172.21.15.42:0/3058018891 <== osd.0 v2:172.21.15.42:6800/24836 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f48bc0026c0 con 0x7f48c005c910 2020-04-02T23:24:53.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.856+0000 7f48e6950700 1 -- 172.21.15.42:0/3058018891 >> [v2:172.21.15.42:6800/24836,v1:172.21.15.42:6801/24836] conn(0x7f48c005c910 msgr2=0x7f48c005ed30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:53.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.856+0000 7f48e6950700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.42:6800/24836,v1:172.21.15.42:6801/24836] conn(0x7f48c005c910 0x7f48c005ed30 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:53.860 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.857+0000 7f48e6950700 1 -- 172.21.15.42:0/3058018891 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f48c00558b0 msgr2=0x7f48c0057d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:53.860 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.857+0000 7f48e6950700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f48c00558b0 0x7f48c0057d70 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f48d0002f30 tx=0x7f48d0006de0).stop 2020-04-02T23:24:53.860 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.857+0000 7f48e6950700 1 -- 172.21.15.42:0/3058018891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c0003f80 msgr2=0x7f48c0004400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:53.860 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.857+0000 7f48e6950700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c0003f80 0x7f48c0004400 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f48e0065d30 tx=0x7f48d8010bf0).stop 2020-04-02T23:24:53.860 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.857+0000 7f48e6950700 1 -- 172.21.15.42:0/3058018891 shutdown_connections 2020-04-02T23:24:53.860 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.857+0000 7f48e6950700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.42:6800/24836,v1:172.21.15.42:6801/24836] conn(0x7f48c005c910 0x7f48c005ed30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:53.860 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.857+0000 7f48e6950700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f48c00558b0 0x7f48c0057d70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:53.861 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.857+0000 7f48e6950700 1 --2- 172.21.15.42:0/3058018891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c0003f80 0x7f48c0004400 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:53.861 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.857+0000 7f48e6950700 1 -- 172.21.15.42:0/3058018891 >> 172.21.15.42:0/3058018891 conn(0x7f48e005b720 msgr2=0x7f48e0069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:53.861 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.857+0000 7f48e6950700 1 -- 172.21.15.42:0/3058018891 shutdown_connections 2020-04-02T23:24:53.861 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:53.857+0000 7f48e6950700 1 -- 172.21.15.42:0/3058018891 wait complete. 2020-04-02T23:24:53.868 INFO:teuthology.orchestra.run.smithi042.stdout:64424509445 2020-04-02T23:24:53.869 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:53.882 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-04-02T23:24:54.038 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.036+0000 7fd094a1c700 1 Processor -- start 2020-04-02T23:24:54.038 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.036+0000 7fd094a1c700 1 -- start start 2020-04-02T23:24:54.041 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.036+0000 7fd094a1c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd0900a20b0 0x7fd09013d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:54.041 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.036+0000 7fd094a1c700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd09013d640 0x7fd09013fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:54.041 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.036+0000 7fd094a1c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0900a25f0 con 0x7fd0900a1cd0 2020-04-02T23:24:54.041 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.036+0000 7fd094a1c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09009a8f0 con 0x7fd0900a20b0 2020-04-02T23:24:54.041 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.036+0000 7fd094a1c700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09009ab90 con 0x7fd09013d640 2020-04-02T23:24:54.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd08dd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd0900a20b0 0x7fd09013d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd08ed9d700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd09013d640 0x7fd09013fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd08e59c700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd0900a1cd0 0x7fd0900a6340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:53814/0 (socket says 172.21.15.42:53814) 2020-04-02T23:24:54.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd08dd9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd0900a20b0 0x7fd09013d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.42:34504/0 (socket says 172.21.15.42:34504) 2020-04-02T23:24:54.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd08e59c700 1 -- 172.21.15.42:0/3781557141 learned_addr learned my addr 172.21.15.42:0/3781557141 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:54.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd08dd9b700 1 -- 172.21.15.42:0/3781557141 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd09013d640 msgr2=0x7fd09013fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:54.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd08dd9b700 1 --2- 172.21.15.42:0/3781557141 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd09013d640 0x7fd09013fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:54.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd08dd9b700 1 -- 172.21.15.42:0/3781557141 >> v1:172.21.15.84:6789/0 conn(0x7fd0900a1cd0 legacy=0x7fd0900a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd08d59a700 1 -- 172.21.15.42:0/3781557141 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163707341 0 0) 0x7fd0900a25f0 con 0x7fd0900a1cd0 2020-04-02T23:24:54.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd08dd9b700 1 -- 172.21.15.42:0/3781557141 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09009ae30 con 0x7fd0900a20b0 2020-04-02T23:24:54.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd08ed9d700 1 --2- 172.21.15.42:0/3781557141 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd09013d640 0x7fd09013fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:54.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd08dd9b700 1 --2- 172.21.15.42:0/3781557141 >> v2:172.21.15.84:3300/0 conn(0x7fd0900a20b0 0x7fd09013d1e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd0780032b0 tx=0x7fd078007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd08dd9b700 1 --2- 172.21.15.42:0/3781557141 >> v2:172.21.15.84:3300/0 conn(0x7fd0900a20b0 0x7fd09013d1e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd0780032b0 tx=0x7fd078007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd08dd9b700 1 --2- 172.21.15.42:0/3781557141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0900a20b0 0x7fd09013d1e0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fd0780032b0 tx=0x7fd078007dc0).ready entity=mon.1 client_cookie=cdf6c4bed005fff8 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:54.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd08dd9b700 1 --2- 172.21.15.42:0/3781557141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0900a20b0 0x7fd09013d1e0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fd0780032b0 tx=0x7fd078007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.044 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd08d59a700 1 -- 172.21.15.42:0/3781557141 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd078011e20 con 0x7fd0900a20b0 2020-04-02T23:24:54.044 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd08dd9b700 1 --2- 172.21.15.42:0/3781557141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0900a20b0 0x7fd09013d1e0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fd0780032b0 tx=0x7fd078007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.044 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd08d59a700 1 -- 172.21.15.42:0/3781557141 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07800a160 con 0x7fd0900a20b0 2020-04-02T23:24:54.044 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd08dd9b700 1 --2- 172.21.15.42:0/3781557141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0900a20b0 0x7fd09013d1e0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7fd0780032b0 tx=0x7fd078007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.044 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd094a1c700 1 -- 172.21.15.42:0/3781557141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0900a20b0 msgr2=0x7fd09013d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.044 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd08d59a700 1 -- 172.21.15.42:0/3781557141 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd07800a540 con 0x7fd0900a20b0 2020-04-02T23:24:54.044 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.037+0000 7fd094a1c700 1 --2- 172.21.15.42:0/3781557141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0900a20b0 0x7fd09013d1e0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7fd0780032b0 tx=0x7fd078007dc0).stop 2020-04-02T23:24:54.044 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.038+0000 7fd094a1c700 1 -- 172.21.15.42:0/3781557141 shutdown_connections 2020-04-02T23:24:54.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.038+0000 7fd094a1c700 1 --2- 172.21.15.42:0/3781557141 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd09013d640 0x7fd09013fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:54.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.038+0000 7fd094a1c700 1 --2- 172.21.15.42:0/3781557141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0900a20b0 0x7fd09013d1e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.038+0000 7fd094a1c700 1 -- 172.21.15.42:0/3781557141 >> 172.21.15.42:0/3781557141 conn(0x7fd09005b720 msgr2=0x7fd0900aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:54.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.038+0000 7fd094a1c700 1 -- 172.21.15.42:0/3781557141 shutdown_connections 2020-04-02T23:24:54.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.038+0000 7fd094a1c700 1 -- 172.21.15.42:0/3781557141 wait complete. 2020-04-02T23:24:54.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.039+0000 7fd094a1c700 1 Processor -- start 2020-04-02T23:24:54.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.039+0000 7fd094a1c700 1 -- start start 2020-04-02T23:24:54.049 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.039+0000 7fd094a1c700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd0900a20b0 0x7fd0901354e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.049 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.039+0000 7fd094a1c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd09013d640 0x7fd090135940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.049 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd094a1c700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09005f1c0 con 0x7fd0900a1cd0 2020-04-02T23:24:54.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd094a1c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0900653c0 con 0x7fd09013d640 2020-04-02T23:24:54.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd094a1c700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd090065be0 con 0x7fd0900a20b0 2020-04-02T23:24:54.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd08e59c700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd0900a1cd0 0x7fd090063e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59442/0 (socket says 172.21.15.42:59442) 2020-04-02T23:24:54.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd08e59c700 1 -- 172.21.15.42:0/572070890 learned_addr learned my addr 172.21.15.42:0/572070890 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:54.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd08dd9b700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd0900a20b0 0x7fd0901354e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd08ed9d700 1 --2- 172.21.15.42:0/572070890 >> v2:172.21.15.84:3300/0 conn(0x7fd09013d640 0x7fd090135940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd0877fe700 1 -- 172.21.15.42:0/572070890 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791101286 0 0) 0x7fd09005f1c0 con 0x7fd0900a1cd0 2020-04-02T23:24:54.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd0877fe700 1 -- 172.21.15.42:0/572070890 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd074002fe0 con 0x7fd0900a1cd0 2020-04-02T23:24:54.051 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd08ed9d700 1 -- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd0900a20b0 msgr2=0x7fd0901354e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.051 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd08ed9d700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd0900a20b0 0x7fd0901354e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.051 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd08ed9d700 1 -- 172.21.15.42:0/572070890 >> v1:172.21.15.42:6789/0 conn(0x7fd0900a1cd0 legacy=0x7fd090063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.051 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd08ed9d700 1 -- 172.21.15.42:0/572070890 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd090065e80 con 0x7fd09013d640 2020-04-02T23:24:54.051 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd08dd9b700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd0900a20b0 0x7fd0901354e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:54.051 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd08ed9d700 1 --2- 172.21.15.42:0/572070890 >> v2:172.21.15.84:3300/0 conn(0x7fd09013d640 0x7fd090135940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd080002f30 tx=0x7fd080010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.051 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd08ed9d700 1 --2- 172.21.15.42:0/572070890 >> v2:172.21.15.84:3300/0 conn(0x7fd09013d640 0x7fd090135940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd080002f30 tx=0x7fd080010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.052 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd08ed9d700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09013d640 0x7fd090135940 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7fd080002f30 tx=0x7fd080010cc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:54.052 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd08ed9d700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09013d640 0x7fd090135940 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fd080002f30 tx=0x7fd080010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.052 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd0877fe700 1 -- 172.21.15.42:0/572070890 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd080005e90 con 0x7fd09013d640 2020-04-02T23:24:54.052 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd08ed9d700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09013d640 0x7fd090135940 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fd080002f30 tx=0x7fd080010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.052 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd0877fe700 1 -- 172.21.15.42:0/572070890 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd080007160 con 0x7fd09013d640 2020-04-02T23:24:54.052 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd08ed9d700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09013d640 0x7fd090135940 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fd080002f30 tx=0x7fd080010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.052 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd094a1c700 1 -- 172.21.15.42:0/572070890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0900657f0 con 0x7fd09013d640 2020-04-02T23:24:54.052 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.040+0000 7fd0877fe700 1 -- 172.21.15.42:0/572070890 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd080007580 con 0x7fd09013d640 2020-04-02T23:24:54.053 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.041+0000 7fd094a1c700 1 -- 172.21.15.42:0/572070890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0901462f0 con 0x7fd09013d640 2020-04-02T23:24:54.053 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.041+0000 7fd08ed9d700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09013d640 0x7fd090135940 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fd080002f30 tx=0x7fd080010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.053 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.041+0000 7fd094a1c700 1 -- 172.21.15.42:0/572070890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd090066080 con 0x7fd09013d640 2020-04-02T23:24:54.053 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.042+0000 7fd0877fe700 1 -- 172.21.15.42:0/572070890 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd080010170 con 0x7fd09013d640 2020-04-02T23:24:54.053 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.042+0000 7fd08ed9d700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09013d640 0x7fd090135940 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fd080002f30 tx=0x7fd080010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.053 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.042+0000 7fd08ed9d700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09013d640 0x7fd090135940 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7fd080002f30 tx=0x7fd080010cc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.053 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.042+0000 7fd0877fe700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd07404d8e0 0x7fd07404fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.054 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.042+0000 7fd0877fe700 1 -- 172.21.15.42:0/572070890 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd080061280 con 0x7fd09013d640 2020-04-02T23:24:54.054 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.042+0000 7fd0877fe700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.42:6808/24881,v1:172.21.15.42:6809/24881] conn(0x7fd074054780 0x7fd074056ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.054 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.042+0000 7fd0877fe700 1 -- 172.21.15.42:0/572070890 --> [v2:172.21.15.42:6808/24881,v1:172.21.15.42:6809/24881] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd074057160 con 0x7fd074054780 2020-04-02T23:24:54.054 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.042+0000 7fd0877fe700 1 -- 172.21.15.42:0/572070890 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0800627a0 con 0x7fd09013d640 2020-04-02T23:24:54.054 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.042+0000 7fd08e59c700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd07404d8e0 0x7fd07404fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.054 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.042+0000 7fd08dd9b700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.42:6808/24881,v1:172.21.15.42:6809/24881] conn(0x7fd074054780 0x7fd074056ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.054 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.042+0000 7fd08e59c700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd07404d8e0 0x7fd07404fda0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd088000ff0 tx=0x7fd0880016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.054 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.042+0000 7fd08dd9b700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.42:6808/24881,v1:172.21.15.42:6809/24881] conn(0x7fd074054780 0x7fd074056ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:54.055 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.042+0000 7fd08e59c700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd07404d8e0 0x7fd07404fda0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd088000ff0 tx=0x7fd0880016e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.055 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.042+0000 7fd08e59c700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd07404d8e0 0x7fd07404fda0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fd088000ff0 tx=0x7fd0880016e0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:54.055 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.043+0000 7fd0877fe700 1 -- 172.21.15.42:0/572070890 <== osd.1 v2:172.21.15.42:6808/24881 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fd074057160 con 0x7fd074054780 2020-04-02T23:24:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.061+0000 7fd094a1c700 1 -- 172.21.15.42:0/572070890 --> [v2:172.21.15.42:6808/24881,v1:172.21.15.42:6809/24881] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd09005d2e0 con 0x7fd074054780 2020-04-02T23:24:54.064 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.061+0000 7fd0877fe700 1 -- 172.21.15.42:0/572070890 <== osd.1 v2:172.21.15.42:6808/24881 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd09005d2e0 con 0x7fd074054780 2020-04-02T23:24:54.064 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.062+0000 7fd094a1c700 1 -- 172.21.15.42:0/572070890 >> [v2:172.21.15.42:6808/24881,v1:172.21.15.42:6809/24881] conn(0x7fd074054780 msgr2=0x7fd074056ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.064 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.062+0000 7fd094a1c700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.42:6808/24881,v1:172.21.15.42:6809/24881] conn(0x7fd074054780 0x7fd074056ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.065 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.062+0000 7fd094a1c700 1 -- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd07404d8e0 msgr2=0x7fd07404fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.065 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.062+0000 7fd094a1c700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd07404d8e0 0x7fd07404fda0 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7fd088000ff0 tx=0x7fd0880016e0).stop 2020-04-02T23:24:54.065 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.062+0000 7fd094a1c700 1 -- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09013d640 msgr2=0x7fd090135940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.065 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.062+0000 7fd094a1c700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09013d640 0x7fd090135940 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7fd080002f30 tx=0x7fd080010cc0).stop 2020-04-02T23:24:54.065 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.062+0000 7fd08ed9d700 1 -- 172.21.15.42:0/572070890 reap_dead start 2020-04-02T23:24:54.065 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.062+0000 7fd094a1c700 1 -- 172.21.15.42:0/572070890 shutdown_connections 2020-04-02T23:24:54.066 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.062+0000 7fd094a1c700 1 --2- 172.21.15.42:0/572070890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd09013d640 0x7fd090135940 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.066 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.062+0000 7fd094a1c700 1 -- 172.21.15.42:0/572070890 >> 172.21.15.42:0/572070890 conn(0x7fd09005b720 msgr2=0x7fd0900a7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:54.066 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.062+0000 7fd094a1c700 1 -- 172.21.15.42:0/572070890 shutdown_connections 2020-04-02T23:24:54.066 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.062+0000 7fd094a1c700 1 -- 172.21.15.42:0/572070890 wait complete. 2020-04-02T23:24:54.074 INFO:teuthology.orchestra.run.smithi042.stdout:64424509447 2020-04-02T23:24:54.074 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:54.088 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-04-02T23:24:54.242 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.240+0000 7fd4e5577700 1 Processor -- start 2020-04-02T23:24:54.242 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.240+0000 7fd4e5577700 1 -- start start 2020-04-02T23:24:54.250 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.241+0000 7fd4e5577700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd4e00ab410 0x7fd4e00a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:54.251 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.241+0000 7fd4e5577700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e00a31b0 con 0x7fd4e00a6a90 2020-04-02T23:24:54.251 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.241+0000 7fd4e5577700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e00a49f0 con 0x7fd4e00a23e0 2020-04-02T23:24:54.251 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.241+0000 7fd4e5577700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e005ff40 con 0x7fd4e00ab410 2020-04-02T23:24:54.251 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.241+0000 7fd4de7fc700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd4e00a6a90 0x7fd4e00a1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59452/0 (socket says 172.21.15.42:59452) 2020-04-02T23:24:54.251 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.241+0000 7fd4de7fc700 1 -- 172.21.15.42:0/2318021000 learned_addr learned my addr 172.21.15.42:0/2318021000 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:54.251 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.241+0000 7fd4deffd700 1 --2- 172.21.15.42:0/2318021000 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd4e00ab410 0x7fd4e00a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.252 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.241+0000 7fd4ddffb700 1 -- 172.21.15.42:0/2318021000 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930304320 0 0) 0x7fd4e00a31b0 con 0x7fd4e00a6a90 2020-04-02T23:24:54.252 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.241+0000 7fd4ddffb700 1 -- 172.21.15.42:0/2318021000 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4c0003230 con 0x7fd4e00a6a90 2020-04-02T23:24:54.252 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4ddffb700 1 -- 172.21.15.42:0/2318021000 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783661277 0 0) 0x7fd4e00a49f0 con 0x7fd4e00a23e0 2020-04-02T23:24:54.252 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4ddffb700 1 -- 172.21.15.42:0/2318021000 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4e00a31b0 con 0x7fd4e00a23e0 2020-04-02T23:24:54.252 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4ddffb700 1 -- 172.21.15.42:0/2318021000 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2511164487 0 0) 0x7fd4c0003230 con 0x7fd4e00a6a90 2020-04-02T23:24:54.252 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4ddffb700 1 -- 172.21.15.42:0/2318021000 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd4e00ab410 msgr2=0x7fd4e00a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:54.252 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4ddffb700 1 --2- 172.21.15.42:0/2318021000 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd4e00ab410 0x7fd4e00a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:54.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4ddffb700 1 -- 172.21.15.42:0/2318021000 >> v1:172.21.15.84:6789/0 conn(0x7fd4e00a23e0 legacy=0x7fd4e0140410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4ddffb700 1 -- 172.21.15.42:0/2318021000 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e00a3420 con 0x7fd4e00a6a90 2020-04-02T23:24:54.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4ddffb700 1 -- 172.21.15.42:0/2318021000 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7fd4d00016d0 con 0x7fd4e00a6a90 2020-04-02T23:24:54.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4ddffb700 1 -- 172.21.15.42:0/2318021000 >> v1:172.21.15.42:6789/0 conn(0x7fd4e00a6a90 legacy=0x7fd4e00a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4ddffb700 1 --2- 172.21.15.42:0/2318021000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4c00038e0 0x7fd4c0003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:54.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4ddffb700 1 --2- 172.21.15.42:0/2318021000 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd4e00ab410 0x7fd4c00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:54.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4ddffb700 1 --2- 172.21.15.42:0/2318021000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4c0004930 0x7fd4c0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:54.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4ddffb700 1 -- 172.21.15.42:0/2318021000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e005ff40 con 0x7fd4c0004930 2020-04-02T23:24:54.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4ddffb700 1 -- 172.21.15.42:0/2318021000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c0005210 con 0x7fd4c00038e0 2020-04-02T23:24:54.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4ddffb700 1 -- 172.21.15.42:0/2318021000 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c000b720 con 0x7fd4e00ab410 2020-04-02T23:24:54.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4df7fe700 1 --2- 172.21.15.42:0/2318021000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4c0004930 0x7fd4c0004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4de7fc700 1 --2- 172.21.15.42:0/2318021000 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd4e00ab410 0x7fd4c00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.255 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4deffd700 1 --2- 172.21.15.42:0/2318021000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4c00038e0 0x7fd4c0003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.255 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4df7fe700 1 -- 172.21.15.42:0/2318021000 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd4e00ab410 msgr2=0x7fd4c00044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:54.255 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4df7fe700 1 --2- 172.21.15.42:0/2318021000 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd4e00ab410 0x7fd4c00044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:54.255 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4df7fe700 1 -- 172.21.15.42:0/2318021000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4c00038e0 msgr2=0x7fd4c0003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:54.255 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4df7fe700 1 --2- 172.21.15.42:0/2318021000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4c00038e0 0x7fd4c0003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:54.255 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4df7fe700 1 -- 172.21.15.42:0/2318021000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c0003230 con 0x7fd4c0004930 2020-04-02T23:24:54.255 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4deffd700 1 --2- 172.21.15.42:0/2318021000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4c00038e0 0x7fd4c0003ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:24:54.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4df7fe700 1 --2- 172.21.15.42:0/2318021000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4c0004930 0x7fd4c0004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd4d8001450 tx=0x7fd4d800c230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4df7fe700 1 --2- 172.21.15.42:0/2318021000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4c0004930 0x7fd4c0004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd4d8001450 tx=0x7fd4d800c230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4df7fe700 1 --2- 172.21.15.42:0/2318021000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4c0004930 0x7fd4c0004db0 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7fd4d8001450 tx=0x7fd4d800c230).ready entity=mon.0 client_cookie=c7d798fd179f0d9c server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:54.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4df7fe700 1 --2- 172.21.15.42:0/2318021000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4c0004930 0x7fd4c0004db0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fd4d8001450 tx=0x7fd4d800c230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4ddffb700 1 -- 172.21.15.42:0/2318021000 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4d8001e40 con 0x7fd4c0004930 2020-04-02T23:24:54.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4df7fe700 1 --2- 172.21.15.42:0/2318021000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4c0004930 0x7fd4c0004db0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fd4d8001450 tx=0x7fd4d800c230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.257 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4df7fe700 1 --2- 172.21.15.42:0/2318021000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4c0004930 0x7fd4c0004db0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fd4d8001450 tx=0x7fd4d800c230).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.257 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4ddffb700 1 -- 172.21.15.42:0/2318021000 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d800cde0 con 0x7fd4c0004930 2020-04-02T23:24:54.257 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4ddffb700 1 -- 172.21.15.42:0/2318021000 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4d80114c0 con 0x7fd4c0004930 2020-04-02T23:24:54.257 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4e5577700 1 -- 172.21.15.42:0/2318021000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4c0004930 msgr2=0x7fd4c0004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.257 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4e5577700 1 --2- 172.21.15.42:0/2318021000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4c0004930 0x7fd4c0004db0 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7fd4d8001450 tx=0x7fd4d800c230).stop 2020-04-02T23:24:54.257 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.242+0000 7fd4df7fe700 1 -- 172.21.15.42:0/2318021000 reap_dead start 2020-04-02T23:24:54.257 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.243+0000 7fd4e5577700 1 -- 172.21.15.42:0/2318021000 shutdown_connections 2020-04-02T23:24:54.257 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.243+0000 7fd4e5577700 1 -- 172.21.15.42:0/2318021000 >> 172.21.15.42:0/2318021000 conn(0x7fd4e005b720 msgr2=0x7fd4e00aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:54.258 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.243+0000 7fd4e5577700 1 -- 172.21.15.42:0/2318021000 shutdown_connections 2020-04-02T23:24:54.258 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.243+0000 7fd4e5577700 1 -- 172.21.15.42:0/2318021000 wait complete. 2020-04-02T23:24:54.258 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.244+0000 7fd4e5577700 1 Processor -- start 2020-04-02T23:24:54.258 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.244+0000 7fd4e5577700 1 -- start start 2020-04-02T23:24:54.258 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.244+0000 7fd4e5577700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd4e009dbd0 0x7fd4e0065770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.258 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4e5577700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e0061800 con 0x7fd4e0142f40 2020-04-02T23:24:54.259 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4e5577700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e01433e0 con 0x7fd4e00634d0 2020-04-02T23:24:54.259 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4e5577700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e0143680 con 0x7fd4e009dbd0 2020-04-02T23:24:54.259 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4deffd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd4e009dbd0 0x7fd4e0065770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.259 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4de7fc700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd4e0142f40 0x7fd4e00610f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59466/0 (socket says 172.21.15.42:59466) 2020-04-02T23:24:54.259 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4deffd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd4e009dbd0 0x7fd4e0065770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40040/0 (socket says 172.21.15.42:40040) 2020-04-02T23:24:54.259 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4de7fc700 1 -- 172.21.15.42:0/2728626786 learned_addr learned my addr 172.21.15.42:0/2728626786 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:54.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4deffd700 1 -- 172.21.15.42:0/2728626786 >> v1:172.21.15.84:6789/0 conn(0x7fd4e00634d0 legacy=0x7fd4e0063980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4d7fff700 1 -- 172.21.15.42:0/2728626786 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947445445 0 0) 0x7fd4e0061800 con 0x7fd4e0142f40 2020-04-02T23:24:54.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4deffd700 1 -- 172.21.15.42:0/2728626786 >> v1:172.21.15.42:6789/0 conn(0x7fd4e0142f40 legacy=0x7fd4e00610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4deffd700 1 -- 172.21.15.42:0/2728626786 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e0143920 con 0x7fd4e009dbd0 2020-04-02T23:24:54.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4deffd700 1 --2- 172.21.15.42:0/2728626786 >> v2:172.21.15.42:3300/0 conn(0x7fd4e009dbd0 0x7fd4e0065770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4e0065100 tx=0x7fd4c8012d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4deffd700 1 --2- 172.21.15.42:0/2728626786 >> v2:172.21.15.42:3300/0 conn(0x7fd4e009dbd0 0x7fd4e0065770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4e0065100 tx=0x7fd4c8012d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4deffd700 1 --2- 172.21.15.42:0/2728626786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4e009dbd0 0x7fd4e0065770 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7fd4e0065100 tx=0x7fd4c8012d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:54.261 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4deffd700 1 --2- 172.21.15.42:0/2728626786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4e009dbd0 0x7fd4e0065770 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fd4e0065100 tx=0x7fd4c8012d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.261 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4d7fff700 1 -- 172.21.15.42:0/2728626786 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4c8005e90 con 0x7fd4e009dbd0 2020-04-02T23:24:54.261 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4deffd700 1 --2- 172.21.15.42:0/2728626786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4e009dbd0 0x7fd4e0065770 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fd4e0065100 tx=0x7fd4c8012d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.261 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4deffd700 1 --2- 172.21.15.42:0/2728626786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4e009dbd0 0x7fd4e0065770 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fd4e0065100 tx=0x7fd4c8012d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.261 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4d7fff700 1 -- 172.21.15.42:0/2728626786 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c8007160 con 0x7fd4e009dbd0 2020-04-02T23:24:54.261 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4d7fff700 1 -- 172.21.15.42:0/2728626786 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4c8007500 con 0x7fd4e009dbd0 2020-04-02T23:24:54.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4e5577700 1 -- 172.21.15.42:0/2728626786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e0143dc0 con 0x7fd4e009dbd0 2020-04-02T23:24:54.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.245+0000 7fd4e5577700 1 -- 172.21.15.42:0/2728626786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e00a5320 con 0x7fd4e009dbd0 2020-04-02T23:24:54.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.246+0000 7fd4deffd700 1 --2- 172.21.15.42:0/2728626786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4e009dbd0 0x7fd4e0065770 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fd4e0065100 tx=0x7fd4c8012d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.246+0000 7fd4e5577700 1 -- 172.21.15.42:0/2728626786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd4e0143b20 con 0x7fd4e009dbd0 2020-04-02T23:24:54.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.246+0000 7fd4d7fff700 1 -- 172.21.15.42:0/2728626786 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd4c8014410 con 0x7fd4e009dbd0 2020-04-02T23:24:54.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.246+0000 7fd4deffd700 1 --2- 172.21.15.42:0/2728626786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4e009dbd0 0x7fd4e0065770 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fd4e0065100 tx=0x7fd4c8012d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.246+0000 7fd4deffd700 1 --2- 172.21.15.42:0/2728626786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4e009dbd0 0x7fd4e0065770 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7fd4e0065100 tx=0x7fd4c8012d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.247+0000 7fd4d7fff700 1 --2- 172.21.15.42:0/2728626786 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd4c404d460 0x7fd4c404f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.247+0000 7fd4d7fff700 1 -- 172.21.15.42:0/2728626786 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd4c80635d0 con 0x7fd4e009dbd0 2020-04-02T23:24:54.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.247+0000 7fd4d7fff700 1 --2- 172.21.15.42:0/2728626786 >> [v2:172.21.15.42:6816/24917,v1:172.21.15.42:6817/24917] conn(0x7fd4c4054490 0x7fd4c40568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.247+0000 7fd4d7fff700 1 -- 172.21.15.42:0/2728626786 --> [v2:172.21.15.42:6816/24917,v1:172.21.15.42:6817/24917] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4c4056e70 con 0x7fd4c4054490 2020-04-02T23:24:54.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.247+0000 7fd4d7fff700 1 -- 172.21.15.42:0/2728626786 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4c8064a90 con 0x7fd4e009dbd0 2020-04-02T23:24:54.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.247+0000 7fd4de7fc700 1 --2- 172.21.15.42:0/2728626786 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd4c404d460 0x7fd4c404f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.247+0000 7fd4df7fe700 1 --2- 172.21.15.42:0/2728626786 >> [v2:172.21.15.42:6816/24917,v1:172.21.15.42:6817/24917] conn(0x7fd4c4054490 0x7fd4c40568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.264 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.247+0000 7fd4de7fc700 1 --2- 172.21.15.42:0/2728626786 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd4c404d460 0x7fd4c404f920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4d000e950 tx=0x7fd4e00ab7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.264 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.247+0000 7fd4de7fc700 1 --2- 172.21.15.42:0/2728626786 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd4c404d460 0x7fd4c404f920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4d000e950 tx=0x7fd4e00ab7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.264 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.247+0000 7fd4de7fc700 1 --2- 172.21.15.42:0/2728626786 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd4c404d460 0x7fd4c404f920 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fd4d000e950 tx=0x7fd4e00ab7f0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:54.264 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.247+0000 7fd4df7fe700 1 --2- 172.21.15.42:0/2728626786 >> [v2:172.21.15.42:6816/24917,v1:172.21.15.42:6817/24917] conn(0x7fd4c4054490 0x7fd4c40568b0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:54.264 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.248+0000 7fd4d7fff700 1 -- 172.21.15.42:0/2728626786 <== osd.2 v2:172.21.15.42:6816/24917 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fd4c4056e70 con 0x7fd4c4054490 2020-04-02T23:24:54.268 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.265+0000 7fd4e5577700 1 -- 172.21.15.42:0/2728626786 --> [v2:172.21.15.42:6816/24917,v1:172.21.15.42:6817/24917] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd4e00a91e0 con 0x7fd4c4054490 2020-04-02T23:24:54.268 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.266+0000 7fd4d7fff700 1 -- 172.21.15.42:0/2728626786 <== osd.2 v2:172.21.15.42:6816/24917 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd4e00a91e0 con 0x7fd4c4054490 2020-04-02T23:24:54.269 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.266+0000 7fd4e5577700 1 -- 172.21.15.42:0/2728626786 >> [v2:172.21.15.42:6816/24917,v1:172.21.15.42:6817/24917] conn(0x7fd4c4054490 msgr2=0x7fd4c40568b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.269 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.266+0000 7fd4e5577700 1 --2- 172.21.15.42:0/2728626786 >> [v2:172.21.15.42:6816/24917,v1:172.21.15.42:6817/24917] conn(0x7fd4c4054490 0x7fd4c40568b0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.269 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.266+0000 7fd4e5577700 1 -- 172.21.15.42:0/2728626786 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd4c404d460 msgr2=0x7fd4c404f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.269 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.266+0000 7fd4e5577700 1 --2- 172.21.15.42:0/2728626786 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd4c404d460 0x7fd4c404f920 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7fd4d000e950 tx=0x7fd4e00ab7f0).stop 2020-04-02T23:24:54.269 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.266+0000 7fd4e5577700 1 -- 172.21.15.42:0/2728626786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4e009dbd0 msgr2=0x7fd4e0065770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.269 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.266+0000 7fd4e5577700 1 --2- 172.21.15.42:0/2728626786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4e009dbd0 0x7fd4e0065770 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7fd4e0065100 tx=0x7fd4c8012d60).stop 2020-04-02T23:24:54.270 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.266+0000 7fd4df7fe700 1 -- 172.21.15.42:0/2728626786 reap_dead start 2020-04-02T23:24:54.270 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.266+0000 7fd4e5577700 1 -- 172.21.15.42:0/2728626786 shutdown_connections 2020-04-02T23:24:54.270 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.266+0000 7fd4e5577700 1 --2- 172.21.15.42:0/2728626786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4e009dbd0 0x7fd4e0065770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.270 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.266+0000 7fd4e5577700 1 -- 172.21.15.42:0/2728626786 >> 172.21.15.42:0/2728626786 conn(0x7fd4e005b720 msgr2=0x7fd4e0139a30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:54.270 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.266+0000 7fd4e5577700 1 -- 172.21.15.42:0/2728626786 shutdown_connections 2020-04-02T23:24:54.270 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.266+0000 7fd4e5577700 1 -- 172.21.15.42:0/2728626786 wait complete. 2020-04-02T23:24:54.278 INFO:teuthology.orchestra.run.smithi042.stdout:64424509445 2020-04-02T23:24:54.278 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:54.292 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-04-02T23:24:54.445 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.443+0000 7f48cc595700 1 Processor -- start 2020-04-02T23:24:54.446 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.443+0000 7f48cc595700 1 -- start start 2020-04-02T23:24:54.453 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.444+0000 7f48cc595700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f48c40ab410 0x7f48c40a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:54.453 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.444+0000 7f48cc595700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c40a23e0 0x7f48c40a2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:54.454 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.444+0000 7f48cc595700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c40a31b0 con 0x7f48c40a6a90 2020-04-02T23:24:54.454 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.444+0000 7f48cc595700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c40a49f0 con 0x7f48c40ab410 2020-04-02T23:24:54.454 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.444+0000 7f48cc595700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c405ff40 con 0x7f48c40a23e0 2020-04-02T23:24:54.454 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.444+0000 7f48c9b30700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f48c40a6a90 0x7f48c40a1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59474/0 (socket says 172.21.15.42:59474) 2020-04-02T23:24:54.454 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.444+0000 7f48c9b30700 1 -- 172.21.15.42:0/2047752715 learned_addr learned my addr 172.21.15.42:0/2047752715 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:54.454 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.444+0000 7f48cab32700 1 --2- 172.21.15.42:0/2047752715 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c40a23e0 0x7f48c40a2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.455 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48ca331700 1 --2- 172.21.15.42:0/2047752715 >> v2:172.21.15.84:3300/0 conn(0x7f48c40ab410 0x7f48c40a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.455 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48c932f700 1 -- 172.21.15.42:0/2047752715 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1858398941 0 0) 0x7f48c40a31b0 con 0x7f48c40a6a90 2020-04-02T23:24:54.455 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48c932f700 1 -- 172.21.15.42:0/2047752715 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48ac003230 con 0x7f48c40a6a90 2020-04-02T23:24:54.455 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48c932f700 1 -- 172.21.15.42:0/2047752715 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3115890087 0 0) 0x7f48ac003230 con 0x7f48c40a6a90 2020-04-02T23:24:54.455 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48c932f700 1 -- 172.21.15.42:0/2047752715 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c40a23e0 msgr2=0x7f48c40a2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:54.455 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48c932f700 1 --2- 172.21.15.42:0/2047752715 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c40a23e0 0x7f48c40a2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:54.455 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48c932f700 1 -- 172.21.15.42:0/2047752715 >> v2:172.21.15.84:3300/0 conn(0x7f48c40ab410 msgr2=0x7f48c40a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:54.455 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48c932f700 1 --2- 172.21.15.42:0/2047752715 >> v2:172.21.15.84:3300/0 conn(0x7f48c40ab410 0x7f48c40a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:54.456 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48c932f700 1 -- 172.21.15.42:0/2047752715 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c40a3420 con 0x7f48c40a6a90 2020-04-02T23:24:54.456 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48c932f700 1 -- 172.21.15.42:0/2047752715 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7f48c00016d0 con 0x7f48c40a6a90 2020-04-02T23:24:54.456 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48c932f700 1 -- 172.21.15.42:0/2047752715 >> v1:172.21.15.42:6789/0 conn(0x7f48c40a6a90 legacy=0x7f48c40a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.456 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48c932f700 1 --2- 172.21.15.42:0/2047752715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48ac003720 0x7f48ac003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:54.456 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48c932f700 1 --2- 172.21.15.42:0/2047752715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48ac004060 0x7f48ac004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:54.456 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48c932f700 1 --2- 172.21.15.42:0/2047752715 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c40a23e0 0x7f48ac004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:54.457 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48c932f700 1 -- 172.21.15.42:0/2047752715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c40a49f0 con 0x7f48ac003720 2020-04-02T23:24:54.457 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48c932f700 1 -- 172.21.15.42:0/2047752715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c405ff40 con 0x7f48ac004060 2020-04-02T23:24:54.457 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48c932f700 1 -- 172.21.15.42:0/2047752715 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac004ff0 con 0x7f48c40a23e0 2020-04-02T23:24:54.457 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48ca331700 1 --2- 172.21.15.42:0/2047752715 >> v2:172.21.15.84:3300/0 conn(0x7f48c40ab410 0x7f48c40a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:54.463 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48cab32700 1 --2- 172.21.15.42:0/2047752715 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c40a23e0 0x7f48ac004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.463 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48c9b30700 1 --2- 172.21.15.42:0/2047752715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48ac004060 0x7f48ac004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.463 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48ca331700 1 --2- 172.21.15.42:0/2047752715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48ac003720 0x7f48ac003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.463 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48cab32700 1 -- 172.21.15.42:0/2047752715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48ac004060 msgr2=0x7f48ac004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:54.463 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48cab32700 1 --2- 172.21.15.42:0/2047752715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48ac004060 0x7f48ac004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:54.463 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48cab32700 1 -- 172.21.15.42:0/2047752715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48ac003720 msgr2=0x7f48ac003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:54.464 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48cab32700 1 --2- 172.21.15.42:0/2047752715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48ac003720 0x7f48ac003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:54.464 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48cab32700 1 -- 172.21.15.42:0/2047752715 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac003230 con 0x7f48c40a23e0 2020-04-02T23:24:54.464 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.445+0000 7f48ca331700 1 --2- 172.21.15.42:0/2047752715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48ac003720 0x7f48ac003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:54.464 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.446+0000 7f48cab32700 1 --2- 172.21.15.42:0/2047752715 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c40a23e0 0x7f48ac004ac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f48bc008c90 tx=0x7f48bc0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.464 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.446+0000 7f48cab32700 1 --2- 172.21.15.42:0/2047752715 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c40a23e0 0x7f48ac004ac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f48bc008c90 tx=0x7f48bc0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.464 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.446+0000 7f48cab32700 1 --2- 172.21.15.42:0/2047752715 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c40a23e0 0x7f48ac004ac0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f48bc008c90 tx=0x7f48bc0103d0).ready entity=mon.2 client_cookie=8b13e2b6e0c5881a server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.446+0000 7f48cab32700 1 --2- 172.21.15.42:0/2047752715 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c40a23e0 0x7f48ac004ac0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f48bc008c90 tx=0x7f48bc0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.446+0000 7f48c932f700 1 -- 172.21.15.42:0/2047752715 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48bc0110c0 con 0x7f48c40a23e0 2020-04-02T23:24:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.446+0000 7f48cab32700 1 --2- 172.21.15.42:0/2047752715 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c40a23e0 0x7f48ac004ac0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f48bc008c90 tx=0x7f48bc0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.446+0000 7f48cab32700 1 --2- 172.21.15.42:0/2047752715 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c40a23e0 0x7f48ac004ac0 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f48bc008c90 tx=0x7f48bc0103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.446+0000 7f48c932f700 1 -- 172.21.15.42:0/2047752715 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48bc011220 con 0x7f48c40a23e0 2020-04-02T23:24:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.446+0000 7f48c932f700 1 -- 172.21.15.42:0/2047752715 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48bc011600 con 0x7f48c40a23e0 2020-04-02T23:24:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.446+0000 7f48cc595700 1 -- 172.21.15.42:0/2047752715 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c40a23e0 msgr2=0x7f48ac004ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.446+0000 7f48cc595700 1 --2- 172.21.15.42:0/2047752715 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c40a23e0 0x7f48ac004ac0 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f48bc008c90 tx=0x7f48bc0103d0).stop 2020-04-02T23:24:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.446+0000 7f48cab32700 1 -- 172.21.15.42:0/2047752715 reap_dead start 2020-04-02T23:24:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.446+0000 7f48cc595700 1 -- 172.21.15.42:0/2047752715 shutdown_connections 2020-04-02T23:24:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.446+0000 7f48cc595700 1 -- 172.21.15.42:0/2047752715 >> 172.21.15.42:0/2047752715 conn(0x7f48c405b720 msgr2=0x7f48c40aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.446+0000 7f48cc595700 1 -- 172.21.15.42:0/2047752715 shutdown_connections 2020-04-02T23:24:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.446+0000 7f48cc595700 1 -- 172.21.15.42:0/2047752715 wait complete. 2020-04-02T23:24:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.447+0000 7f48cc595700 1 Processor -- start 2020-04-02T23:24:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.447+0000 7f48cc595700 1 -- start start 2020-04-02T23:24:54.467 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.448+0000 7f48cc595700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f48c4066440 0x7f48c4064b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.467 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.448+0000 7f48cc595700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f48c4064fa0 0x7f48c40a5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.467 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.448+0000 7f48cc595700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c40a5780 0x7f48c40a5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.467 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.448+0000 7f48cc595700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c405efb0 con 0x7f48c4064fa0 2020-04-02T23:24:54.467 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.448+0000 7f48cc595700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c408fde0 con 0x7f48c4066440 2020-04-02T23:24:54.467 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.448+0000 7f48cc595700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c4090080 con 0x7f48c40a5780 2020-04-02T23:24:54.467 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.448+0000 7f48c9b30700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f48c4064fa0 0x7f48c40a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.468 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.448+0000 7f48c9b30700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f48c4064fa0 0x7f48c40a5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40060/0 (socket says 172.21.15.42:40060) 2020-04-02T23:24:54.468 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.448+0000 7f48c9b30700 1 -- 172.21.15.42:0/2739152728 learned_addr learned my addr 172.21.15.42:0/2739152728 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:54.468 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.448+0000 7f48ca331700 1 --2- 172.21.15.42:0/2739152728 >> v2:172.21.15.84:3300/0 conn(0x7f48c4066440 0x7f48c4064b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.468 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.448+0000 7f48cab32700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c40a5780 0x7f48c40a5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.468 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.448+0000 7f48c9b30700 1 -- 172.21.15.42:0/2739152728 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c40a5780 msgr2=0x7f48c40a5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.468 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.448+0000 7f48c9b30700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f48c40a5780 0x7f48c40a5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.468 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.448+0000 7f48c9b30700 1 -- 172.21.15.42:0/2739152728 >> v2:172.21.15.84:3300/0 conn(0x7f48c4066440 msgr2=0x7f48c4064b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.448+0000 7f48c9b30700 1 --2- 172.21.15.42:0/2739152728 >> v2:172.21.15.84:3300/0 conn(0x7f48c4066440 0x7f48c4064b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.448+0000 7f48c9b30700 1 -- 172.21.15.42:0/2739152728 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c409fd00 con 0x7f48c4064fa0 2020-04-02T23:24:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.448+0000 7f48c9b30700 1 --2- 172.21.15.42:0/2739152728 >> v2:172.21.15.42:3300/0 conn(0x7f48c4064fa0 0x7f48c40a5320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f48c00013e0 tx=0x7f48c40ab7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.448+0000 7f48c9b30700 1 --2- 172.21.15.42:0/2739152728 >> v2:172.21.15.42:3300/0 conn(0x7f48c4064fa0 0x7f48c40a5320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f48c00013e0 tx=0x7f48c40ab7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.448+0000 7f48c9b30700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c4064fa0 0x7f48c40a5320 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f48c00013e0 tx=0x7f48c40ab7f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.449+0000 7f48c9b30700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c4064fa0 0x7f48c40a5320 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f48c00013e0 tx=0x7f48c40ab7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.449+0000 7f48c9b30700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c4064fa0 0x7f48c40a5320 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f48c00013e0 tx=0x7f48c40ab7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.449+0000 7f48b77fe700 1 -- 172.21.15.42:0/2739152728 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48c0011c90 con 0x7f48c4064fa0 2020-04-02T23:24:54.470 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.449+0000 7f48c9b30700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c4064fa0 0x7f48c40a5320 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f48c00013e0 tx=0x7f48c40ab7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.470 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.449+0000 7f48b77fe700 1 -- 172.21.15.42:0/2739152728 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c0011df0 con 0x7f48c4064fa0 2020-04-02T23:24:54.470 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.449+0000 7f48cc595700 1 -- 172.21.15.42:0/2739152728 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c408fad0 con 0x7f48c4064fa0 2020-04-02T23:24:54.470 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.449+0000 7f48b77fe700 1 -- 172.21.15.42:0/2739152728 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48c000ca80 con 0x7f48c4064fa0 2020-04-02T23:24:54.470 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.449+0000 7f48cc595700 1 -- 172.21.15.42:0/2739152728 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c40a6070 con 0x7f48c4064fa0 2020-04-02T23:24:54.470 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.449+0000 7f48c9b30700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c4064fa0 0x7f48c40a5320 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f48c00013e0 tx=0x7f48c40ab7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.470 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.450+0000 7f48cc595700 1 -- 172.21.15.42:0/2739152728 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f48c4090280 con 0x7f48c4064fa0 2020-04-02T23:24:54.471 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.450+0000 7f48b77fe700 1 -- 172.21.15.42:0/2739152728 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f48c000ccf0 con 0x7f48c4064fa0 2020-04-02T23:24:54.471 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.450+0000 7f48c9b30700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c4064fa0 0x7f48c40a5320 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f48c00013e0 tx=0x7f48c40ab7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.471 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.450+0000 7f48c9b30700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c4064fa0 0x7f48c40a5320 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f48c00013e0 tx=0x7f48c40ab7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.471 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.450+0000 7f48b77fe700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f48a404d660 0x7f48a404fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.471 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.450+0000 7f48b77fe700 1 -- 172.21.15.42:0/2739152728 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f48c0060b20 con 0x7f48c4064fa0 2020-04-02T23:24:54.471 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.450+0000 7f48b77fe700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.42:6824/24940,v1:172.21.15.42:6825/24940] conn(0x7f48a4054900 0x7f48a4056d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.471 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.450+0000 7f48b77fe700 1 -- 172.21.15.42:0/2739152728 --> [v2:172.21.15.42:6824/24940,v1:172.21.15.42:6825/24940] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f48a40572e0 con 0x7f48a4054900 2020-04-02T23:24:54.472 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.450+0000 7f48b77fe700 1 -- 172.21.15.42:0/2739152728 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48c0061fe0 con 0x7f48c4064fa0 2020-04-02T23:24:54.472 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.450+0000 7f48ca331700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f48a404d660 0x7f48a404fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.472 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.450+0000 7f48cab32700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.42:6824/24940,v1:172.21.15.42:6825/24940] conn(0x7f48a4054900 0x7f48a4056d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.472 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.450+0000 7f48ca331700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f48a404d660 0x7f48a404fb20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f48b8002f30 tx=0x7f48b800bd00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.472 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.450+0000 7f48cab32700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.42:6824/24940,v1:172.21.15.42:6825/24940] conn(0x7f48a4054900 0x7f48a4056d20 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:54.472 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.450+0000 7f48ca331700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f48a404d660 0x7f48a404fb20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f48b8002f30 tx=0x7f48b800bd00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.472 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.450+0000 7f48ca331700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f48a404d660 0x7f48a404fb20 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f48b8002f30 tx=0x7f48b800bd00).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:54.473 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.451+0000 7f48b77fe700 1 -- 172.21.15.42:0/2739152728 <== osd.3 v2:172.21.15.42:6824/24940 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f48a40572e0 con 0x7f48a4054900 2020-04-02T23:24:54.474 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.469+0000 7f48cc595700 1 -- 172.21.15.42:0/2739152728 --> [v2:172.21.15.42:6824/24940,v1:172.21.15.42:6825/24940] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f48c413a410 con 0x7f48a4054900 2020-04-02T23:24:54.474 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.469+0000 7f48b77fe700 1 -- 172.21.15.42:0/2739152728 <== osd.3 v2:172.21.15.42:6824/24940 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f48c413a410 con 0x7f48a4054900 2020-04-02T23:24:54.474 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.469+0000 7f48cc595700 1 -- 172.21.15.42:0/2739152728 >> [v2:172.21.15.42:6824/24940,v1:172.21.15.42:6825/24940] conn(0x7f48a4054900 msgr2=0x7f48a4056d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.474 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.469+0000 7f48cc595700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.42:6824/24940,v1:172.21.15.42:6825/24940] conn(0x7f48a4054900 0x7f48a4056d20 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.475 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.469+0000 7f48cc595700 1 -- 172.21.15.42:0/2739152728 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f48a404d660 msgr2=0x7f48a404fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.475 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.469+0000 7f48cc595700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f48a404d660 0x7f48a404fb20 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f48b8002f30 tx=0x7f48b800bd00).stop 2020-04-02T23:24:54.475 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.469+0000 7f48cc595700 1 -- 172.21.15.42:0/2739152728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c4064fa0 msgr2=0x7f48c40a5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.475 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.469+0000 7f48cc595700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c4064fa0 0x7f48c40a5320 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f48c00013e0 tx=0x7f48c40ab7f0).stop 2020-04-02T23:24:54.475 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.469+0000 7f48cab32700 1 -- 172.21.15.42:0/2739152728 reap_dead start 2020-04-02T23:24:54.475 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.469+0000 7f48cc595700 1 -- 172.21.15.42:0/2739152728 shutdown_connections 2020-04-02T23:24:54.475 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.470+0000 7f48cc595700 1 --2- 172.21.15.42:0/2739152728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48c4064fa0 0x7f48c40a5320 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.476 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.470+0000 7f48cc595700 1 -- 172.21.15.42:0/2739152728 >> 172.21.15.42:0/2739152728 conn(0x7f48c405b720 msgr2=0x7f48c4069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:54.476 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.470+0000 7f48cc595700 1 -- 172.21.15.42:0/2739152728 shutdown_connections 2020-04-02T23:24:54.476 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.470+0000 7f48cc595700 1 -- 172.21.15.42:0/2739152728 wait complete. 2020-04-02T23:24:54.481 INFO:teuthology.orchestra.run.smithi042.stdout:64424509447 2020-04-02T23:24:54.481 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:54.495 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2020-04-02T23:24:54.650 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.648+0000 7fa5ee8c4700 1 Processor -- start 2020-04-02T23:24:54.650 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.648+0000 7fa5ee8c4700 1 -- start start 2020-04-02T23:24:54.653 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.648+0000 7fa5ee8c4700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa5e80a6d40 0x7fa5e813a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:54.653 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.648+0000 7fa5ee8c4700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e80a45f0 con 0x7fa5e80ab410 2020-04-02T23:24:54.653 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.648+0000 7fa5ee8c4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e809f460 con 0x7fa5e8067380 2020-04-02T23:24:54.653 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.648+0000 7fa5ee8c4700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e805ff40 con 0x7fa5e80a6d40 2020-04-02T23:24:54.653 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.648+0000 7fa5ece61700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa5e80a6d40 0x7fa5e813a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.653 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.648+0000 7fa5e7fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa5e80ab410 0x7fa5e80a6630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59492/0 (socket says 172.21.15.42:59492) 2020-04-02T23:24:54.653 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.648+0000 7fa5ece61700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa5e80a6d40 0x7fa5e813a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40072/0 (socket says 172.21.15.42:40072) 2020-04-02T23:24:54.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.648+0000 7fa5e7fff700 1 -- 172.21.15.42:0/2513538896 learned_addr learned my addr 172.21.15.42:0/2513538896 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:54.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.649+0000 7fa5ece61700 1 -- 172.21.15.42:0/2513538896 >> v1:172.21.15.84:6789/0 conn(0x7fa5e8067380 legacy=0x7fa5e813a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.649+0000 7fa5e77fe700 1 -- 172.21.15.42:0/2513538896 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734779065 0 0) 0x7fa5e809f460 con 0x7fa5e8067380 2020-04-02T23:24:54.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.649+0000 7fa5ece61700 1 -- 172.21.15.42:0/2513538896 >> v1:172.21.15.42:6789/0 conn(0x7fa5e80ab410 legacy=0x7fa5e80a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.649+0000 7fa5ece61700 1 -- 172.21.15.42:0/2513538896 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e80a4850 con 0x7fa5e80a6d40 2020-04-02T23:24:54.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.649+0000 7fa5ece61700 1 --2- 172.21.15.42:0/2513538896 >> v2:172.21.15.42:3300/0 conn(0x7fa5e80a6d40 0x7fa5e813a8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa5d80010d0 tx=0x7fa5e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.649+0000 7fa5ece61700 1 --2- 172.21.15.42:0/2513538896 >> v2:172.21.15.42:3300/0 conn(0x7fa5e80a6d40 0x7fa5e813a8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa5d80010d0 tx=0x7fa5e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.655 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.649+0000 7fa5ece61700 1 --2- 172.21.15.42:0/2513538896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5e80a6d40 0x7fa5e813a8e0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fa5d80010d0 tx=0x7fa5e0007dc0).ready entity=mon.0 client_cookie=14cda27e3d980b0f server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:54.655 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.649+0000 7fa5ece61700 1 --2- 172.21.15.42:0/2513538896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5e80a6d40 0x7fa5e813a8e0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fa5d80010d0 tx=0x7fa5e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.655 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.649+0000 7fa5e77fe700 1 -- 172.21.15.42:0/2513538896 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5e0010d60 con 0x7fa5e80a6d40 2020-04-02T23:24:54.655 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.649+0000 7fa5ece61700 1 --2- 172.21.15.42:0/2513538896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5e80a6d40 0x7fa5e813a8e0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fa5d80010d0 tx=0x7fa5e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.655 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.649+0000 7fa5ece61700 1 --2- 172.21.15.42:0/2513538896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5e80a6d40 0x7fa5e813a8e0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fa5d80010d0 tx=0x7fa5e0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.655 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.649+0000 7fa5e77fe700 1 -- 172.21.15.42:0/2513538896 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e00110c0 con 0x7fa5e80a6d40 2020-04-02T23:24:54.655 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.649+0000 7fa5e77fe700 1 -- 172.21.15.42:0/2513538896 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5e0011460 con 0x7fa5e80a6d40 2020-04-02T23:24:54.655 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.649+0000 7fa5ee8c4700 1 -- 172.21.15.42:0/2513538896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5e80a6d40 msgr2=0x7fa5e813a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.656 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.649+0000 7fa5ee8c4700 1 --2- 172.21.15.42:0/2513538896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5e80a6d40 0x7fa5e813a8e0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fa5d80010d0 tx=0x7fa5e0007dc0).stop 2020-04-02T23:24:54.656 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.650+0000 7fa5ee8c4700 1 -- 172.21.15.42:0/2513538896 shutdown_connections 2020-04-02T23:24:54.656 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.650+0000 7fa5ee8c4700 1 --2- 172.21.15.42:0/2513538896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5e80a6d40 0x7fa5e813a8e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.656 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.650+0000 7fa5ee8c4700 1 -- 172.21.15.42:0/2513538896 >> 172.21.15.42:0/2513538896 conn(0x7fa5e805b720 msgr2=0x7fa5e80aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:54.656 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.650+0000 7fa5ee8c4700 1 -- 172.21.15.42:0/2513538896 shutdown_connections 2020-04-02T23:24:54.656 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.650+0000 7fa5ee8c4700 1 -- 172.21.15.42:0/2513538896 wait complete. 2020-04-02T23:24:54.656 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.650+0000 7fa5ee8c4700 1 Processor -- start 2020-04-02T23:24:54.657 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.650+0000 7fa5ee8c4700 1 -- start start 2020-04-02T23:24:54.660 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.651+0000 7fa5ee8c4700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa5e80a6d40 0x7fa5e8066eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.660 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.651+0000 7fa5ee8c4700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa5e80ab410 0x7fa5e8137660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.661 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.651+0000 7fa5ee8c4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e80636b0 con 0x7fa5e8067380 2020-04-02T23:24:54.661 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.651+0000 7fa5ee8c4700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e8063410 con 0x7fa5e80a6d40 2020-04-02T23:24:54.661 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.651+0000 7fa5ee8c4700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e8065220 con 0x7fa5e80ab410 2020-04-02T23:24:54.661 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.651+0000 7fa5dffff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa5e80a6d40 0x7fa5e8066eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.661 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.651+0000 7fa5dffff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa5e80a6d40 0x7fa5e8066eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40076/0 (socket says 172.21.15.42:40076) 2020-04-02T23:24:54.661 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.651+0000 7fa5dffff700 1 -- 172.21.15.42:0/2772857507 learned_addr learned my addr 172.21.15.42:0/2772857507 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:54.661 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.651+0000 7fa5ece61700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa5e80ab410 0x7fa5e8137660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.662 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.651+0000 7fa5dffff700 1 -- 172.21.15.42:0/2772857507 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa5e80ab410 msgr2=0x7fa5e8137660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.662 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.651+0000 7fa5dffff700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa5e80ab410 0x7fa5e8137660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.662 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.651+0000 7fa5dffff700 1 -- 172.21.15.42:0/2772857507 >> v1:172.21.15.84:6789/0 conn(0x7fa5e8067380 legacy=0x7fa5e8062220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.662 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.651+0000 7fa5dffff700 1 -- 172.21.15.42:0/2772857507 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e80a9160 con 0x7fa5e80a6d40 2020-04-02T23:24:54.662 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.651+0000 7fa5dffff700 1 --2- 172.21.15.42:0/2772857507 >> v2:172.21.15.42:3300/0 conn(0x7fa5e80a6d40 0x7fa5e8066eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa5d0000b80 tx=0x7fa5d0010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.662 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.652+0000 7fa5dffff700 1 --2- 172.21.15.42:0/2772857507 >> v2:172.21.15.42:3300/0 conn(0x7fa5e80a6d40 0x7fa5e8066eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa5d0000b80 tx=0x7fa5d0010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.662 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.652+0000 7fa5dffff700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5e80a6d40 0x7fa5e8066eb0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7fa5d0000b80 tx=0x7fa5d0010a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:54.662 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.652+0000 7fa5dffff700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5e80a6d40 0x7fa5e8066eb0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fa5d0000b80 tx=0x7fa5d0010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.663 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.652+0000 7fa5dffff700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5e80a6d40 0x7fa5e8066eb0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fa5d0000b80 tx=0x7fa5d0010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.663 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.652+0000 7fa5e5ffb700 1 -- 172.21.15.42:0/2772857507 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5d000cc20 con 0x7fa5e80a6d40 2020-04-02T23:24:54.663 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.652+0000 7fa5dffff700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5e80a6d40 0x7fa5e8066eb0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fa5d0000b80 tx=0x7fa5d0010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.663 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.652+0000 7fa5e5ffb700 1 -- 172.21.15.42:0/2772857507 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d000cd80 con 0x7fa5e80a6d40 2020-04-02T23:24:54.663 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.652+0000 7fa5ee8c4700 1 -- 172.21.15.42:0/2772857507 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e8062fe0 con 0x7fa5e80a6d40 2020-04-02T23:24:54.663 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.652+0000 7fa5e5ffb700 1 -- 172.21.15.42:0/2772857507 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5d00111b0 con 0x7fa5e80a6d40 2020-04-02T23:24:54.663 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.652+0000 7fa5ee8c4700 1 -- 172.21.15.42:0/2772857507 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e8065880 con 0x7fa5e80a6d40 2020-04-02T23:24:54.664 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.652+0000 7fa5dffff700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5e80a6d40 0x7fa5e8066eb0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fa5d0000b80 tx=0x7fa5d0010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.664 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.653+0000 7fa5ee8c4700 1 -- 172.21.15.42:0/2772857507 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa5e805d2e0 con 0x7fa5e80a6d40 2020-04-02T23:24:54.664 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.653+0000 7fa5e5ffb700 1 -- 172.21.15.42:0/2772857507 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa5d00064e0 con 0x7fa5e80a6d40 2020-04-02T23:24:54.664 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.653+0000 7fa5dffff700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5e80a6d40 0x7fa5e8066eb0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fa5d0000b80 tx=0x7fa5d0010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.664 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.653+0000 7fa5dffff700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5e80a6d40 0x7fa5e8066eb0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fa5d0000b80 tx=0x7fa5d0010a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.664 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.653+0000 7fa5e5ffb700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa5cc04d610 0x7fa5cc04fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.664 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.653+0000 7fa5e5ffb700 1 -- 172.21.15.42:0/2772857507 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa5d0060ac0 con 0x7fa5e80a6d40 2020-04-02T23:24:54.665 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.653+0000 7fa5e5ffb700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.84:6802/24239,v1:172.21.15.84:6803/24239] conn(0x7fa5cc054830 0x7fa5cc056c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.665 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.653+0000 7fa5e5ffb700 1 -- 172.21.15.42:0/2772857507 --> [v2:172.21.15.84:6802/24239,v1:172.21.15.84:6803/24239] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5cc057210 con 0x7fa5cc054830 2020-04-02T23:24:54.665 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.653+0000 7fa5e5ffb700 1 -- 172.21.15.42:0/2772857507 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5d0061f80 con 0x7fa5e80a6d40 2020-04-02T23:24:54.665 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.653+0000 7fa5e7fff700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa5cc04d610 0x7fa5cc04fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.665 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.653+0000 7fa5ece61700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.84:6802/24239,v1:172.21.15.84:6803/24239] conn(0x7fa5cc054830 0x7fa5cc056c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.665 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.654+0000 7fa5e7fff700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa5cc04d610 0x7fa5cc04fad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa5e80a9090 tx=0x7fa5d80015b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.665 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.654+0000 7fa5e7fff700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa5cc04d610 0x7fa5cc04fad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa5e80a9090 tx=0x7fa5d80015b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.665 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.654+0000 7fa5e7fff700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa5cc04d610 0x7fa5cc04fad0 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7fa5e80a9090 tx=0x7fa5d80015b0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:54.666 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.654+0000 7fa5ece61700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.84:6802/24239,v1:172.21.15.84:6803/24239] conn(0x7fa5cc054830 0x7fa5cc056c50 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:54.666 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.654+0000 7fa5e5ffb700 1 -- 172.21.15.42:0/2772857507 <== osd.4 v2:172.21.15.84:6802/24239 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fa5cc057210 con 0x7fa5cc054830 2020-04-02T23:24:54.674 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.672+0000 7fa5ee8c4700 1 -- 172.21.15.42:0/2772857507 --> [v2:172.21.15.84:6802/24239,v1:172.21.15.84:6803/24239] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa5e8056c50 con 0x7fa5cc054830 2020-04-02T23:24:54.675 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.673+0000 7fa5e5ffb700 1 -- 172.21.15.42:0/2772857507 <== osd.4 v2:172.21.15.84:6802/24239 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa5e8056c50 con 0x7fa5cc054830 2020-04-02T23:24:54.676 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.673+0000 7fa5ee8c4700 1 -- 172.21.15.42:0/2772857507 >> [v2:172.21.15.84:6802/24239,v1:172.21.15.84:6803/24239] conn(0x7fa5cc054830 msgr2=0x7fa5cc056c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.676 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.673+0000 7fa5ee8c4700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.84:6802/24239,v1:172.21.15.84:6803/24239] conn(0x7fa5cc054830 0x7fa5cc056c50 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.676 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.673+0000 7fa5ee8c4700 1 -- 172.21.15.42:0/2772857507 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa5cc04d610 msgr2=0x7fa5cc04fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.676 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.673+0000 7fa5ee8c4700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa5cc04d610 0x7fa5cc04fad0 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7fa5e80a9090 tx=0x7fa5d80015b0).stop 2020-04-02T23:24:54.676 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.673+0000 7fa5ee8c4700 1 -- 172.21.15.42:0/2772857507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5e80a6d40 msgr2=0x7fa5e8066eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.676 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.673+0000 7fa5ee8c4700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5e80a6d40 0x7fa5e8066eb0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7fa5d0000b80 tx=0x7fa5d0010a10).stop 2020-04-02T23:24:54.677 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.673+0000 7fa5ece61700 1 -- 172.21.15.42:0/2772857507 reap_dead start 2020-04-02T23:24:54.677 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.673+0000 7fa5ee8c4700 1 -- 172.21.15.42:0/2772857507 shutdown_connections 2020-04-02T23:24:54.677 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.673+0000 7fa5ee8c4700 1 --2- 172.21.15.42:0/2772857507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5e80a6d40 0x7fa5e8066eb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.677 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.673+0000 7fa5ee8c4700 1 -- 172.21.15.42:0/2772857507 >> 172.21.15.42:0/2772857507 conn(0x7fa5e805b720 msgr2=0x7fa5e8069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:54.677 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.673+0000 7fa5ee8c4700 1 -- 172.21.15.42:0/2772857507 shutdown_connections 2020-04-02T23:24:54.677 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.673+0000 7fa5ee8c4700 1 -- 172.21.15.42:0/2772857507 wait complete. 2020-04-02T23:24:54.685 INFO:teuthology.orchestra.run.smithi042.stdout:60129542150 2020-04-02T23:24:54.685 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:54.699 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2020-04-02T23:24:54.852 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.850+0000 7fe793a6b700 1 Processor -- start 2020-04-02T23:24:54.853 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.850+0000 7fe793a6b700 1 -- start start 2020-04-02T23:24:54.855 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.851+0000 7fe793a6b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe78c0ab410 0x7fe78c0a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:54.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.851+0000 7fe793a6b700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78c0a31b0 con 0x7fe78c0a6a90 2020-04-02T23:24:54.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.851+0000 7fe793a6b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78c0a49f0 con 0x7fe78c0a23e0 2020-04-02T23:24:54.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.851+0000 7fe793a6b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78c05ff40 con 0x7fe78c0ab410 2020-04-02T23:24:54.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.851+0000 7fe791006700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe78c0a6a90 0x7fe78c0a1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59510/0 (socket says 172.21.15.42:59510) 2020-04-02T23:24:54.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.851+0000 7fe791006700 1 -- 172.21.15.42:0/433656140 learned_addr learned my addr 172.21.15.42:0/433656140 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:54.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.851+0000 7fe791807700 1 --2- 172.21.15.42:0/433656140 >> v2:172.21.15.84:3300/0 conn(0x7fe78c0ab410 0x7fe78c0a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.851+0000 7fe790805700 1 -- 172.21.15.42:0/433656140 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593776133 0 0) 0x7fe78c0a31b0 con 0x7fe78c0a6a90 2020-04-02T23:24:54.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.851+0000 7fe790805700 1 -- 172.21.15.42:0/433656140 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe774003230 con 0x7fe78c0a6a90 2020-04-02T23:24:54.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.852+0000 7fe790805700 1 -- 172.21.15.42:0/433656140 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2613093810 0 0) 0x7fe774003230 con 0x7fe78c0a6a90 2020-04-02T23:24:54.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.852+0000 7fe791807700 1 -- 172.21.15.42:0/433656140 >> v1:172.21.15.84:6789/0 conn(0x7fe78c0a23e0 legacy=0x7fe78c140410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.852+0000 7fe791807700 1 -- 172.21.15.42:0/433656140 >> v1:172.21.15.42:6789/0 conn(0x7fe78c0a6a90 legacy=0x7fe78c0a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.852+0000 7fe791807700 1 -- 172.21.15.42:0/433656140 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c0a3420 con 0x7fe78c0ab410 2020-04-02T23:24:54.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.852+0000 7fe791807700 1 --2- 172.21.15.42:0/433656140 >> v2:172.21.15.84:3300/0 conn(0x7fe78c0ab410 0x7fe78c0a6630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe788001bf0 tx=0x7fe77c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.858 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.852+0000 7fe791807700 1 --2- 172.21.15.42:0/433656140 >> v2:172.21.15.84:3300/0 conn(0x7fe78c0ab410 0x7fe78c0a6630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe788001bf0 tx=0x7fe77c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.858 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.852+0000 7fe791807700 1 --2- 172.21.15.42:0/433656140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78c0ab410 0x7fe78c0a6630 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7fe788001bf0 tx=0x7fe77c007a40).ready entity=mon.1 client_cookie=7690d64ce3891b1f server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:54.858 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.852+0000 7fe791807700 1 --2- 172.21.15.42:0/433656140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78c0ab410 0x7fe78c0a6630 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fe788001bf0 tx=0x7fe77c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.858 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.852+0000 7fe790805700 1 -- 172.21.15.42:0/433656140 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe788001a50 con 0x7fe78c0ab410 2020-04-02T23:24:54.858 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.852+0000 7fe791807700 1 --2- 172.21.15.42:0/433656140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78c0ab410 0x7fe78c0a6630 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fe788001bf0 tx=0x7fe77c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.858 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.852+0000 7fe790805700 1 -- 172.21.15.42:0/433656140 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c008b40 con 0x7fe78c0ab410 2020-04-02T23:24:54.858 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.852+0000 7fe791807700 1 --2- 172.21.15.42:0/433656140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78c0ab410 0x7fe78c0a6630 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fe788001bf0 tx=0x7fe77c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.858 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.852+0000 7fe790805700 1 -- 172.21.15.42:0/433656140 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe77c008ea0 con 0x7fe78c0ab410 2020-04-02T23:24:54.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.852+0000 7fe793a6b700 1 -- 172.21.15.42:0/433656140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78c0ab410 msgr2=0x7fe78c0a6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.852+0000 7fe793a6b700 1 --2- 172.21.15.42:0/433656140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78c0ab410 0x7fe78c0a6630 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7fe788001bf0 tx=0x7fe77c007a40).stop 2020-04-02T23:24:54.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.852+0000 7fe793a6b700 1 -- 172.21.15.42:0/433656140 shutdown_connections 2020-04-02T23:24:54.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.852+0000 7fe793a6b700 1 --2- 172.21.15.42:0/433656140 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe78c0ab410 0x7fe78c0a6630 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.852+0000 7fe793a6b700 1 -- 172.21.15.42:0/433656140 >> 172.21.15.42:0/433656140 conn(0x7fe78c05b720 msgr2=0x7fe78c0aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:54.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.853+0000 7fe793a6b700 1 -- 172.21.15.42:0/433656140 shutdown_connections 2020-04-02T23:24:54.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.853+0000 7fe793a6b700 1 -- 172.21.15.42:0/433656140 wait complete. 2020-04-02T23:24:54.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.853+0000 7fe793a6b700 1 Processor -- start 2020-04-02T23:24:54.860 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.853+0000 7fe793a6b700 1 -- start start 2020-04-02T23:24:54.865 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.854+0000 7fe793a6b700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe78c0a6a90 0x7fe78c062a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.865 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.854+0000 7fe793a6b700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78c063820 con 0x7fe78c0a23e0 2020-04-02T23:24:54.865 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.854+0000 7fe793a6b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78c0a52f0 con 0x7fe78c0ab410 2020-04-02T23:24:54.865 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.854+0000 7fe793a6b700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c063a50 con 0x7fe78c0a6a90 2020-04-02T23:24:54.865 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.854+0000 7fe791807700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe78c0a23e0 0x7fe78c1386e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59514/0 (socket says 172.21.15.42:59514) 2020-04-02T23:24:54.866 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.854+0000 7fe791807700 1 -- 172.21.15.42:0/3930971435 learned_addr learned my addr 172.21.15.42:0/3930971435 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:54.866 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.854+0000 7fe791006700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe78c0a6a90 0x7fe78c062a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.866 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.854+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665405379 0 0) 0x7fe78c063820 con 0x7fe78c0a23e0 2020-04-02T23:24:54.866 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.854+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe76c002fe0 con 0x7fe78c0a23e0 2020-04-02T23:24:54.866 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.854+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134728708 0 0) 0x7fe78c0a52f0 con 0x7fe78c0ab410 2020-04-02T23:24:54.866 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.854+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe78c063820 con 0x7fe78c0ab410 2020-04-02T23:24:54.866 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.854+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2588210404 0 0) 0x7fe76c002fe0 con 0x7fe78c0a23e0 2020-04-02T23:24:54.866 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.854+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 --> v1:172.21.15.42:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe78c0a52f0 con 0x7fe78c0a23e0 2020-04-02T23:24:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.854+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7fe77c002f30 con 0x7fe78c0a23e0 2020-04-02T23:24:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe78c0a6a90 msgr2=0x7fe78c062a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe77affd700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe78c0a6a90 0x7fe78c062a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 >> v1:172.21.15.84:6789/0 conn(0x7fe78c0ab410 legacy=0x7fe78c065aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 >> v1:172.21.15.42:6789/0 conn(0x7fe78c0a23e0 legacy=0x7fe78c1386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe77affd700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe76c004b20 0x7fe76c004f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.867 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe77affd700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe76c003ab0 0x7fe76c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe77affd700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe76c004350 0x7fe76c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c063a50 con 0x7fe76c004350 2020-04-02T23:24:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c004830 con 0x7fe76c003ab0 2020-04-02T23:24:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c00bbb0 con 0x7fe76c004b20 2020-04-02T23:24:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe791006700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe78c0a6a90 0x7fe78c062a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe792008700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe76c004350 0x7fe76c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.868 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe791807700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe76c004b20 0x7fe76c004f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.873 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe791006700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe76c003ab0 0x7fe76c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.873 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe792008700 1 -- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe76c004b20 msgr2=0x7fe76c004f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.873 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe792008700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe76c004b20 0x7fe76c004f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.873 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe792008700 1 -- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe76c003ab0 msgr2=0x7fe76c003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.873 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe792008700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe76c003ab0 0x7fe76c003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.873 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe792008700 1 -- 172.21.15.42:0/3930971435 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c063cf0 con 0x7fe76c004350 2020-04-02T23:24:54.873 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe793a6b700 1 -- 172.21.15.42:0/3930971435 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe78c09a490 con 0x7fe76c004350 2020-04-02T23:24:54.874 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe792008700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe76c004350 0x7fe76c00b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe784000fa0 tx=0x7fe784010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.874 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe793a6b700 1 -- 172.21.15.42:0/3930971435 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78c138fb0 con 0x7fe76c004350 2020-04-02T23:24:54.874 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe792008700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe76c004350 0x7fe76c00b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe784000fa0 tx=0x7fe784010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.874 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe792008700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe76c004350 0x7fe76c00b750 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7fe784000fa0 tx=0x7fe784010af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:54.874 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe792008700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe76c004350 0x7fe76c00b750 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fe784000fa0 tx=0x7fe784010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.874 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe78400c8f0 con 0x7fe76c004350 2020-04-02T23:24:54.874 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe792008700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe76c004350 0x7fe76c00b750 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fe784000fa0 tx=0x7fe784010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.875 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78400ca90 con 0x7fe76c004350 2020-04-02T23:24:54.875 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe792008700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe76c004350 0x7fe76c00b750 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fe784000fa0 tx=0x7fe784010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.875 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.855+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe78400ce70 con 0x7fe76c004350 2020-04-02T23:24:54.875 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.856+0000 7fe792008700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe76c004350 0x7fe76c00b750 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fe784000fa0 tx=0x7fe784010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.875 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.856+0000 7fe793a6b700 1 -- 172.21.15.42:0/3930971435 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe768003580 con 0x7fe76c004350 2020-04-02T23:24:54.875 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.856+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe7840064e0 con 0x7fe76c004350 2020-04-02T23:24:54.875 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.856+0000 7fe792008700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe76c004350 0x7fe76c00b750 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fe784000fa0 tx=0x7fe784010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.875 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.856+0000 7fe792008700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe76c004350 0x7fe76c00b750 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fe784000fa0 tx=0x7fe784010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.876 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.857+0000 7fe77affd700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe76c055ee0 0x7fe76c0583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.876 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.857+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe7840606f0 con 0x7fe76c004350 2020-04-02T23:24:54.876 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.857+0000 7fe77affd700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:6810/24276,v1:172.21.15.84:6811/24276] conn(0x7fe76c05cea0 0x7fe76c05f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:54.876 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.857+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 --> [v2:172.21.15.84:6810/24276,v1:172.21.15.84:6811/24276] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe76c05f910 con 0x7fe76c05cea0 2020-04-02T23:24:54.876 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.857+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe784061b90 con 0x7fe76c004350 2020-04-02T23:24:54.876 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.857+0000 7fe791807700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe76c055ee0 0x7fe76c0583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.876 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.857+0000 7fe791006700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:6810/24276,v1:172.21.15.84:6811/24276] conn(0x7fe76c05cea0 0x7fe76c05f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:54.877 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.857+0000 7fe791807700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe76c055ee0 0x7fe76c0583a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe78c0a5220 tx=0x7fe77c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.877 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.857+0000 7fe791807700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe76c055ee0 0x7fe76c0583a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe78c0a5220 tx=0x7fe77c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:54.877 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.857+0000 7fe791807700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe76c055ee0 0x7fe76c0583a0 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7fe78c0a5220 tx=0x7fe77c007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:54.877 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.857+0000 7fe791006700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:6810/24276,v1:172.21.15.84:6811/24276] conn(0x7fe76c05cea0 0x7fe76c05f2c0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:54.877 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.858+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 <== osd.5 v2:172.21.15.84:6810/24276 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fe76c05f910 con 0x7fe76c05cea0 2020-04-02T23:24:54.880 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.876+0000 7fe793a6b700 1 -- 172.21.15.42:0/3930971435 --> [v2:172.21.15.84:6810/24276,v1:172.21.15.84:6811/24276] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe768002680 con 0x7fe76c05cea0 2020-04-02T23:24:54.880 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.876+0000 7fe77affd700 1 -- 172.21.15.42:0/3930971435 <== osd.5 v2:172.21.15.84:6810/24276 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe768002680 con 0x7fe76c05cea0 2020-04-02T23:24:54.881 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.877+0000 7fe793a6b700 1 -- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:6810/24276,v1:172.21.15.84:6811/24276] conn(0x7fe76c05cea0 msgr2=0x7fe76c05f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.881 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.877+0000 7fe793a6b700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:6810/24276,v1:172.21.15.84:6811/24276] conn(0x7fe76c05cea0 0x7fe76c05f2c0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.881 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.877+0000 7fe792008700 1 -- 172.21.15.42:0/3930971435 reap_dead start 2020-04-02T23:24:54.881 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.877+0000 7fe793a6b700 1 -- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe76c055ee0 msgr2=0x7fe76c0583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.881 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.877+0000 7fe793a6b700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe76c055ee0 0x7fe76c0583a0 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7fe78c0a5220 tx=0x7fe77c007a40).stop 2020-04-02T23:24:54.881 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.877+0000 7fe793a6b700 1 -- 172.21.15.42:0/3930971435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe76c004350 msgr2=0x7fe76c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:54.881 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.877+0000 7fe793a6b700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe76c004350 0x7fe76c00b750 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7fe784000fa0 tx=0x7fe784010af0).stop 2020-04-02T23:24:54.882 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.877+0000 7fe793a6b700 1 -- 172.21.15.42:0/3930971435 shutdown_connections 2020-04-02T23:24:54.882 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.877+0000 7fe793a6b700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe76c055ee0 0x7fe76c0583a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.882 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.877+0000 7fe793a6b700 1 --2- 172.21.15.42:0/3930971435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe76c004350 0x7fe76c00b750 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:54.882 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.877+0000 7fe793a6b700 1 -- 172.21.15.42:0/3930971435 >> 172.21.15.42:0/3930971435 conn(0x7fe78c05b720 msgr2=0x7fe78c069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:54.882 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.877+0000 7fe793a6b700 1 -- 172.21.15.42:0/3930971435 shutdown_connections 2020-04-02T23:24:54.882 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:54.877+0000 7fe793a6b700 1 -- 172.21.15.42:0/3930971435 wait complete. 2020-04-02T23:24:54.889 INFO:teuthology.orchestra.run.smithi042.stdout:60129542149 2020-04-02T23:24:54.890 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:54.905 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2020-04-02T23:24:55.066 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.057+0000 7f1d3e0b2700 1 Processor -- start 2020-04-02T23:24:55.067 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.057+0000 7f1d3e0b2700 1 -- start start 2020-04-02T23:24:55.067 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d3e0b2700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d380ab410 0x7f1d380a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:55.067 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d3e0b2700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1d380a6a90 0x7f1d380a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:55.067 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d3e0b2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1d380a2130 0x7f1d380a2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:55.067 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d3e0b2700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d380a31b0 con 0x7f1d380a6a90 2020-04-02T23:24:55.067 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d3e0b2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d380a49f0 con 0x7f1d380a2130 2020-04-02T23:24:55.068 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d3e0b2700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3805ff40 con 0x7f1d380ab410 2020-04-02T23:24:55.068 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d36ffd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1d380a6a90 0x7f1d380a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.068 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d36ffd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1d380a6a90 0x7f1d380a1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40108/0 (socket says 172.21.15.42:40108) 2020-04-02T23:24:55.068 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d36ffd700 1 -- 172.21.15.42:0/3400767611 learned_addr learned my addr 172.21.15.42:0/3400767611 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:55.068 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d37fff700 1 --2- 172.21.15.42:0/3400767611 >> v2:172.21.15.84:3300/0 conn(0x7f1d380a2130 0x7f1d380a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.068 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d377fe700 1 --2- 172.21.15.42:0/3400767611 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d380ab410 0x7f1d380a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.069 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d36ffd700 1 -- 172.21.15.42:0/3400767611 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d380ab410 msgr2=0x7f1d380a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:55.069 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d36ffd700 1 --2- 172.21.15.42:0/3400767611 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d380ab410 0x7f1d380a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:55.069 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d36ffd700 1 -- 172.21.15.42:0/3400767611 >> v2:172.21.15.84:3300/0 conn(0x7f1d380a2130 msgr2=0x7f1d380a2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:55.069 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d36ffd700 1 --2- 172.21.15.42:0/3400767611 >> v2:172.21.15.84:3300/0 conn(0x7f1d380a2130 0x7f1d380a2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:55.069 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d36ffd700 1 -- 172.21.15.42:0/3400767611 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d380a3420 con 0x7f1d380a6a90 2020-04-02T23:24:55.069 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d36ffd700 1 --2- 172.21.15.42:0/3400767611 >> v2:172.21.15.42:3300/0 conn(0x7f1d380a6a90 0x7f1d380a1cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1d2c002f30 tx=0x7f1d2c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.069 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d36ffd700 1 --2- 172.21.15.42:0/3400767611 >> v2:172.21.15.42:3300/0 conn(0x7f1d380a6a90 0x7f1d380a1cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1d2c002f30 tx=0x7f1d2c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.070 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d36ffd700 1 --2- 172.21.15.42:0/3400767611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d380a6a90 0x7f1d380a1cd0 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7f1d2c002f30 tx=0x7f1d2c007a40).ready entity=mon.0 client_cookie=4e708e4ac55a9817 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:55.070 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d36ffd700 1 --2- 172.21.15.42:0/3400767611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d380a6a90 0x7f1d380a1cd0 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f1d2c002f30 tx=0x7f1d2c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.070 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d36ffd700 1 --2- 172.21.15.42:0/3400767611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d380a6a90 0x7f1d380a1cd0 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f1d2c002f30 tx=0x7f1d2c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.070 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d367fc700 1 -- 172.21.15.42:0/3400767611 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d2c011720 con 0x7f1d380a6a90 2020-04-02T23:24:55.070 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d36ffd700 1 --2- 172.21.15.42:0/3400767611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d380a6a90 0x7f1d380a1cd0 secure :-1 s=THROTTLE_DONE pgs=132 cs=0 l=1 rx=0x7f1d2c002f30 tx=0x7f1d2c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.070 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d367fc700 1 -- 172.21.15.42:0/3400767611 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c011880 con 0x7f1d380a6a90 2020-04-02T23:24:55.070 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d367fc700 1 -- 172.21.15.42:0/3400767611 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d2c011c60 con 0x7f1d380a6a90 2020-04-02T23:24:55.071 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d3e0b2700 1 -- 172.21.15.42:0/3400767611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d380a6a90 msgr2=0x7f1d380a1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.071 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.058+0000 7f1d3e0b2700 1 --2- 172.21.15.42:0/3400767611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d380a6a90 0x7f1d380a1cd0 secure :-1 s=READY pgs=132 cs=0 l=1 rx=0x7f1d2c002f30 tx=0x7f1d2c007a40).stop 2020-04-02T23:24:55.071 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.059+0000 7f1d3e0b2700 1 -- 172.21.15.42:0/3400767611 shutdown_connections 2020-04-02T23:24:55.071 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.059+0000 7f1d3e0b2700 1 --2- 172.21.15.42:0/3400767611 >> v2:172.21.15.84:3300/0 conn(0x7f1d380a2130 0x7f1d380a2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:55.071 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.059+0000 7f1d3e0b2700 1 --2- 172.21.15.42:0/3400767611 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d380ab410 0x7f1d380a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:55.071 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.059+0000 7f1d3e0b2700 1 --2- 172.21.15.42:0/3400767611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d380a6a90 0x7f1d380a1cd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:55.071 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.059+0000 7f1d3e0b2700 1 -- 172.21.15.42:0/3400767611 >> 172.21.15.42:0/3400767611 conn(0x7f1d3805b720 msgr2=0x7f1d380aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:55.072 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.059+0000 7f1d3e0b2700 1 -- 172.21.15.42:0/3400767611 shutdown_connections 2020-04-02T23:24:55.072 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.059+0000 7f1d3e0b2700 1 -- 172.21.15.42:0/3400767611 wait complete. 2020-04-02T23:24:55.072 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.060+0000 7f1d3e0b2700 1 Processor -- start 2020-04-02T23:24:55.072 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.060+0000 7f1d3e0b2700 1 -- start start 2020-04-02T23:24:55.072 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d3e0b2700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d380a2130 0x7f1d380649f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:55.072 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d3e0b2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1d380ab410 0x7f1d38147510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:55.072 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d3e0b2700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d38146f50 con 0x7f1d380a6a90 2020-04-02T23:24:55.073 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d3e0b2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d38065020 con 0x7f1d380ab410 2020-04-02T23:24:55.073 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d3e0b2700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d380652c0 con 0x7f1d380a2130 2020-04-02T23:24:55.073 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d36ffd700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f1d380a6a90 0x7f1d38063db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59538/0 (socket says 172.21.15.42:59538) 2020-04-02T23:24:55.073 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d36ffd700 1 -- 172.21.15.42:0/184702053 learned_addr learned my addr 172.21.15.42:0/184702053 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:55.073 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d377fe700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d380a2130 0x7f1d380649f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.073 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d37fff700 1 --2- 172.21.15.42:0/184702053 >> v2:172.21.15.84:3300/0 conn(0x7f1d380ab410 0x7f1d38147510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.073 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d34ff9700 1 -- 172.21.15.42:0/184702053 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859561773 0 0) 0x7f1d38146f50 con 0x7f1d380a6a90 2020-04-02T23:24:55.073 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d34ff9700 1 -- 172.21.15.42:0/184702053 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d18002fe0 con 0x7f1d380a6a90 2020-04-02T23:24:55.074 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d377fe700 1 -- 172.21.15.42:0/184702053 >> v2:172.21.15.84:3300/0 conn(0x7f1d380ab410 msgr2=0x7f1d38147510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.074 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d377fe700 1 --2- 172.21.15.42:0/184702053 >> v2:172.21.15.84:3300/0 conn(0x7f1d380ab410 0x7f1d38147510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:55.074 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d377fe700 1 -- 172.21.15.42:0/184702053 >> v1:172.21.15.42:6789/0 conn(0x7f1d380a6a90 legacy=0x7f1d38063db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.074 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d377fe700 1 -- 172.21.15.42:0/184702053 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3809fdb0 con 0x7f1d380a2130 2020-04-02T23:24:55.074 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d377fe700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d380a2130 0x7f1d380649f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.074 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d377fe700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d380a2130 0x7f1d380649f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.074 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d377fe700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d380a2130 0x7f1d380649f0 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010af0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:55.075 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d377fe700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d380a2130 0x7f1d380649f0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.075 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d34ff9700 1 -- 172.21.15.42:0/184702053 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d28005e90 con 0x7f1d380a2130 2020-04-02T23:24:55.075 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d377fe700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d380a2130 0x7f1d380649f0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.075 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d34ff9700 1 -- 172.21.15.42:0/184702053 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d28007160 con 0x7f1d380a2130 2020-04-02T23:24:55.075 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d377fe700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d380a2130 0x7f1d380649f0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.075 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d34ff9700 1 -- 172.21.15.42:0/184702053 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d28007580 con 0x7f1d380a2130 2020-04-02T23:24:55.075 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.061+0000 7f1d3e0b2700 1 -- 172.21.15.42:0/184702053 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d380644c0 con 0x7f1d380a2130 2020-04-02T23:24:55.075 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.062+0000 7f1d3e0b2700 1 -- 172.21.15.42:0/184702053 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d38066f70 con 0x7f1d380a2130 2020-04-02T23:24:55.076 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.062+0000 7f1d377fe700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d380a2130 0x7f1d380649f0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.076 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.062+0000 7f1d3e0b2700 1 -- 172.21.15.42:0/184702053 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1d38063b10 con 0x7f1d380a2130 2020-04-02T23:24:55.076 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.063+0000 7f1d34ff9700 1 -- 172.21.15.42:0/184702053 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f1d2800e180 con 0x7f1d380a2130 2020-04-02T23:24:55.076 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.063+0000 7f1d377fe700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d380a2130 0x7f1d380649f0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.076 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.063+0000 7f1d377fe700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d380a2130 0x7f1d380649f0 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.076 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.063+0000 7f1d34ff9700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1d1804d870 0x7f1d1804fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:55.077 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.063+0000 7f1d34ff9700 1 -- 172.21.15.42:0/184702053 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1d28061150 con 0x7f1d380a2130 2020-04-02T23:24:55.077 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.063+0000 7f1d34ff9700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:6818/24319,v1:172.21.15.84:6819/24319] conn(0x7f1d18054830 0x7f1d18056c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:55.077 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.063+0000 7f1d34ff9700 1 -- 172.21.15.42:0/184702053 --> [v2:172.21.15.84:6818/24319,v1:172.21.15.84:6819/24319] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d18057210 con 0x7f1d18054830 2020-04-02T23:24:55.078 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.063+0000 7f1d34ff9700 1 -- 172.21.15.42:0/184702053 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d28062670 con 0x7f1d380a2130 2020-04-02T23:24:55.078 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.063+0000 7f1d36ffd700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1d1804d870 0x7f1d1804fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.078 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.063+0000 7f1d37fff700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:6818/24319,v1:172.21.15.84:6819/24319] conn(0x7f1d18054830 0x7f1d18056c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.078 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.063+0000 7f1d36ffd700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1d1804d870 0x7f1d1804fd30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d2c0084c0 tx=0x7f1d2c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.078 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.063+0000 7f1d36ffd700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1d1804d870 0x7f1d1804fd30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d2c0084c0 tx=0x7f1d2c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.078 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.063+0000 7f1d36ffd700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1d1804d870 0x7f1d1804fd30 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f1d2c0084c0 tx=0x7f1d2c007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:55.078 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.063+0000 7f1d37fff700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:6818/24319,v1:172.21.15.84:6819/24319] conn(0x7f1d18054830 0x7f1d18056c50 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:55.079 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.064+0000 7f1d34ff9700 1 -- 172.21.15.42:0/184702053 <== osd.6 v2:172.21.15.84:6818/24319 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f1d18057210 con 0x7f1d18054830 2020-04-02T23:24:55.084 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.083+0000 7f1d3e0b2700 1 -- 172.21.15.42:0/184702053 --> [v2:172.21.15.84:6818/24319,v1:172.21.15.84:6819/24319] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1d38147bb0 con 0x7f1d18054830 2020-04-02T23:24:55.086 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.083+0000 7f1d34ff9700 1 -- 172.21.15.42:0/184702053 <== osd.6 v2:172.21.15.84:6818/24319 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1d38147bb0 con 0x7f1d18054830 2020-04-02T23:24:55.086 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.083+0000 7f1d3e0b2700 1 -- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:6818/24319,v1:172.21.15.84:6819/24319] conn(0x7f1d18054830 msgr2=0x7f1d18056c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.086 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.083+0000 7f1d3e0b2700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:6818/24319,v1:172.21.15.84:6819/24319] conn(0x7f1d18054830 0x7f1d18056c50 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:55.086 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.083+0000 7f1d3e0b2700 1 -- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1d1804d870 msgr2=0x7f1d1804fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.086 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.083+0000 7f1d3e0b2700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f1d1804d870 0x7f1d1804fd30 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f1d2c0084c0 tx=0x7f1d2c007a40).stop 2020-04-02T23:24:55.087 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.083+0000 7f1d3e0b2700 1 -- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d380a2130 msgr2=0x7f1d380649f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.087 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.083+0000 7f1d3e0b2700 1 --2- 172.21.15.42:0/184702053 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f1d380a2130 0x7f1d380649f0 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f1d28002f30 tx=0x7f1d28010af0).stop 2020-04-02T23:24:55.087 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.083+0000 7f1d37fff700 1 -- 172.21.15.42:0/184702053 reap_dead start 2020-04-02T23:24:55.087 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.083+0000 7f1d3e0b2700 1 -- 172.21.15.42:0/184702053 shutdown_connections 2020-04-02T23:24:55.087 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.084+0000 7f1d3e0b2700 1 -- 172.21.15.42:0/184702053 >> 172.21.15.42:0/184702053 conn(0x7f1d3805b720 msgr2=0x7f1d380a9300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:55.087 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.084+0000 7f1d3e0b2700 1 -- 172.21.15.42:0/184702053 shutdown_connections 2020-04-02T23:24:55.087 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.084+0000 7f1d3e0b2700 1 -- 172.21.15.42:0/184702053 wait complete. 2020-04-02T23:24:55.095 INFO:teuthology.orchestra.run.smithi042.stdout:60129542150 2020-04-02T23:24:55.096 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:55.109 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2020-04-02T23:24:55.264 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.262+0000 7f0c15a5e700 1 Processor -- start 2020-04-02T23:24:55.264 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.262+0000 7f0c15a5e700 1 -- start start 2020-04-02T23:24:55.273 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c15a5e700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c100a20b0 0x7f0c1013d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:55.274 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c15a5e700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c100a25f0 con 0x7f0c1013d640 2020-04-02T23:24:55.274 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c15a5e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1009a8f0 con 0x7f0c100a1cd0 2020-04-02T23:24:55.274 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c15a5e700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1009ab90 con 0x7f0c100a20b0 2020-04-02T23:24:55.274 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c0f7fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f0c1013d640 0x7f0c1013fa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59550/0 (socket says 172.21.15.42:59550) 2020-04-02T23:24:55.274 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c0f7fe700 1 -- 172.21.15.42:0/4027141806 learned_addr learned my addr 172.21.15.42:0/4027141806 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:55.274 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c07fff700 1 --2- 172.21.15.42:0/4027141806 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c100a20b0 0x7f0c1013d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.275 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c0e7fc700 1 -- 172.21.15.42:0/4027141806 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152416980 0 0) 0x7f0c100a25f0 con 0x7f0c1013d640 2020-04-02T23:24:55.275 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c0e7fc700 1 -- 172.21.15.42:0/4027141806 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bf0003230 con 0x7f0c1013d640 2020-04-02T23:24:55.275 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c0e7fc700 1 -- 172.21.15.42:0/4027141806 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2795650433 0 0) 0x7f0c1009a8f0 con 0x7f0c100a1cd0 2020-04-02T23:24:55.275 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c0e7fc700 1 -- 172.21.15.42:0/4027141806 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c100a25f0 con 0x7f0c100a1cd0 2020-04-02T23:24:55.275 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c0e7fc700 1 -- 172.21.15.42:0/4027141806 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2126166239 0 0) 0x7f0bf0003230 con 0x7f0c1013d640 2020-04-02T23:24:55.275 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c0e7fc700 1 -- 172.21.15.42:0/4027141806 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c100a20b0 msgr2=0x7f0c1013d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:55.276 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c0e7fc700 1 --2- 172.21.15.42:0/4027141806 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c100a20b0 0x7f0c1013d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:55.276 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c0e7fc700 1 -- 172.21.15.42:0/4027141806 >> v1:172.21.15.84:6789/0 conn(0x7f0c100a1cd0 legacy=0x7f0c100a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.276 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c0e7fc700 1 -- 172.21.15.42:0/4027141806 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1009ae30 con 0x7f0c1013d640 2020-04-02T23:24:55.277 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c0e7fc700 1 -- 172.21.15.42:0/4027141806 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7f0c08001a50 con 0x7f0c1013d640 2020-04-02T23:24:55.277 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c0e7fc700 1 -- 172.21.15.42:0/4027141806 >> v1:172.21.15.42:6789/0 conn(0x7f0c1013d640 legacy=0x7f0c1013fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.277 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c0e7fc700 1 --2- 172.21.15.42:0/4027141806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bf00038e0 0x7f0bf0003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:55.277 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c0e7fc700 1 --2- 172.21.15.42:0/4027141806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bf00044d0 0x7f0bf0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:55.277 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c0e7fc700 1 --2- 172.21.15.42:0/4027141806 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c100a20b0 0x7f0bf0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:55.277 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c0e7fc700 1 -- 172.21.15.42:0/4027141806 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1009ab90 con 0x7f0bf00038e0 2020-04-02T23:24:55.277 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c0e7fc700 1 -- 172.21.15.42:0/4027141806 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf0005210 con 0x7f0bf00044d0 2020-04-02T23:24:55.278 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.263+0000 7f0c0e7fc700 1 -- 172.21.15.42:0/4027141806 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf000c830 con 0x7f0c100a20b0 2020-04-02T23:24:55.278 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.264+0000 7f0c0effd700 1 --2- 172.21.15.42:0/4027141806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bf00038e0 0x7f0bf0003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.278 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.264+0000 7f0c07fff700 1 --2- 172.21.15.42:0/4027141806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bf00044d0 0x7f0bf0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.278 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.264+0000 7f0c0f7fe700 1 --2- 172.21.15.42:0/4027141806 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c100a20b0 0x7f0bf0004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.278 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.264+0000 7f0c0effd700 1 -- 172.21.15.42:0/4027141806 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c100a20b0 msgr2=0x7f0bf0004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:55.278 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.264+0000 7f0c0effd700 1 --2- 172.21.15.42:0/4027141806 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c100a20b0 0x7f0bf0004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:55.278 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.264+0000 7f0c0effd700 1 -- 172.21.15.42:0/4027141806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bf00044d0 msgr2=0x7f0bf0004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:55.279 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.264+0000 7f0c0effd700 1 --2- 172.21.15.42:0/4027141806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bf00044d0 0x7f0bf0004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:55.279 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.264+0000 7f0c0effd700 1 -- 172.21.15.42:0/4027141806 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf0003230 con 0x7f0bf00038e0 2020-04-02T23:24:55.279 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.264+0000 7f0c0effd700 1 --2- 172.21.15.42:0/4027141806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bf00038e0 0x7f0bf0003ce0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0c00001110 tx=0x7f0c000015c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.279 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.264+0000 7f0c0effd700 1 --2- 172.21.15.42:0/4027141806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bf00038e0 0x7f0bf0003ce0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0c00001110 tx=0x7f0c000015c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.279 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.264+0000 7f0c0effd700 1 --2- 172.21.15.42:0/4027141806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bf00038e0 0x7f0bf0003ce0 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f0c00001110 tx=0x7f0c000015c0).ready entity=mon.0 client_cookie=3b66b631baed00af server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:55.279 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.264+0000 7f0c0effd700 1 --2- 172.21.15.42:0/4027141806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bf00038e0 0x7f0bf0003ce0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f0c00001110 tx=0x7f0c000015c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.279 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.264+0000 7f0c0e7fc700 1 -- 172.21.15.42:0/4027141806 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c00012e70 con 0x7f0bf00038e0 2020-04-02T23:24:55.280 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.264+0000 7f0c0effd700 1 --2- 172.21.15.42:0/4027141806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bf00038e0 0x7f0bf0003ce0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f0c00001110 tx=0x7f0c000015c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.280 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.264+0000 7f0c0effd700 1 --2- 172.21.15.42:0/4027141806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bf00038e0 0x7f0bf0003ce0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f0c00001110 tx=0x7f0c000015c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.280 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.264+0000 7f0c0e7fc700 1 -- 172.21.15.42:0/4027141806 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0000c3d0 con 0x7f0bf00038e0 2020-04-02T23:24:55.280 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.264+0000 7f0c0e7fc700 1 -- 172.21.15.42:0/4027141806 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c0000c7f0 con 0x7f0bf00038e0 2020-04-02T23:24:55.280 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.264+0000 7f0c15a5e700 1 -- 172.21.15.42:0/4027141806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bf00038e0 msgr2=0x7f0bf0003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.280 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.264+0000 7f0c15a5e700 1 --2- 172.21.15.42:0/4027141806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bf00038e0 0x7f0bf0003ce0 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f0c00001110 tx=0x7f0c000015c0).stop 2020-04-02T23:24:55.281 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.264+0000 7f0c0f7fe700 1 -- 172.21.15.42:0/4027141806 reap_dead start 2020-04-02T23:24:55.281 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.265+0000 7f0c15a5e700 1 -- 172.21.15.42:0/4027141806 shutdown_connections 2020-04-02T23:24:55.281 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.265+0000 7f0c15a5e700 1 -- 172.21.15.42:0/4027141806 >> 172.21.15.42:0/4027141806 conn(0x7f0c1005b720 msgr2=0x7f0c100aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:55.281 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.265+0000 7f0c15a5e700 1 -- 172.21.15.42:0/4027141806 shutdown_connections 2020-04-02T23:24:55.281 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.265+0000 7f0c15a5e700 1 -- 172.21.15.42:0/4027141806 wait complete. 2020-04-02T23:24:55.281 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.266+0000 7f0c15a5e700 1 Processor -- start 2020-04-02T23:24:55.281 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.266+0000 7f0c15a5e700 1 -- start start 2020-04-02T23:24:55.282 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.266+0000 7f0c15a5e700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c10142620 0x7f0c10061dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:55.282 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.266+0000 7f0c15a5e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0c1009c270 0x7f0c1009c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:55.282 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.266+0000 7f0c15a5e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1009cf30 con 0x7f0c1013caa0 2020-04-02T23:24:55.282 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.266+0000 7f0c15a5e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1005efb0 con 0x7f0c1009c270 2020-04-02T23:24:55.282 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.266+0000 7f0c15a5e700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1009d160 con 0x7f0c10142620 2020-04-02T23:24:55.282 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.266+0000 7f0c0effd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0c1013caa0 0x7f0c10141f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:53936/0 (socket says 172.21.15.42:53936) 2020-04-02T23:24:55.282 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.266+0000 7f0c0effd700 1 -- 172.21.15.42:0/3298662554 learned_addr learned my addr 172.21.15.42:0/3298662554 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:55.282 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.266+0000 7f0c07fff700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c10142620 0x7f0c10061dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.283 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.266+0000 7f0c0f7fe700 1 --2- 172.21.15.42:0/3298662554 >> v2:172.21.15.84:3300/0 conn(0x7f0c1009c270 0x7f0c1009c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.283 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.267+0000 7f0c0cff9700 1 -- 172.21.15.42:0/3298662554 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893778803 0 0) 0x7f0c1009cf30 con 0x7f0c1013caa0 2020-04-02T23:24:55.283 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.267+0000 7f0c0cff9700 1 -- 172.21.15.42:0/3298662554 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bf4002fe0 con 0x7f0c1013caa0 2020-04-02T23:24:55.283 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.267+0000 7f0c07fff700 1 -- 172.21.15.42:0/3298662554 >> v2:172.21.15.84:3300/0 conn(0x7f0c1009c270 msgr2=0x7f0c1009c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.283 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.267+0000 7f0c07fff700 1 --2- 172.21.15.42:0/3298662554 >> v2:172.21.15.84:3300/0 conn(0x7f0c1009c270 0x7f0c1009c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:55.284 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.267+0000 7f0c07fff700 1 -- 172.21.15.42:0/3298662554 >> v1:172.21.15.84:6789/0 conn(0x7f0c1013caa0 legacy=0x7f0c10141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.284 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.267+0000 7f0c07fff700 1 -- 172.21.15.42:0/3298662554 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1009d400 con 0x7f0c10142620 2020-04-02T23:24:55.284 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.267+0000 7f0c07fff700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c10142620 0x7f0c10061dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0c1009de10 tx=0x7f0bf8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.284 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.267+0000 7f0c07fff700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c10142620 0x7f0c10061dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0c1009de10 tx=0x7f0bf8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.284 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.267+0000 7f0c07fff700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c10142620 0x7f0c10061dd0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f0c1009de10 tx=0x7f0bf8010ba0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:55.284 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.267+0000 7f0c07fff700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c10142620 0x7f0c10061dd0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f0c1009de10 tx=0x7f0bf8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.267+0000 7f0c0cff9700 1 -- 172.21.15.42:0/3298662554 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bf8005ca0 con 0x7f0c10142620 2020-04-02T23:24:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.267+0000 7f0c07fff700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c10142620 0x7f0c10061dd0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f0c1009de10 tx=0x7f0bf8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.285 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.267+0000 7f0c07fff700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c10142620 0x7f0c10061dd0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f0c1009de10 tx=0x7f0bf8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.267+0000 7f0c0cff9700 1 -- 172.21.15.42:0/3298662554 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf8005e40 con 0x7f0c10142620 2020-04-02T23:24:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.267+0000 7f0c15a5e700 1 -- 172.21.15.42:0/3298662554 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c1009d6a0 con 0x7f0c10142620 2020-04-02T23:24:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.267+0000 7f0c0cff9700 1 -- 172.21.15.42:0/3298662554 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bf8007350 con 0x7f0c10142620 2020-04-02T23:24:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.267+0000 7f0c15a5e700 1 -- 172.21.15.42:0/3298662554 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c1009cb60 con 0x7f0c10142620 2020-04-02T23:24:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.268+0000 7f0c07fff700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c10142620 0x7f0c10061dd0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f0c1009de10 tx=0x7f0bf8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.268+0000 7f0c15a5e700 1 -- 172.21.15.42:0/3298662554 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0c1005d2e0 con 0x7f0c10142620 2020-04-02T23:24:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.268+0000 7f0c0cff9700 1 -- 172.21.15.42:0/3298662554 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f0bf8009480 con 0x7f0c10142620 2020-04-02T23:24:55.286 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.268+0000 7f0c07fff700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c10142620 0x7f0c10061dd0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f0c1009de10 tx=0x7f0bf8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.287 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.268+0000 7f0c07fff700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c10142620 0x7f0c10061dd0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f0c1009de10 tx=0x7f0bf8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.287 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.268+0000 7f0c0cff9700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f0bf404d880 0x7f0bf404fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:55.287 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.269+0000 7f0c0cff9700 1 -- 172.21.15.42:0/3298662554 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f0bf8060f70 con 0x7f0c10142620 2020-04-02T23:24:55.287 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.269+0000 7f0c0cff9700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:6826/24349,v1:172.21.15.84:6827/24349] conn(0x7f0bf4054890 0x7f0bf4056cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:55.287 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.269+0000 7f0c0cff9700 1 -- 172.21.15.42:0/3298662554 --> [v2:172.21.15.84:6826/24349,v1:172.21.15.84:6827/24349] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0bf4057270 con 0x7f0bf4054890 2020-04-02T23:24:55.287 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.269+0000 7f0c0cff9700 1 -- 172.21.15.42:0/3298662554 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bf8062490 con 0x7f0c10142620 2020-04-02T23:24:55.287 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.269+0000 7f0c0effd700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f0bf404d880 0x7f0bf404fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.288 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.269+0000 7f0c0f7fe700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:6826/24349,v1:172.21.15.84:6827/24349] conn(0x7f0bf4054890 0x7f0bf4056cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.288 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.269+0000 7f0c0effd700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f0bf404d880 0x7f0bf404fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0c00000b80 tx=0x7f0c000015c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.288 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.269+0000 7f0c0effd700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f0bf404d880 0x7f0bf404fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0c00000b80 tx=0x7f0c000015c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.288 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.269+0000 7f0c0effd700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f0bf404d880 0x7f0bf404fd40 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f0c00000b80 tx=0x7f0c000015c0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:55.288 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.269+0000 7f0c0f7fe700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:6826/24349,v1:172.21.15.84:6827/24349] conn(0x7f0bf4054890 0x7f0bf4056cb0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:55.288 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.270+0000 7f0c0cff9700 1 -- 172.21.15.42:0/3298662554 <== osd.7 v2:172.21.15.84:6826/24349 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f0bf4057270 con 0x7f0bf4054890 2020-04-02T23:24:55.290 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.288+0000 7f0c15a5e700 1 -- 172.21.15.42:0/3298662554 --> [v2:172.21.15.84:6826/24349,v1:172.21.15.84:6827/24349] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0c100ab340 con 0x7f0bf4054890 2020-04-02T23:24:55.291 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.288+0000 7f0c0cff9700 1 -- 172.21.15.42:0/3298662554 <== osd.7 v2:172.21.15.84:6826/24349 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0c100ab340 con 0x7f0bf4054890 2020-04-02T23:24:55.291 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.289+0000 7f0c15a5e700 1 -- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:6826/24349,v1:172.21.15.84:6827/24349] conn(0x7f0bf4054890 msgr2=0x7f0bf4056cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.291 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.289+0000 7f0c15a5e700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:6826/24349,v1:172.21.15.84:6827/24349] conn(0x7f0bf4054890 0x7f0bf4056cb0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:55.291 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.289+0000 7f0c15a5e700 1 -- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f0bf404d880 msgr2=0x7f0bf404fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.292 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.289+0000 7f0c15a5e700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f0bf404d880 0x7f0bf404fd40 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f0c00000b80 tx=0x7f0c000015c0).stop 2020-04-02T23:24:55.292 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.289+0000 7f0c15a5e700 1 -- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c10142620 msgr2=0x7f0c10061dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.292 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.289+0000 7f0c15a5e700 1 --2- 172.21.15.42:0/3298662554 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0c10142620 0x7f0c10061dd0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f0c1009de10 tx=0x7f0bf8010ba0).stop 2020-04-02T23:24:55.292 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.289+0000 7f0c0f7fe700 1 -- 172.21.15.42:0/3298662554 reap_dead start 2020-04-02T23:24:55.292 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.289+0000 7f0c15a5e700 1 -- 172.21.15.42:0/3298662554 shutdown_connections 2020-04-02T23:24:55.292 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.289+0000 7f0c15a5e700 1 -- 172.21.15.42:0/3298662554 >> 172.21.15.42:0/3298662554 conn(0x7f0c1005b720 msgr2=0x7f0c100a6890 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:55.293 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.289+0000 7f0c15a5e700 1 -- 172.21.15.42:0/3298662554 shutdown_connections 2020-04-02T23:24:55.293 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.289+0000 7f0c15a5e700 1 -- 172.21.15.42:0/3298662554 wait complete. 2020-04-02T23:24:55.300 INFO:teuthology.orchestra.run.smithi042.stdout:64424509445 2020-04-02T23:24:55.301 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:55.314 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-04-02T23:24:55.469 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.467+0000 7f91662c8700 1 Processor -- start 2020-04-02T23:24:55.469 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.467+0000 7f91662c8700 1 -- start start 2020-04-02T23:24:55.472 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.467+0000 7f91662c8700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f91600a9aa0 0x7f91601324a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:55.472 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.467+0000 7f91662c8700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9160132900 0x7f9160142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:55.472 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.467+0000 7f91662c8700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91600a9f50 con 0x7f91600ac310 2020-04-02T23:24:55.472 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.467+0000 7f91662c8700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91600ab660 con 0x7f91600a9aa0 2020-04-02T23:24:55.472 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.467+0000 7f91662c8700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91600a6180 con 0x7f9160132900 2020-04-02T23:24:55.473 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.467+0000 7f915ffff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f91600ac310 0x7f9160138680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59568/0 (socket says 172.21.15.42:59568) 2020-04-02T23:24:55.473 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.468+0000 7f915ffff700 1 -- 172.21.15.42:0/2011700825 learned_addr learned my addr 172.21.15.42:0/2011700825 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:55.473 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.468+0000 7f915f7fe700 1 --2- 172.21.15.42:0/2011700825 >> v2:172.21.15.42:3300/0 conn(0x7f91600a9aa0 0x7f91601324a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.473 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.468+0000 7f9164865700 1 --2- 172.21.15.42:0/2011700825 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9160132900 0x7f9160142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.473 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.468+0000 7f915f7fe700 1 -- 172.21.15.42:0/2011700825 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9160132900 msgr2=0x7f9160142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:55.473 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.468+0000 7f915f7fe700 1 --2- 172.21.15.42:0/2011700825 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9160132900 0x7f9160142fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:55.473 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.468+0000 7f915f7fe700 1 -- 172.21.15.42:0/2011700825 >> v1:172.21.15.42:6789/0 conn(0x7f91600ac310 legacy=0x7f9160138680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.474 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.468+0000 7f915effd700 1 -- 172.21.15.42:0/2011700825 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945437758 0 0) 0x7f91600a9f50 con 0x7f91600ac310 2020-04-02T23:24:55.474 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.468+0000 7f915f7fe700 1 -- 172.21.15.42:0/2011700825 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91600a6420 con 0x7f91600a9aa0 2020-04-02T23:24:55.474 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.468+0000 7f9164865700 1 --2- 172.21.15.42:0/2011700825 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9160132900 0x7f9160142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:24:55.474 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.468+0000 7f915f7fe700 1 --2- 172.21.15.42:0/2011700825 >> v2:172.21.15.42:3300/0 conn(0x7f91600a9aa0 0x7f91601324a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9154002f30 tx=0x7f9154007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.474 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.468+0000 7f915f7fe700 1 --2- 172.21.15.42:0/2011700825 >> v2:172.21.15.42:3300/0 conn(0x7f91600a9aa0 0x7f91601324a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9154002f30 tx=0x7f9154007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.474 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.468+0000 7f915f7fe700 1 --2- 172.21.15.42:0/2011700825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91600a9aa0 0x7f91601324a0 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f9154002f30 tx=0x7f9154007a40).ready entity=mon.0 client_cookie=3c99c7db35b9d969 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:55.474 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.468+0000 7f915f7fe700 1 --2- 172.21.15.42:0/2011700825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91600a9aa0 0x7f91601324a0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f9154002f30 tx=0x7f9154007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.475 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.468+0000 7f915effd700 1 -- 172.21.15.42:0/2011700825 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9154011470 con 0x7f91600a9aa0 2020-04-02T23:24:55.475 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.468+0000 7f915f7fe700 1 --2- 172.21.15.42:0/2011700825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91600a9aa0 0x7f91601324a0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f9154002f30 tx=0x7f9154007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.475 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.468+0000 7f915f7fe700 1 --2- 172.21.15.42:0/2011700825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91600a9aa0 0x7f91601324a0 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f9154002f30 tx=0x7f9154007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.475 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.468+0000 7f915effd700 1 -- 172.21.15.42:0/2011700825 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91540115d0 con 0x7f91600a9aa0 2020-04-02T23:24:55.475 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.468+0000 7f915effd700 1 -- 172.21.15.42:0/2011700825 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91540119b0 con 0x7f91600a9aa0 2020-04-02T23:24:55.475 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.468+0000 7f91662c8700 1 -- 172.21.15.42:0/2011700825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91600a9aa0 msgr2=0x7f91601324a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.476 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.468+0000 7f91662c8700 1 --2- 172.21.15.42:0/2011700825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91600a9aa0 0x7f91601324a0 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f9154002f30 tx=0x7f9154007a40).stop 2020-04-02T23:24:55.476 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.469+0000 7f91662c8700 1 -- 172.21.15.42:0/2011700825 shutdown_connections 2020-04-02T23:24:55.476 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.469+0000 7f91662c8700 1 --2- 172.21.15.42:0/2011700825 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9160132900 0x7f9160142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:55.476 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.469+0000 7f91662c8700 1 --2- 172.21.15.42:0/2011700825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91600a9aa0 0x7f91601324a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:55.476 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.469+0000 7f91662c8700 1 -- 172.21.15.42:0/2011700825 >> 172.21.15.42:0/2011700825 conn(0x7f9160060980 msgr2=0x7f91600ab880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:55.476 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.469+0000 7f91662c8700 1 -- 172.21.15.42:0/2011700825 shutdown_connections 2020-04-02T23:24:55.476 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.469+0000 7f91662c8700 1 -- 172.21.15.42:0/2011700825 wait complete. 2020-04-02T23:24:55.477 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.470+0000 7f91662c8700 1 Processor -- start 2020-04-02T23:24:55.477 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.470+0000 7f91662c8700 1 -- start start 2020-04-02T23:24:55.482 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.470+0000 7f91662c8700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f91600a9aa0 0x7f9160136f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:55.482 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.470+0000 7f91662c8700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91601490c0 con 0x7f9160132900 2020-04-02T23:24:55.482 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f91662c8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9160149360 con 0x7f91600ac310 2020-04-02T23:24:55.483 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f91662c8700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9160149f10 con 0x7f91600a9aa0 2020-04-02T23:24:55.484 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f9164865700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f9160132900 0x7f9160128af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59578/0 (socket says 172.21.15.42:59578) 2020-04-02T23:24:55.484 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f9164865700 1 -- 172.21.15.42:0/1122980433 learned_addr learned my addr 172.21.15.42:0/1122980433 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:55.484 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f915ffff700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f91600a9aa0 0x7f9160136f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.484 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f915d7fa700 1 -- 172.21.15.42:0/1122980433 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678413636 0 0) 0x7f91601490c0 con 0x7f9160132900 2020-04-02T23:24:55.484 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f915d7fa700 1 -- 172.21.15.42:0/1122980433 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9140002fe0 con 0x7f9160132900 2020-04-02T23:24:55.484 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f915d7fa700 1 -- 172.21.15.42:0/1122980433 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 290541083 0 0) 0x7f9140002fe0 con 0x7f9160132900 2020-04-02T23:24:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f915d7fa700 1 -- 172.21.15.42:0/1122980433 --> v1:172.21.15.42:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f91601490c0 con 0x7f9160132900 2020-04-02T23:24:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f915d7fa700 1 -- 172.21.15.42:0/1122980433 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7f9158001890 con 0x7f9160132900 2020-04-02T23:24:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f915d7fa700 1 -- 172.21.15.42:0/1122980433 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f91600a9aa0 msgr2=0x7f9160136f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f915d7fa700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f91600a9aa0 0x7f9160136f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f915d7fa700 1 -- 172.21.15.42:0/1122980433 >> v1:172.21.15.84:6789/0 conn(0x7f91600ac310 legacy=0x7f9160149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f915d7fa700 1 -- 172.21.15.42:0/1122980433 >> v1:172.21.15.42:6789/0 conn(0x7f9160132900 legacy=0x7f9160128af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f915d7fa700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f91400049b0 0x7f9140004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:55.486 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f915d7fa700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9140005210 0x7f9140003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:55.486 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f915d7fa700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9140003f00 0x7f9140004380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:55.486 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f915d7fa700 1 -- 172.21.15.42:0/1122980433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9160149f10 con 0x7f9140005210 2020-04-02T23:24:55.486 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f915d7fa700 1 -- 172.21.15.42:0/1122980433 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914000b890 con 0x7f9140003f00 2020-04-02T23:24:55.486 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f915d7fa700 1 -- 172.21.15.42:0/1122980433 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914000ba50 con 0x7f91400049b0 2020-04-02T23:24:55.486 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f915f7fe700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9140005210 0x7f9140003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.486 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f915ffff700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f91400049b0 0x7f9140004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.487 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.471+0000 7f9164865700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9140003f00 0x7f9140004380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.487 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.472+0000 7f915f7fe700 1 -- 172.21.15.42:0/1122980433 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f91400049b0 msgr2=0x7f9140004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.487 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.472+0000 7f915f7fe700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f91400049b0 0x7f9140004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:55.487 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.472+0000 7f915f7fe700 1 -- 172.21.15.42:0/1122980433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9140003f00 msgr2=0x7f9140004380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.487 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.472+0000 7f915f7fe700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9140003f00 0x7f9140004380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:55.487 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.472+0000 7f915f7fe700 1 -- 172.21.15.42:0/1122980433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91601379f0 con 0x7f9140005210 2020-04-02T23:24:55.487 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.472+0000 7f91662c8700 1 -- 172.21.15.42:0/1122980433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916012adb0 con 0x7f9140005210 2020-04-02T23:24:55.488 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.472+0000 7f9164865700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9140003f00 0x7f9140004380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:24:55.488 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.472+0000 7f915f7fe700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9140005210 0x7f9140003920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f91540088e0 tx=0x7f9154007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.488 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.472+0000 7f91662c8700 1 -- 172.21.15.42:0/1122980433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916012c790 con 0x7f9140005210 2020-04-02T23:24:55.488 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.472+0000 7f915f7fe700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9140005210 0x7f9140003920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f91540088e0 tx=0x7f9154007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.488 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.472+0000 7f915f7fe700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9140005210 0x7f9140003920 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f91540088e0 tx=0x7f9154007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:55.488 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.472+0000 7f915f7fe700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9140005210 0x7f9140003920 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f91540088e0 tx=0x7f9154007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.488 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.472+0000 7f915d7fa700 1 -- 172.21.15.42:0/1122980433 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9154011a20 con 0x7f9140005210 2020-04-02T23:24:55.489 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.472+0000 7f915f7fe700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9140005210 0x7f9140003920 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f91540088e0 tx=0x7f9154007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.489 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.472+0000 7f915f7fe700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9140005210 0x7f9140003920 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f91540088e0 tx=0x7f9154007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.490 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.472+0000 7f915d7fa700 1 -- 172.21.15.42:0/1122980433 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9154007340 con 0x7f9140005210 2020-04-02T23:24:55.490 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.472+0000 7f915d7fa700 1 -- 172.21.15.42:0/1122980433 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91540056c0 con 0x7f9140005210 2020-04-02T23:24:55.490 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.472+0000 7f915f7fe700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9140005210 0x7f9140003920 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f91540088e0 tx=0x7f9154007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.490 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.473+0000 7f91662c8700 1 -- 172.21.15.42:0/1122980433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913c003340 con 0x7f9140005210 2020-04-02T23:24:55.490 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.473+0000 7f915d7fa700 1 -- 172.21.15.42:0/1122980433 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f9154005820 con 0x7f9140005210 2020-04-02T23:24:55.490 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.473+0000 7f915f7fe700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9140005210 0x7f9140003920 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f91540088e0 tx=0x7f9154007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.490 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.473+0000 7f915d7fa700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9140055d80 0x7f9140058240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:55.491 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.473+0000 7f915d7fa700 1 -- 172.21.15.42:0/1122980433 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f9154061500 con 0x7f9140005210 2020-04-02T23:24:55.491 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.473+0000 7f915ffff700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9140055d80 0x7f9140058240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.491 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.473+0000 7f915ffff700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9140055d80 0x7f9140058240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9150000b80 tx=0x7f9150001a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.491 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.474+0000 7f915ffff700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9140055d80 0x7f9140058240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9150000b80 tx=0x7f9150001a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.491 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.474+0000 7f915ffff700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9140055d80 0x7f9140058240 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f9150000b80 tx=0x7f9150001a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:55.491 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.476+0000 7f915f7fe700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9140005210 0x7f9140003920 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f91540088e0 tx=0x7f9154007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.491 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.476+0000 7f915d7fa700 1 -- 172.21.15.42:0/1122980433 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f915403cce0 con 0x7f9140005210 2020-04-02T23:24:55.625 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.623+0000 7f91662c8700 1 -- 172.21.15.42:0/1122980433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f913c0021d0 con 0x7f9140005210 2020-04-02T23:24:55.625 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.623+0000 7f915f7fe700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9140005210 0x7f9140003920 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f91540088e0 tx=0x7f9154007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.625 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.623+0000 7f915d7fa700 1 -- 172.21.15.42:0/1122980433 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9154040300 con 0x7f9140005210 2020-04-02T23:24:55.625 INFO:teuthology.orchestra.run.smithi042.stdout:64424509445 2020-04-02T23:24:55.627 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.624+0000 7f91662c8700 1 -- 172.21.15.42:0/1122980433 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9140055d80 msgr2=0x7f9140058240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.627 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.624+0000 7f91662c8700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9140055d80 0x7f9140058240 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f9150000b80 tx=0x7f9150001a40).stop 2020-04-02T23:24:55.627 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.624+0000 7f91662c8700 1 -- 172.21.15.42:0/1122980433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9140005210 msgr2=0x7f9140003920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.627 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.624+0000 7f91662c8700 1 --2- 172.21.15.42:0/1122980433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9140005210 0x7f9140003920 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f91540088e0 tx=0x7f9154007a40).stop 2020-04-02T23:24:55.627 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.624+0000 7f9164865700 1 -- 172.21.15.42:0/1122980433 reap_dead start 2020-04-02T23:24:55.627 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.624+0000 7f9164865700 1 -- 172.21.15.42:0/1122980433 reap_dead start 2020-04-02T23:24:55.627 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.624+0000 7f91662c8700 1 -- 172.21.15.42:0/1122980433 shutdown_connections 2020-04-02T23:24:55.628 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.624+0000 7f91662c8700 1 -- 172.21.15.42:0/1122980433 >> 172.21.15.42:0/1122980433 conn(0x7f9160060980 msgr2=0x7f916012e700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:55.628 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.624+0000 7f91662c8700 1 -- 172.21.15.42:0/1122980433 shutdown_connections 2020-04-02T23:24:55.628 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.624+0000 7f91662c8700 1 -- 172.21.15.42:0/1122980433 wait complete. 2020-04-02T23:24:55.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.0 2020-04-02T23:24:55.637 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:55.650 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-04-02T23:24:55.805 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.803+0000 7f7c40812700 1 Processor -- start 2020-04-02T23:24:55.805 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.803+0000 7f7c40812700 1 -- start start 2020-04-02T23:24:55.808 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.804+0000 7f7c40812700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c065ce0 0x7f7c3c0ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:55.808 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.804+0000 7f7c40812700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7c3c0a69a0 0x7f7c3c0a6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:55.808 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.804+0000 7f7c40812700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3c0a1cd0 con 0x7f7c3c13c1f0 2020-04-02T23:24:55.809 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.804+0000 7f7c40812700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c3c0ab7a0 con 0x7f7c3c0a69a0 2020-04-02T23:24:55.809 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.804+0000 7f7c40812700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0a6500 con 0x7f7c3c065ce0 2020-04-02T23:24:55.809 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.804+0000 7f7c3ad9d700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f7c3c13c1f0 0x7f7c3c13c660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59592/0 (socket says 172.21.15.42:59592) 2020-04-02T23:24:55.809 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.804+0000 7f7c3ad9d700 1 -- 172.21.15.42:0/637564430 learned_addr learned my addr 172.21.15.42:0/637564430 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:55.809 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.804+0000 7f7c33fff700 1 --2- 172.21.15.42:0/637564430 >> v2:172.21.15.84:3300/0 conn(0x7f7c3c0a69a0 0x7f7c3c0a6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.809 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.804+0000 7f7c3a59c700 1 --2- 172.21.15.42:0/637564430 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c065ce0 0x7f7c3c0ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.809 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.804+0000 7f7c39d9b700 1 -- 172.21.15.42:0/637564430 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3933674746 0 0) 0x7f7c3c0a1cd0 con 0x7f7c3c13c1f0 2020-04-02T23:24:55.809 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.804+0000 7f7c39d9b700 1 -- 172.21.15.42:0/637564430 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c1c003230 con 0x7f7c3c13c1f0 2020-04-02T23:24:55.810 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.804+0000 7f7c3a59c700 1 -- 172.21.15.42:0/637564430 >> v2:172.21.15.84:3300/0 conn(0x7f7c3c0a69a0 msgr2=0x7f7c3c0a6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:55.810 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.804+0000 7f7c3a59c700 1 --2- 172.21.15.42:0/637564430 >> v2:172.21.15.84:3300/0 conn(0x7f7c3c0a69a0 0x7f7c3c0a6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:55.810 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.804+0000 7f7c3a59c700 1 -- 172.21.15.42:0/637564430 >> v1:172.21.15.42:6789/0 conn(0x7f7c3c13c1f0 legacy=0x7f7c3c13c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.810 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.804+0000 7f7c3a59c700 1 -- 172.21.15.42:0/637564430 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c0a6260 con 0x7f7c3c065ce0 2020-04-02T23:24:55.810 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.804+0000 7f7c33fff700 1 --2- 172.21.15.42:0/637564430 >> v2:172.21.15.84:3300/0 conn(0x7f7c3c0a69a0 0x7f7c3c0a6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:55.810 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.804+0000 7f7c3a59c700 1 --2- 172.21.15.42:0/637564430 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c065ce0 0x7f7c3c0ab090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7c2c002f30 tx=0x7f7c2c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.810 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.804+0000 7f7c3a59c700 1 --2- 172.21.15.42:0/637564430 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c065ce0 0x7f7c3c0ab090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7c2c002f30 tx=0x7f7c2c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.811 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.804+0000 7f7c3a59c700 1 --2- 172.21.15.42:0/637564430 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c065ce0 0x7f7c3c0ab090 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f7c2c002f30 tx=0x7f7c2c007a40).ready entity=mon.2 client_cookie=d75a14f0d8c4ce0d server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:55.811 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.805+0000 7f7c3a59c700 1 --2- 172.21.15.42:0/637564430 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c065ce0 0x7f7c3c0ab090 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f7c2c002f30 tx=0x7f7c2c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.811 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.805+0000 7f7c39d9b700 1 -- 172.21.15.42:0/637564430 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c2c011310 con 0x7f7c3c065ce0 2020-04-02T23:24:55.811 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.805+0000 7f7c3a59c700 1 --2- 172.21.15.42:0/637564430 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c065ce0 0x7f7c3c0ab090 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f7c2c002f30 tx=0x7f7c2c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.811 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.805+0000 7f7c39d9b700 1 -- 172.21.15.42:0/637564430 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c011470 con 0x7f7c3c065ce0 2020-04-02T23:24:55.811 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.805+0000 7f7c3a59c700 1 --2- 172.21.15.42:0/637564430 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c065ce0 0x7f7c3c0ab090 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f7c2c002f30 tx=0x7f7c2c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.811 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.805+0000 7f7c39d9b700 1 -- 172.21.15.42:0/637564430 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c2c011850 con 0x7f7c3c065ce0 2020-04-02T23:24:55.812 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.805+0000 7f7c40812700 1 -- 172.21.15.42:0/637564430 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c065ce0 msgr2=0x7f7c3c0ab090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.812 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.805+0000 7f7c40812700 1 --2- 172.21.15.42:0/637564430 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c065ce0 0x7f7c3c0ab090 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f7c2c002f30 tx=0x7f7c2c007a40).stop 2020-04-02T23:24:55.812 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.805+0000 7f7c40812700 1 -- 172.21.15.42:0/637564430 shutdown_connections 2020-04-02T23:24:55.812 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.805+0000 7f7c40812700 1 --2- 172.21.15.42:0/637564430 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c065ce0 0x7f7c3c0ab090 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:55.812 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.805+0000 7f7c40812700 1 --2- 172.21.15.42:0/637564430 >> v2:172.21.15.84:3300/0 conn(0x7f7c3c0a69a0 0x7f7c3c0a6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:55.812 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.805+0000 7f7c40812700 1 -- 172.21.15.42:0/637564430 >> 172.21.15.42:0/637564430 conn(0x7f7c3c05b720 msgr2=0x7f7c3c0aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:55.812 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.805+0000 7f7c40812700 1 -- 172.21.15.42:0/637564430 shutdown_connections 2020-04-02T23:24:55.813 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.805+0000 7f7c40812700 1 -- 172.21.15.42:0/637564430 wait complete. 2020-04-02T23:24:55.813 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.806+0000 7f7c40812700 1 Processor -- start 2020-04-02T23:24:55.813 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.806+0000 7f7c40812700 1 -- start start 2020-04-02T23:24:55.816 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c40812700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c13c1f0 0x7f7c3c09b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:55.817 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c40812700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3c09ca90 con 0x7f7c3c065ce0 2020-04-02T23:24:55.817 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c40812700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3c09cd30 con 0x7f7c3c0a69a0 2020-04-02T23:24:55.817 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c40812700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c09bc50 con 0x7f7c3c13c1f0 2020-04-02T23:24:55.817 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c3a59c700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f7c3c065ce0 0x7f7c3c0a0e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59594/0 (socket says 172.21.15.42:59594) 2020-04-02T23:24:55.817 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c3a59c700 1 -- 172.21.15.42:0/512355596 learned_addr learned my addr 172.21.15.42:0/512355596 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:55.817 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c3ad9d700 1 --2- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c13c1f0 0x7f7c3c09b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.818 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c337fe700 1 -- 172.21.15.42:0/512355596 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808090040 0 0) 0x7f7c3c09ca90 con 0x7f7c3c065ce0 2020-04-02T23:24:55.818 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c337fe700 1 -- 172.21.15.42:0/512355596 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c20002fe0 con 0x7f7c3c065ce0 2020-04-02T23:24:55.818 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c337fe700 1 -- 172.21.15.42:0/512355596 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663605234 0 0) 0x7f7c3c09cd30 con 0x7f7c3c0a69a0 2020-04-02T23:24:55.818 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c337fe700 1 -- 172.21.15.42:0/512355596 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c3c09ca90 con 0x7f7c3c0a69a0 2020-04-02T23:24:55.818 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c3ad9d700 1 -- 172.21.15.42:0/512355596 >> v1:172.21.15.84:6789/0 conn(0x7f7c3c0a69a0 legacy=0x7f7c3c149400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.818 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c3ad9d700 1 -- 172.21.15.42:0/512355596 >> v1:172.21.15.42:6789/0 conn(0x7f7c3c065ce0 legacy=0x7f7c3c0a0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.818 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c3ad9d700 1 -- 172.21.15.42:0/512355596 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c0a1560 con 0x7f7c3c13c1f0 2020-04-02T23:24:55.818 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c3ad9d700 1 --2- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c13c1f0 0x7f7c3c09b690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c3c09c120 tx=0x7f7c34010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.819 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c3ad9d700 1 --2- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c13c1f0 0x7f7c3c09b690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c3c09c120 tx=0x7f7c34010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.819 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c3ad9d700 1 --2- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c13c1f0 0x7f7c3c09b690 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f7c3c09c120 tx=0x7f7c34010c20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:55.819 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c3ad9d700 1 --2- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c13c1f0 0x7f7c3c09b690 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f7c3c09c120 tx=0x7f7c34010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.819 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c337fe700 1 -- 172.21.15.42:0/512355596 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c34005e50 con 0x7f7c3c13c1f0 2020-04-02T23:24:55.819 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c3ad9d700 1 --2- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c13c1f0 0x7f7c3c09b690 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f7c3c09c120 tx=0x7f7c34010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.819 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.807+0000 7f7c3ad9d700 1 --2- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c13c1f0 0x7f7c3c09b690 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f7c3c09c120 tx=0x7f7c34010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.819 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.808+0000 7f7c337fe700 1 -- 172.21.15.42:0/512355596 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c340123c0 con 0x7f7c3c13c1f0 2020-04-02T23:24:55.820 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.808+0000 7f7c40812700 1 -- 172.21.15.42:0/512355596 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3c09e2b0 con 0x7f7c3c13c1f0 2020-04-02T23:24:55.820 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.808+0000 7f7c337fe700 1 -- 172.21.15.42:0/512355596 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c340127a0 con 0x7f7c3c13c1f0 2020-04-02T23:24:55.820 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.808+0000 7f7c40812700 1 -- 172.21.15.42:0/512355596 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3c149cd0 con 0x7f7c3c13c1f0 2020-04-02T23:24:55.820 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.808+0000 7f7c3ad9d700 1 --2- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c13c1f0 0x7f7c3c09b690 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f7c3c09c120 tx=0x7f7c34010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.820 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.809+0000 7f7c40812700 1 -- 172.21.15.42:0/512355596 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3c0a16f0 con 0x7f7c3c13c1f0 2020-04-02T23:24:55.820 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.809+0000 7f7c337fe700 1 -- 172.21.15.42:0/512355596 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f7c34012900 con 0x7f7c3c13c1f0 2020-04-02T23:24:55.820 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.809+0000 7f7c3ad9d700 1 --2- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c13c1f0 0x7f7c3c09b690 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f7c3c09c120 tx=0x7f7c34010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.821 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.809+0000 7f7c337fe700 1 --2- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f7c2004da70 0x7f7c2004ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:55.821 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.809+0000 7f7c337fe700 1 -- 172.21.15.42:0/512355596 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7c34061130 con 0x7f7c3c13c1f0 2020-04-02T23:24:55.821 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.809+0000 7f7c3a59c700 1 --2- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f7c2004da70 0x7f7c2004ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:55.821 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.809+0000 7f7c3a59c700 1 --2- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f7c2004da70 0x7f7c2004ff30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c2c000b80 tx=0x7f7c2c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.821 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.809+0000 7f7c3a59c700 1 --2- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f7c2004da70 0x7f7c2004ff30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c2c000b80 tx=0x7f7c2c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.821 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.809+0000 7f7c3a59c700 1 --2- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f7c2004da70 0x7f7c2004ff30 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f7c2c000b80 tx=0x7f7c2c007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:55.821 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.813+0000 7f7c3ad9d700 1 --2- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c13c1f0 0x7f7c3c09b690 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f7c3c09c120 tx=0x7f7c34010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.822 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.813+0000 7f7c337fe700 1 -- 172.21.15.42:0/512355596 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f7c3403c8f0 con 0x7f7c3c13c1f0 2020-04-02T23:24:55.962 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.960+0000 7f7c40812700 1 -- 172.21.15.42:0/512355596 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7c3c05d2e0 con 0x7f7c3c13c1f0 2020-04-02T23:24:55.962 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.960+0000 7f7c3ad9d700 1 --2- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c13c1f0 0x7f7c3c09b690 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7f7c3c09c120 tx=0x7f7c34010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:55.963 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.960+0000 7f7c337fe700 1 -- 172.21.15.42:0/512355596 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7c3403ff10 con 0x7f7c3c13c1f0 2020-04-02T23:24:55.963 INFO:teuthology.orchestra.run.smithi042.stdout:64424509447 2020-04-02T23:24:55.964 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.962+0000 7f7c40812700 1 -- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f7c2004da70 msgr2=0x7f7c2004ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.964 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.962+0000 7f7c40812700 1 --2- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f7c2004da70 0x7f7c2004ff30 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f7c2c000b80 tx=0x7f7c2c007a40).stop 2020-04-02T23:24:55.965 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.962+0000 7f7c40812700 1 -- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c13c1f0 msgr2=0x7f7c3c09b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:55.965 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.962+0000 7f7c40812700 1 --2- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c13c1f0 0x7f7c3c09b690 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7f7c3c09c120 tx=0x7f7c34010c20).stop 2020-04-02T23:24:55.965 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.962+0000 7f7c40812700 1 -- 172.21.15.42:0/512355596 shutdown_connections 2020-04-02T23:24:55.965 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.962+0000 7f7c40812700 1 --2- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f7c2004da70 0x7f7c2004ff30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:55.965 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.962+0000 7f7c40812700 1 --2- 172.21.15.42:0/512355596 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7c3c13c1f0 0x7f7c3c09b690 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:55.965 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.962+0000 7f7c40812700 1 -- 172.21.15.42:0/512355596 >> 172.21.15.42:0/512355596 conn(0x7f7c3c05b720 msgr2=0x7f7c3c0aa110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:55.965 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.962+0000 7f7c40812700 1 -- 172.21.15.42:0/512355596 shutdown_connections 2020-04-02T23:24:55.966 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:55.962+0000 7f7c40812700 1 -- 172.21.15.42:0/512355596 wait complete. 2020-04-02T23:24:55.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2020-04-02T23:24:55.974 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:55.988 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-04-02T23:24:56.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.140+0000 7f2709561700 1 Processor -- start 2020-04-02T23:24:56.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.141+0000 7f2709561700 1 -- start start 2020-04-02T23:24:56.146 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.141+0000 7f2709561700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f270413e3f0 0x7f27041407e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:56.146 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.141+0000 7f2709561700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2704140c40 0x7f2704143030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:56.146 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.141+0000 7f2709561700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27040a4060 con 0x7f27040ad460 2020-04-02T23:24:56.146 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.141+0000 7f2709561700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27040626b0 con 0x7f270413e3f0 2020-04-02T23:24:56.146 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.141+0000 7f2709561700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2704060f70 con 0x7f2704140c40 2020-04-02T23:24:56.146 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.141+0000 7f27027fc700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f270413e3f0 0x7f27041407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:56.146 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.141+0000 7f27027fc700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f270413e3f0 0x7f27041407e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40178/0 (socket says 172.21.15.42:40178) 2020-04-02T23:24:56.147 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.141+0000 7f27027fc700 1 -- 172.21.15.42:0/136886182 learned_addr learned my addr 172.21.15.42:0/136886182 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:56.147 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.142+0000 7f27037fe700 1 --2- 172.21.15.42:0/136886182 >> v2:172.21.15.84:3300/0 conn(0x7f2704140c40 0x7f2704143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:56.147 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.142+0000 7f27027fc700 1 -- 172.21.15.42:0/136886182 >> v2:172.21.15.84:3300/0 conn(0x7f2704140c40 msgr2=0x7f2704143030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:56.147 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.142+0000 7f27027fc700 1 --2- 172.21.15.42:0/136886182 >> v2:172.21.15.84:3300/0 conn(0x7f2704140c40 0x7f2704143030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:56.147 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.142+0000 7f27027fc700 1 -- 172.21.15.42:0/136886182 >> v1:172.21.15.84:6789/0 conn(0x7f27040ad460 legacy=0x7f27040a83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.147 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.142+0000 7f27027fc700 1 -- 172.21.15.42:0/136886182 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2704060400 con 0x7f270413e3f0 2020-04-02T23:24:56.147 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.142+0000 7f27027fc700 1 --2- 172.21.15.42:0/136886182 >> v2:172.21.15.42:3300/0 conn(0x7f270413e3f0 0x7f27041407e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f26f4002f30 tx=0x7f26f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.148 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.142+0000 7f27027fc700 1 --2- 172.21.15.42:0/136886182 >> v2:172.21.15.42:3300/0 conn(0x7f270413e3f0 0x7f27041407e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f26f4002f30 tx=0x7f26f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.148 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.142+0000 7f27027fc700 1 --2- 172.21.15.42:0/136886182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f270413e3f0 0x7f27041407e0 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7f26f4002f30 tx=0x7f26f4007a40).ready entity=mon.0 client_cookie=53b055a2eccc868f server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:56.148 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.142+0000 7f27027fc700 1 --2- 172.21.15.42:0/136886182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f270413e3f0 0x7f27041407e0 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f26f4002f30 tx=0x7f26f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.148 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.142+0000 7f27027fc700 1 --2- 172.21.15.42:0/136886182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f270413e3f0 0x7f27041407e0 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f26f4002f30 tx=0x7f26f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.148 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.142+0000 7f2701ffb700 1 -- 172.21.15.42:0/136886182 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26f4011720 con 0x7f270413e3f0 2020-04-02T23:24:56.148 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.142+0000 7f27027fc700 1 --2- 172.21.15.42:0/136886182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f270413e3f0 0x7f27041407e0 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7f26f4002f30 tx=0x7f26f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.148 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.142+0000 7f2701ffb700 1 -- 172.21.15.42:0/136886182 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f4011880 con 0x7f270413e3f0 2020-04-02T23:24:56.149 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.142+0000 7f2701ffb700 1 -- 172.21.15.42:0/136886182 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26f4011c60 con 0x7f270413e3f0 2020-04-02T23:24:56.149 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.142+0000 7f2709561700 1 -- 172.21.15.42:0/136886182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f270413e3f0 msgr2=0x7f27041407e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.149 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.142+0000 7f2709561700 1 --2- 172.21.15.42:0/136886182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f270413e3f0 0x7f27041407e0 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7f26f4002f30 tx=0x7f26f4007a40).stop 2020-04-02T23:24:56.149 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.143+0000 7f2709561700 1 -- 172.21.15.42:0/136886182 shutdown_connections 2020-04-02T23:24:56.149 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.143+0000 7f2709561700 1 --2- 172.21.15.42:0/136886182 >> v2:172.21.15.84:3300/0 conn(0x7f2704140c40 0x7f2704143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:56.149 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.143+0000 7f2709561700 1 --2- 172.21.15.42:0/136886182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f270413e3f0 0x7f27041407e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:56.149 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.143+0000 7f2709561700 1 -- 172.21.15.42:0/136886182 >> 172.21.15.42:0/136886182 conn(0x7f2704062930 msgr2=0x7f27040acb90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:56.149 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.143+0000 7f2709561700 1 -- 172.21.15.42:0/136886182 shutdown_connections 2020-04-02T23:24:56.150 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.143+0000 7f2709561700 1 -- 172.21.15.42:0/136886182 wait complete. 2020-04-02T23:24:56.150 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.144+0000 7f2709561700 1 Processor -- start 2020-04-02T23:24:56.150 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.144+0000 7f2709561700 1 -- start start 2020-04-02T23:24:56.155 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.144+0000 7f2709561700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f270413e3f0 0x7f27040a23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:56.155 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.144+0000 7f2709561700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27040a0bc0 con 0x7f27040ad460 2020-04-02T23:24:56.155 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.144+0000 7f2709561700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27040a0e60 con 0x7f2704140c40 2020-04-02T23:24:56.155 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.144+0000 7f2709561700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f270409cb80 con 0x7f270413e3f0 2020-04-02T23:24:56.155 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.144+0000 7f2702ffd700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f27040ad460 0x7f27040a15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59608/0 (socket says 172.21.15.42:59608) 2020-04-02T23:24:56.156 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.144+0000 7f2702ffd700 1 -- 172.21.15.42:0/258827668 learned_addr learned my addr 172.21.15.42:0/258827668 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:56.156 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.144+0000 7f27027fc700 1 --2- 172.21.15.42:0/258827668 >> v2:172.21.15.84:3300/0 conn(0x7f270413e3f0 0x7f27040a23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:56.156 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.144+0000 7f26fbfff700 1 -- 172.21.15.42:0/258827668 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341732374 0 0) 0x7f27040a0bc0 con 0x7f27040ad460 2020-04-02T23:24:56.156 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.144+0000 7f26fbfff700 1 -- 172.21.15.42:0/258827668 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26e8002fe0 con 0x7f27040ad460 2020-04-02T23:24:56.156 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f26fbfff700 1 -- 172.21.15.42:0/258827668 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215980944 0 0) 0x7f27040a0e60 con 0x7f2704140c40 2020-04-02T23:24:56.156 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f26fbfff700 1 -- 172.21.15.42:0/258827668 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27040a0bc0 con 0x7f2704140c40 2020-04-02T23:24:56.156 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f26fbfff700 1 -- 172.21.15.42:0/258827668 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3354583371 0 0) 0x7f26e8002fe0 con 0x7f27040ad460 2020-04-02T23:24:56.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f26fbfff700 1 -- 172.21.15.42:0/258827668 --> v1:172.21.15.42:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f27040a0e60 con 0x7f27040ad460 2020-04-02T23:24:56.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f26fbfff700 1 -- 172.21.15.42:0/258827668 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7f26ec001930 con 0x7f27040ad460 2020-04-02T23:24:56.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f26fbfff700 1 -- 172.21.15.42:0/258827668 >> v2:172.21.15.84:3300/0 conn(0x7f270413e3f0 msgr2=0x7f27040a23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f26fbfff700 1 --2- 172.21.15.42:0/258827668 >> v2:172.21.15.84:3300/0 conn(0x7f270413e3f0 0x7f27040a23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:56.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f26fbfff700 1 -- 172.21.15.42:0/258827668 >> v1:172.21.15.84:6789/0 conn(0x7f2704140c40 legacy=0x7f270413cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f26fbfff700 1 -- 172.21.15.42:0/258827668 >> v1:172.21.15.42:6789/0 conn(0x7f27040ad460 legacy=0x7f27040a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f26fbfff700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e8004b20 0x7f26e8004f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:56.158 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f26fbfff700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e8003ab0 0x7f26e8003f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:56.158 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f26fbfff700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f26e8004390 0x7f26e800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:56.158 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f26fbfff700 1 -- 172.21.15.42:0/258827668 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e8004820 con 0x7f26e8004b20 2020-04-02T23:24:56.158 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f26fbfff700 1 -- 172.21.15.42:0/258827668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e800bbb0 con 0x7f26e8003ab0 2020-04-02T23:24:56.158 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f26fbfff700 1 -- 172.21.15.42:0/258827668 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e800bcf0 con 0x7f26e8004390 2020-04-02T23:24:56.158 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f2702ffd700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e8004b20 0x7f26e8004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:56.158 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f27027fc700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e8003ab0 0x7f26e8003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:56.159 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f27037fe700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f26e8004390 0x7f26e800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:56.159 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f2702ffd700 1 -- 172.21.15.42:0/258827668 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f26e8004390 msgr2=0x7f26e800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.159 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f2702ffd700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f26e8004390 0x7f26e800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:56.159 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f2702ffd700 1 -- 172.21.15.42:0/258827668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e8003ab0 msgr2=0x7f26e8003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.159 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f2702ffd700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e8003ab0 0x7f26e8003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:56.159 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f2702ffd700 1 -- 172.21.15.42:0/258827668 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27040a1100 con 0x7f26e8004b20 2020-04-02T23:24:56.159 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f27037fe700 1 -- 172.21.15.42:0/258827668 reap_dead start 2020-04-02T23:24:56.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f2709561700 1 -- 172.21.15.42:0/258827668 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f270409ddf0 con 0x7f26e8004b20 2020-04-02T23:24:56.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f2702ffd700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e8004b20 0x7f26e8004f40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26ec001700 tx=0x7f26ec011380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f2709561700 1 -- 172.21.15.42:0/258827668 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27040a23b0 con 0x7f26e8004b20 2020-04-02T23:24:56.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f2702ffd700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e8004b20 0x7f26e8004f40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26ec001700 tx=0x7f26ec011380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f2702ffd700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e8004b20 0x7f26e8004f40 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7f26ec001700 tx=0x7f26ec011380).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:56.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.145+0000 7f2702ffd700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e8004b20 0x7f26e8004f40 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f26ec001700 tx=0x7f26ec011380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.146+0000 7f2702ffd700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e8004b20 0x7f26e8004f40 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f26ec001700 tx=0x7f26ec011380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.146+0000 7f26fbfff700 1 -- 172.21.15.42:0/258827668 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26ec011af0 con 0x7f26e8004b20 2020-04-02T23:24:56.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.146+0000 7f2702ffd700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e8004b20 0x7f26e8004f40 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f26ec001700 tx=0x7f26ec011380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.146+0000 7f26fbfff700 1 -- 172.21.15.42:0/258827668 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ec011c50 con 0x7f26e8004b20 2020-04-02T23:24:56.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.146+0000 7f26fbfff700 1 -- 172.21.15.42:0/258827668 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26ec010390 con 0x7f26e8004b20 2020-04-02T23:24:56.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.146+0000 7f2702ffd700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e8004b20 0x7f26e8004f40 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f26ec001700 tx=0x7f26ec011380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.146+0000 7f2709561700 1 -- 172.21.15.42:0/258827668 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26dc003340 con 0x7f26e8004b20 2020-04-02T23:24:56.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.146+0000 7f26fbfff700 1 -- 172.21.15.42:0/258827668 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f26ec0104f0 con 0x7f26e8004b20 2020-04-02T23:24:56.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.146+0000 7f2702ffd700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e8004b20 0x7f26e8004f40 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f26ec001700 tx=0x7f26ec011380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.147+0000 7f26fbfff700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f26e8051690 0x7f26e8053b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:56.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.147+0000 7f26fbfff700 1 -- 172.21.15.42:0/258827668 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f26ec0612c0 con 0x7f26e8004b20 2020-04-02T23:24:56.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.147+0000 7f27027fc700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f26e8051690 0x7f26e8053b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:56.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.147+0000 7f27027fc700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f26e8051690 0x7f26e8053b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26f4002f30 tx=0x7f26f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.147+0000 7f27027fc700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f26e8051690 0x7f26e8053b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26f4002f30 tx=0x7f26f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.147+0000 7f27027fc700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f26e8051690 0x7f26e8053b50 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f26f4002f30 tx=0x7f26f4007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:56.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.150+0000 7f2702ffd700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e8004b20 0x7f26e8004f40 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f26ec001700 tx=0x7f26ec011380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.150+0000 7f26fbfff700 1 -- 172.21.15.42:0/258827668 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f26ec03ca20 con 0x7f26e8004b20 2020-04-02T23:24:56.299 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.296+0000 7f2709561700 1 -- 172.21.15.42:0/258827668 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f26dc0021d0 con 0x7f26e8004b20 2020-04-02T23:24:56.299 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.297+0000 7f2702ffd700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e8004b20 0x7f26e8004f40 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f26ec001700 tx=0x7f26ec011380).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.299 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.297+0000 7f26fbfff700 1 -- 172.21.15.42:0/258827668 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f26ec040040 con 0x7f26e8004b20 2020-04-02T23:24:56.299 INFO:teuthology.orchestra.run.smithi042.stdout:64424509445 2020-04-02T23:24:56.300 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.298+0000 7f2709561700 1 -- 172.21.15.42:0/258827668 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f26e8051690 msgr2=0x7f26e8053b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.301 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.298+0000 7f2709561700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f26e8051690 0x7f26e8053b50 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f26f4002f30 tx=0x7f26f4007a40).stop 2020-04-02T23:24:56.301 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.298+0000 7f2709561700 1 -- 172.21.15.42:0/258827668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e8004b20 msgr2=0x7f26e8004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.301 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.298+0000 7f2709561700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e8004b20 0x7f26e8004f40 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7f26ec001700 tx=0x7f26ec011380).stop 2020-04-02T23:24:56.301 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.298+0000 7f2709561700 1 -- 172.21.15.42:0/258827668 shutdown_connections 2020-04-02T23:24:56.301 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.298+0000 7f2709561700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f26e8051690 0x7f26e8053b50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:56.301 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.298+0000 7f2709561700 1 --2- 172.21.15.42:0/258827668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e8004b20 0x7f26e8004f40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:56.301 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.298+0000 7f2709561700 1 -- 172.21.15.42:0/258827668 >> 172.21.15.42:0/258827668 conn(0x7f2704062930 msgr2=0x7f27040a7230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:56.302 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.298+0000 7f2709561700 1 -- 172.21.15.42:0/258827668 shutdown_connections 2020-04-02T23:24:56.302 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.298+0000 7f2709561700 1 -- 172.21.15.42:0/258827668 wait complete. 2020-04-02T23:24:56.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.2 2020-04-02T23:24:56.317 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:56.330 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-04-02T23:24:56.484 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.482+0000 7fe4e5faa700 1 Processor -- start 2020-04-02T23:24:56.484 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.482+0000 7fe4e5faa700 1 -- start start 2020-04-02T23:24:56.491 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.483+0000 7fe4e5faa700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe4e00ab410 0x7fe4e00a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:56.491 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.483+0000 7fe4e5faa700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a23e0 0x7fe4e00a2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:56.491 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.483+0000 7fe4e5faa700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e00a31b0 con 0x7fe4e00a6a90 2020-04-02T23:24:56.491 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.483+0000 7fe4e5faa700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e00a49f0 con 0x7fe4e00ab410 2020-04-02T23:24:56.491 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.483+0000 7fe4e5faa700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e005ff40 con 0x7fe4e00a23e0 2020-04-02T23:24:56.491 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.483+0000 7fe4dffff700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a23e0 0x7fe4e00a2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:56.492 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.483+0000 7fe4df7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe4e00ab410 0x7fe4e00a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:56.492 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.483+0000 7fe4deffd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe4e00a6a90 0x7fe4e00a1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:54000/0 (socket says 172.21.15.42:54000) 2020-04-02T23:24:56.492 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.483+0000 7fe4deffd700 1 -- 172.21.15.42:0/2925531530 learned_addr learned my addr 172.21.15.42:0/2925531530 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:56.492 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.483+0000 7fe4de7fc700 1 -- 172.21.15.42:0/2925531530 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502883226 0 0) 0x7fe4e00a31b0 con 0x7fe4e00a6a90 2020-04-02T23:24:56.492 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.483+0000 7fe4de7fc700 1 -- 172.21.15.42:0/2925531530 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4cc003230 con 0x7fe4e00a6a90 2020-04-02T23:24:56.492 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.483+0000 7fe4df7fe700 1 -- 172.21.15.42:0/2925531530 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a23e0 msgr2=0x7fe4e00a2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:56.492 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.483+0000 7fe4df7fe700 1 --2- 172.21.15.42:0/2925531530 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a23e0 0x7fe4e00a2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:56.493 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.483+0000 7fe4df7fe700 1 -- 172.21.15.42:0/2925531530 >> v1:172.21.15.84:6789/0 conn(0x7fe4e00a6a90 legacy=0x7fe4e00a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.493 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.483+0000 7fe4df7fe700 1 -- 172.21.15.42:0/2925531530 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e00a3420 con 0x7fe4e00ab410 2020-04-02T23:24:56.493 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.483+0000 7fe4dffff700 1 --2- 172.21.15.42:0/2925531530 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a23e0 0x7fe4e00a2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:24:56.493 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.483+0000 7fe4df7fe700 1 --2- 172.21.15.42:0/2925531530 >> v2:172.21.15.84:3300/0 conn(0x7fe4e00ab410 0x7fe4e00a6630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe4d0002f30 tx=0x7fe4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.493 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.484+0000 7fe4df7fe700 1 --2- 172.21.15.42:0/2925531530 >> v2:172.21.15.84:3300/0 conn(0x7fe4e00ab410 0x7fe4e00a6630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe4d0002f30 tx=0x7fe4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.493 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.484+0000 7fe4df7fe700 1 --2- 172.21.15.42:0/2925531530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4e00ab410 0x7fe4e00a6630 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7fe4d0002f30 tx=0x7fe4d0007a40).ready entity=mon.1 client_cookie=fa66c19776c84f47 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:56.493 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.484+0000 7fe4df7fe700 1 --2- 172.21.15.42:0/2925531530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4e00ab410 0x7fe4e00a6630 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fe4d0002f30 tx=0x7fe4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.493 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.484+0000 7fe4de7fc700 1 -- 172.21.15.42:0/2925531530 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4d0011310 con 0x7fe4e00ab410 2020-04-02T23:24:56.494 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.484+0000 7fe4df7fe700 1 --2- 172.21.15.42:0/2925531530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4e00ab410 0x7fe4e00a6630 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fe4d0002f30 tx=0x7fe4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.494 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.484+0000 7fe4df7fe700 1 --2- 172.21.15.42:0/2925531530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4e00ab410 0x7fe4e00a6630 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7fe4d0002f30 tx=0x7fe4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.494 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.484+0000 7fe4de7fc700 1 -- 172.21.15.42:0/2925531530 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d0011470 con 0x7fe4e00ab410 2020-04-02T23:24:56.494 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.484+0000 7fe4de7fc700 1 -- 172.21.15.42:0/2925531530 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4d0011890 con 0x7fe4e00ab410 2020-04-02T23:24:56.494 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.484+0000 7fe4e5faa700 1 -- 172.21.15.42:0/2925531530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4e00ab410 msgr2=0x7fe4e00a6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.494 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.484+0000 7fe4e5faa700 1 --2- 172.21.15.42:0/2925531530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4e00ab410 0x7fe4e00a6630 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7fe4d0002f30 tx=0x7fe4d0007a40).stop 2020-04-02T23:24:56.494 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.484+0000 7fe4e5faa700 1 -- 172.21.15.42:0/2925531530 shutdown_connections 2020-04-02T23:24:56.495 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.484+0000 7fe4e5faa700 1 --2- 172.21.15.42:0/2925531530 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a23e0 0x7fe4e00a2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:56.495 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.484+0000 7fe4e5faa700 1 --2- 172.21.15.42:0/2925531530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4e00ab410 0x7fe4e00a6630 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:56.495 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.484+0000 7fe4e5faa700 1 -- 172.21.15.42:0/2925531530 >> 172.21.15.42:0/2925531530 conn(0x7fe4e005b720 msgr2=0x7fe4e00aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:56.495 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.484+0000 7fe4e5faa700 1 -- 172.21.15.42:0/2925531530 shutdown_connections 2020-04-02T23:24:56.495 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.484+0000 7fe4e5faa700 1 -- 172.21.15.42:0/2925531530 wait complete. 2020-04-02T23:24:56.495 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.485+0000 7fe4e5faa700 1 Processor -- start 2020-04-02T23:24:56.495 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.485+0000 7fe4e5faa700 1 -- start start 2020-04-02T23:24:56.496 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.486+0000 7fe4e5faa700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a6a90 0x7fe4e0065700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:56.496 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.486+0000 7fe4e5faa700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e00a7160 con 0x7fe4e00ab410 2020-04-02T23:24:56.496 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.486+0000 7fe4e5faa700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e0063770 con 0x7fe4e00a23e0 2020-04-02T23:24:56.496 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.486+0000 7fe4e5faa700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e00639d0 con 0x7fe4e00a6a90 2020-04-02T23:24:56.496 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.486+0000 7fe4dffff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe4e00ab410 0x7fe4e0062340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59632/0 (socket says 172.21.15.42:59632) 2020-04-02T23:24:56.496 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.486+0000 7fe4dffff700 1 -- 172.21.15.42:0/1634933628 learned_addr learned my addr 172.21.15.42:0/1634933628 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:56.496 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.486+0000 7fe4deffd700 1 --2- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a6a90 0x7fe4e0065700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:56.497 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.486+0000 7fe4dcff9700 1 -- 172.21.15.42:0/1634933628 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602746851 0 0) 0x7fe4e00a7160 con 0x7fe4e00ab410 2020-04-02T23:24:56.497 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.486+0000 7fe4dcff9700 1 -- 172.21.15.42:0/1634933628 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4c0002fe0 con 0x7fe4e00ab410 2020-04-02T23:24:56.497 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.486+0000 7fe4dcff9700 1 -- 172.21.15.42:0/1634933628 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267100490 0 0) 0x7fe4e0063770 con 0x7fe4e00a23e0 2020-04-02T23:24:56.497 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.486+0000 7fe4dcff9700 1 -- 172.21.15.42:0/1634933628 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4e00a7160 con 0x7fe4e00a23e0 2020-04-02T23:24:56.497 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.487+0000 7fe4dcff9700 1 -- 172.21.15.42:0/1634933628 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 74149737 0 0) 0x7fe4c0002fe0 con 0x7fe4e00ab410 2020-04-02T23:24:56.497 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.487+0000 7fe4dcff9700 1 -- 172.21.15.42:0/1634933628 --> v1:172.21.15.42:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe4e0063770 con 0x7fe4e00ab410 2020-04-02T23:24:56.497 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.487+0000 7fe4dcff9700 1 -- 172.21.15.42:0/1634933628 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7fe4d8002840 con 0x7fe4e00ab410 2020-04-02T23:24:56.497 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.487+0000 7fe4deffd700 1 -- 172.21.15.42:0/1634933628 >> v1:172.21.15.84:6789/0 conn(0x7fe4e00a23e0 legacy=0x7fe4e01388d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.487+0000 7fe4deffd700 1 -- 172.21.15.42:0/1634933628 >> v1:172.21.15.42:6789/0 conn(0x7fe4e00ab410 legacy=0x7fe4e0062340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.487+0000 7fe4deffd700 1 -- 172.21.15.42:0/1634933628 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e0063c70 con 0x7fe4e00a6a90 2020-04-02T23:24:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.487+0000 7fe4deffd700 1 --2- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a6a90 0x7fe4e0065700 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe4d40010d0 tx=0x7fe4d40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.487+0000 7fe4deffd700 1 --2- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a6a90 0x7fe4e0065700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe4d40010d0 tx=0x7fe4d40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.487+0000 7fe4deffd700 1 --2- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a6a90 0x7fe4e0065700 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7fe4d40010d0 tx=0x7fe4d40108f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.487+0000 7fe4deffd700 1 --2- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a6a90 0x7fe4e0065700 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fe4d40010d0 tx=0x7fe4d40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.487+0000 7fe4dcff9700 1 -- 172.21.15.42:0/1634933628 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4d4005ab0 con 0x7fe4e00a6a90 2020-04-02T23:24:56.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.487+0000 7fe4deffd700 1 --2- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a6a90 0x7fe4e0065700 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fe4d40010d0 tx=0x7fe4d40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.487+0000 7fe4deffd700 1 --2- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a6a90 0x7fe4e0065700 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fe4d40010d0 tx=0x7fe4d40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.487+0000 7fe4dcff9700 1 -- 172.21.15.42:0/1634933628 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d4005c10 con 0x7fe4e00a6a90 2020-04-02T23:24:56.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.487+0000 7fe4e5faa700 1 -- 172.21.15.42:0/1634933628 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e0137eb0 con 0x7fe4e00a6a90 2020-04-02T23:24:56.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.487+0000 7fe4dcff9700 1 -- 172.21.15.42:0/1634933628 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4d40060c0 con 0x7fe4e00a6a90 2020-04-02T23:24:56.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.487+0000 7fe4e5faa700 1 -- 172.21.15.42:0/1634933628 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e0062c90 con 0x7fe4e00a6a90 2020-04-02T23:24:56.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.488+0000 7fe4deffd700 1 --2- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a6a90 0x7fe4e0065700 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fe4d40010d0 tx=0x7fe4d40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.488+0000 7fe4e5faa700 1 -- 172.21.15.42:0/1634933628 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e0063440 con 0x7fe4e00a6a90 2020-04-02T23:24:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.488+0000 7fe4dcff9700 1 -- 172.21.15.42:0/1634933628 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe4d400a320 con 0x7fe4e00a6a90 2020-04-02T23:24:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.488+0000 7fe4deffd700 1 --2- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a6a90 0x7fe4e0065700 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fe4d40010d0 tx=0x7fe4d40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.488+0000 7fe4dcff9700 1 --2- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe4c004dcb0 0x7fe4c0050170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.488+0000 7fe4dcff9700 1 -- 172.21.15.42:0/1634933628 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe4d4060960 con 0x7fe4e00a6a90 2020-04-02T23:24:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.489+0000 7fe4df7fe700 1 --2- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe4c004dcb0 0x7fe4c0050170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.489+0000 7fe4df7fe700 1 --2- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe4c004dcb0 0x7fe4c0050170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe4d00084c0 tx=0x7fe4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.489+0000 7fe4df7fe700 1 --2- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe4c004dcb0 0x7fe4c0050170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe4d00084c0 tx=0x7fe4d0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.489+0000 7fe4df7fe700 1 --2- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe4c004dcb0 0x7fe4c0050170 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7fe4d00084c0 tx=0x7fe4d0007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.492+0000 7fe4deffd700 1 --2- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a6a90 0x7fe4e0065700 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fe4d40010d0 tx=0x7fe4d40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.492+0000 7fe4dcff9700 1 -- 172.21.15.42:0/1634933628 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fe4d403c040 con 0x7fe4e00a6a90 2020-04-02T23:24:56.641 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.639+0000 7fe4e5faa700 1 -- 172.21.15.42:0/1634933628 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe4e00621b0 con 0x7fe4e00a6a90 2020-04-02T23:24:56.642 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.639+0000 7fe4deffd700 1 --2- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a6a90 0x7fe4e0065700 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7fe4d40010d0 tx=0x7fe4d40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.642 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.640+0000 7fe4dcff9700 1 -- 172.21.15.42:0/1634933628 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe4d4011e60 con 0x7fe4e00a6a90 2020-04-02T23:24:56.642 INFO:teuthology.orchestra.run.smithi042.stdout:64424509447 2020-04-02T23:24:56.643 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.641+0000 7fe4e5faa700 1 -- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe4c004dcb0 msgr2=0x7fe4c0050170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.643 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.641+0000 7fe4e5faa700 1 --2- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe4c004dcb0 0x7fe4c0050170 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7fe4d00084c0 tx=0x7fe4d0007a40).stop 2020-04-02T23:24:56.643 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.641+0000 7fe4e5faa700 1 -- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a6a90 msgr2=0x7fe4e0065700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.644 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.641+0000 7fe4e5faa700 1 --2- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a6a90 0x7fe4e0065700 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7fe4d40010d0 tx=0x7fe4d40108f0).stop 2020-04-02T23:24:56.644 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.641+0000 7fe4e5faa700 1 -- 172.21.15.42:0/1634933628 shutdown_connections 2020-04-02T23:24:56.644 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.641+0000 7fe4e5faa700 1 --2- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe4c004dcb0 0x7fe4c0050170 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:56.644 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.641+0000 7fe4e5faa700 1 --2- 172.21.15.42:0/1634933628 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe4e00a6a90 0x7fe4e0065700 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:56.644 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.641+0000 7fe4e5faa700 1 -- 172.21.15.42:0/1634933628 >> 172.21.15.42:0/1634933628 conn(0x7fe4e005b720 msgr2=0x7fe4e00a5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:56.644 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.641+0000 7fe4e5faa700 1 -- 172.21.15.42:0/1634933628 shutdown_connections 2020-04-02T23:24:56.644 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.641+0000 7fe4e5faa700 1 -- 172.21.15.42:0/1634933628 wait complete. 2020-04-02T23:24:56.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2020-04-02T23:24:56.653 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:56.667 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2020-04-02T23:24:56.821 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.819+0000 7f0b1e6d8700 1 Processor -- start 2020-04-02T23:24:56.822 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.819+0000 7f0b1e6d8700 1 -- start start 2020-04-02T23:24:56.827 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.820+0000 7f0b1e6d8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0b180ab410 0x7f0b180a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:56.827 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.820+0000 7f0b1e6d8700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0b180a6a90 0x7f0b180a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:56.827 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.820+0000 7f0b1e6d8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b180a31b0 con 0x7f0b180a2130 2020-04-02T23:24:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.820+0000 7f0b1e6d8700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b180a49f0 con 0x7f0b180a6a90 2020-04-02T23:24:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.820+0000 7f0b1e6d8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b1805ff40 con 0x7f0b180ab410 2020-04-02T23:24:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.820+0000 7f0b177fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0b180a6a90 0x7f0b180a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.820+0000 7f0b177fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0b180a6a90 0x7f0b180a1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40214/0 (socket says 172.21.15.42:40214) 2020-04-02T23:24:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.820+0000 7f0b177fe700 1 -- 172.21.15.42:0/3165314974 learned_addr learned my addr 172.21.15.42:0/3165314974 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.820+0000 7f0b17fff700 1 --2- 172.21.15.42:0/3165314974 >> v2:172.21.15.84:3300/0 conn(0x7f0b180ab410 0x7f0b180a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:56.829 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.820+0000 7f0b177fe700 1 -- 172.21.15.42:0/3165314974 >> v2:172.21.15.84:3300/0 conn(0x7f0b180ab410 msgr2=0x7f0b180a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:56.829 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.820+0000 7f0b177fe700 1 --2- 172.21.15.42:0/3165314974 >> v2:172.21.15.84:3300/0 conn(0x7f0b180ab410 0x7f0b180a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:56.829 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.820+0000 7f0b177fe700 1 -- 172.21.15.42:0/3165314974 >> v1:172.21.15.84:6789/0 conn(0x7f0b180a2130 legacy=0x7f0b180a2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.829 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.820+0000 7f0b177fe700 1 -- 172.21.15.42:0/3165314974 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b180a3420 con 0x7f0b180a6a90 2020-04-02T23:24:56.829 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.820+0000 7f0b177fe700 1 --2- 172.21.15.42:0/3165314974 >> v2:172.21.15.42:3300/0 conn(0x7f0b180a6a90 0x7f0b180a1cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0b0c002f30 tx=0x7f0b0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.830 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.820+0000 7f0b177fe700 1 --2- 172.21.15.42:0/3165314974 >> v2:172.21.15.42:3300/0 conn(0x7f0b180a6a90 0x7f0b180a1cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0b0c002f30 tx=0x7f0b0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.830 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.820+0000 7f0b177fe700 1 --2- 172.21.15.42:0/3165314974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b180a6a90 0x7f0b180a1cd0 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7f0b0c002f30 tx=0x7f0b0c007a40).ready entity=mon.0 client_cookie=c929a718f68f770f server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:56.830 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.821+0000 7f0b177fe700 1 --2- 172.21.15.42:0/3165314974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b180a6a90 0x7f0b180a1cd0 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7f0b0c002f30 tx=0x7f0b0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.830 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.821+0000 7f0b16ffd700 1 -- 172.21.15.42:0/3165314974 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b0c011670 con 0x7f0b180a6a90 2020-04-02T23:24:56.830 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.821+0000 7f0b177fe700 1 --2- 172.21.15.42:0/3165314974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b180a6a90 0x7f0b180a1cd0 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7f0b0c002f30 tx=0x7f0b0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.830 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.821+0000 7f0b177fe700 1 --2- 172.21.15.42:0/3165314974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b180a6a90 0x7f0b180a1cd0 secure :-1 s=THROTTLE_DONE pgs=146 cs=0 l=1 rx=0x7f0b0c002f30 tx=0x7f0b0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.830 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.821+0000 7f0b16ffd700 1 -- 172.21.15.42:0/3165314974 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c0117d0 con 0x7f0b180a6a90 2020-04-02T23:24:56.831 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.821+0000 7f0b16ffd700 1 -- 172.21.15.42:0/3165314974 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b0c011bb0 con 0x7f0b180a6a90 2020-04-02T23:24:56.831 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.821+0000 7f0b1e6d8700 1 -- 172.21.15.42:0/3165314974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b180a6a90 msgr2=0x7f0b180a1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.831 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.821+0000 7f0b1e6d8700 1 --2- 172.21.15.42:0/3165314974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b180a6a90 0x7f0b180a1cd0 secure :-1 s=READY pgs=146 cs=0 l=1 rx=0x7f0b0c002f30 tx=0x7f0b0c007a40).stop 2020-04-02T23:24:56.831 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.821+0000 7f0b1e6d8700 1 -- 172.21.15.42:0/3165314974 shutdown_connections 2020-04-02T23:24:56.831 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.821+0000 7f0b1e6d8700 1 --2- 172.21.15.42:0/3165314974 >> v2:172.21.15.84:3300/0 conn(0x7f0b180ab410 0x7f0b180a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:56.831 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.821+0000 7f0b1e6d8700 1 --2- 172.21.15.42:0/3165314974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b180a6a90 0x7f0b180a1cd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:56.831 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.821+0000 7f0b1e6d8700 1 -- 172.21.15.42:0/3165314974 >> 172.21.15.42:0/3165314974 conn(0x7f0b1805b720 msgr2=0x7f0b180aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:56.831 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.821+0000 7f0b1e6d8700 1 -- 172.21.15.42:0/3165314974 shutdown_connections 2020-04-02T23:24:56.832 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.821+0000 7f0b1e6d8700 1 -- 172.21.15.42:0/3165314974 wait complete. 2020-04-02T23:24:56.832 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.822+0000 7f0b1e6d8700 1 Processor -- start 2020-04-02T23:24:56.832 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.822+0000 7f0b1e6d8700 1 -- start start 2020-04-02T23:24:56.832 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b1e6d8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0b180a2130 0x7f0b18065500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:56.832 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b1e6d8700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0b180a6a90 0x7f0b18065960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:56.832 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b1e6d8700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0b180ab410 0x7f0b18137d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:56.832 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b1e6d8700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b18138950 con 0x7f0b180a6a90 2020-04-02T23:24:56.833 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b1e6d8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b1813c000 con 0x7f0b180a2130 2020-04-02T23:24:56.833 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b1e6d8700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b18139c40 con 0x7f0b180ab410 2020-04-02T23:24:56.833 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b177fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0b180a6a90 0x7f0b18065960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:56.833 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b177fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0b180a6a90 0x7f0b18065960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40218/0 (socket says 172.21.15.42:40218) 2020-04-02T23:24:56.833 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b177fe700 1 -- 172.21.15.42:0/1574514923 learned_addr learned my addr 172.21.15.42:0/1574514923 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:56.833 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b177fe700 1 -- 172.21.15.42:0/1574514923 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0b180ab410 msgr2=0x7f0b18137d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.833 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b177fe700 1 --2- 172.21.15.42:0/1574514923 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0b180ab410 0x7f0b18137d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:56.834 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b177fe700 1 -- 172.21.15.42:0/1574514923 >> v2:172.21.15.84:3300/0 conn(0x7f0b180a2130 msgr2=0x7f0b18065500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.834 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b177fe700 1 --2- 172.21.15.42:0/1574514923 >> v2:172.21.15.84:3300/0 conn(0x7f0b180a2130 0x7f0b18065500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:56.834 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b177fe700 1 -- 172.21.15.42:0/1574514923 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b18139ee0 con 0x7f0b180a6a90 2020-04-02T23:24:56.834 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b177fe700 1 --2- 172.21.15.42:0/1574514923 >> v2:172.21.15.42:3300/0 conn(0x7f0b180a6a90 0x7f0b18065960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0b0c002f30 tx=0x7f0b0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.834 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b177fe700 1 --2- 172.21.15.42:0/1574514923 >> v2:172.21.15.42:3300/0 conn(0x7f0b180a6a90 0x7f0b18065960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0b0c002f30 tx=0x7f0b0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.834 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b177fe700 1 --2- 172.21.15.42:0/1574514923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b180a6a90 0x7f0b18065960 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f0b0c002f30 tx=0x7f0b0c007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:56.834 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b177fe700 1 --2- 172.21.15.42:0/1574514923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b180a6a90 0x7f0b18065960 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f0b0c002f30 tx=0x7f0b0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.834 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b157fa700 1 -- 172.21.15.42:0/1574514923 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b0c011e20 con 0x7f0b180a6a90 2020-04-02T23:24:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b177fe700 1 --2- 172.21.15.42:0/1574514923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b180a6a90 0x7f0b18065960 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f0b0c002f30 tx=0x7f0b0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b177fe700 1 --2- 172.21.15.42:0/1574514923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b180a6a90 0x7f0b18065960 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f0b0c002f30 tx=0x7f0b0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b157fa700 1 -- 172.21.15.42:0/1574514923 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c007340 con 0x7f0b180a6a90 2020-04-02T23:24:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.823+0000 7f0b1e6d8700 1 -- 172.21.15.42:0/1574514923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1813bd20 con 0x7f0b180a6a90 2020-04-02T23:24:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.824+0000 7f0b157fa700 1 -- 172.21.15.42:0/1574514923 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b0c0056c0 con 0x7f0b180a6a90 2020-04-02T23:24:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.824+0000 7f0b1e6d8700 1 -- 172.21.15.42:0/1574514923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1813a380 con 0x7f0b180a6a90 2020-04-02T23:24:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.824+0000 7f0b177fe700 1 --2- 172.21.15.42:0/1574514923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b180a6a90 0x7f0b18065960 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f0b0c002f30 tx=0x7f0b0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.824+0000 7f0b157fa700 1 -- 172.21.15.42:0/1574514923 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f0b0c005930 con 0x7f0b180a6a90 2020-04-02T23:24:56.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.825+0000 7f0b177fe700 1 --2- 172.21.15.42:0/1574514923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b180a6a90 0x7f0b18065960 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f0b0c002f30 tx=0x7f0b0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.825+0000 7f0b1e6d8700 1 -- 172.21.15.42:0/1574514923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1805d2e0 con 0x7f0b180a6a90 2020-04-02T23:24:56.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.825+0000 7f0b157fa700 1 --2- 172.21.15.42:0/1574514923 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f0af804d5a0 0x7f0af804fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:56.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.825+0000 7f0b157fa700 1 -- 172.21.15.42:0/1574514923 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f0b0c061490 con 0x7f0b180a6a90 2020-04-02T23:24:56.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.825+0000 7f0b17fff700 1 --2- 172.21.15.42:0/1574514923 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f0af804d5a0 0x7f0af804fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:56.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.825+0000 7f0b17fff700 1 --2- 172.21.15.42:0/1574514923 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f0af804d5a0 0x7f0af804fa60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0b08002f30 tx=0x7f0b0800c6f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.825+0000 7f0b17fff700 1 --2- 172.21.15.42:0/1574514923 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f0af804d5a0 0x7f0af804fa60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0b08002f30 tx=0x7f0b0800c6f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.825+0000 7f0b17fff700 1 --2- 172.21.15.42:0/1574514923 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f0af804d5a0 0x7f0af804fa60 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f0b08002f30 tx=0x7f0b0800c6f0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:56.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.828+0000 7f0b177fe700 1 --2- 172.21.15.42:0/1574514923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b180a6a90 0x7f0b18065960 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f0b0c002f30 tx=0x7f0b0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.828+0000 7f0b157fa700 1 -- 172.21.15.42:0/1574514923 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f0b0c03ccb0 con 0x7f0b180a6a90 2020-04-02T23:24:56.978 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.975+0000 7f0b1e6d8700 1 -- 172.21.15.42:0/1574514923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0b1813a070 con 0x7f0b180a6a90 2020-04-02T23:24:56.978 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.976+0000 7f0b177fe700 1 --2- 172.21.15.42:0/1574514923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b180a6a90 0x7f0b18065960 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f0b0c002f30 tx=0x7f0b0c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:56.978 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.976+0000 7f0b157fa700 1 -- 172.21.15.42:0/1574514923 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0b0c0402d0 con 0x7f0b180a6a90 2020-04-02T23:24:56.978 INFO:teuthology.orchestra.run.smithi042.stdout:60129542150 2020-04-02T23:24:56.979 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.977+0000 7f0b1e6d8700 1 -- 172.21.15.42:0/1574514923 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f0af804d5a0 msgr2=0x7f0af804fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.979 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.977+0000 7f0b1e6d8700 1 --2- 172.21.15.42:0/1574514923 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f0af804d5a0 0x7f0af804fa60 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f0b08002f30 tx=0x7f0b0800c6f0).stop 2020-04-02T23:24:56.980 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.977+0000 7f0b1e6d8700 1 -- 172.21.15.42:0/1574514923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b180a6a90 msgr2=0x7f0b18065960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:56.980 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.977+0000 7f0b1e6d8700 1 --2- 172.21.15.42:0/1574514923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b180a6a90 0x7f0b18065960 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f0b0c002f30 tx=0x7f0b0c007a40).stop 2020-04-02T23:24:56.980 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.977+0000 7f0b1e6d8700 1 -- 172.21.15.42:0/1574514923 shutdown_connections 2020-04-02T23:24:56.980 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.977+0000 7f0b1e6d8700 1 --2- 172.21.15.42:0/1574514923 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f0af804d5a0 0x7f0af804fa60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:56.980 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.977+0000 7f0b1e6d8700 1 --2- 172.21.15.42:0/1574514923 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f0b180ab410 0x7f0b18137d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:56.980 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.977+0000 7f0b1e6d8700 1 --2- 172.21.15.42:0/1574514923 >> v2:172.21.15.84:3300/0 conn(0x7f0b180a2130 0x7f0b18065500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:56.980 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.977+0000 7f0b1e6d8700 1 --2- 172.21.15.42:0/1574514923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b180a6a90 0x7f0b18065960 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:56.981 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.977+0000 7f0b1e6d8700 1 -- 172.21.15.42:0/1574514923 >> 172.21.15.42:0/1574514923 conn(0x7f0b1805b720 msgr2=0x7f0b180aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:56.981 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.977+0000 7f0b1e6d8700 1 -- 172.21.15.42:0/1574514923 shutdown_connections 2020-04-02T23:24:56.981 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:56.977+0000 7f0b1e6d8700 1 -- 172.21.15.42:0/1574514923 wait complete. 2020-04-02T23:24:56.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2020-04-02T23:24:56.989 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:57.003 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-04-02T23:24:57.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.155+0000 7f4ab3250700 1 Processor -- start 2020-04-02T23:24:57.158 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.155+0000 7f4ab3250700 1 -- start start 2020-04-02T23:24:57.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.156+0000 7f4ab3250700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4aac0ab410 0x7f4aac0a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:57.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.156+0000 7f4ab3250700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4aac0a6a90 0x7f4aac0a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:57.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.156+0000 7f4ab3250700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4aac0a2130 0x7f4aac0a2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:57.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.156+0000 7f4ab3250700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aac0a31b0 con 0x7f4aac0a6a90 2020-04-02T23:24:57.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.156+0000 7f4ab3250700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aac0a49f0 con 0x7f4aac0ab410 2020-04-02T23:24:57.161 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.156+0000 7f4ab3250700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac05ff40 con 0x7f4aac0a2130 2020-04-02T23:24:57.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.156+0000 7f4aabfff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4aac0a6a90 0x7f4aac0a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:57.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.156+0000 7f4aabfff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4aac0a6a90 0x7f4aac0a1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40228/0 (socket says 172.21.15.42:40228) 2020-04-02T23:24:57.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.156+0000 7f4aabfff700 1 -- 172.21.15.42:0/3472425766 learned_addr learned my addr 172.21.15.42:0/3472425766 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:57.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.156+0000 7f4ab0fec700 1 --2- 172.21.15.42:0/3472425766 >> v2:172.21.15.84:3300/0 conn(0x7f4aac0ab410 0x7f4aac0a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:57.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.156+0000 7f4ab17ed700 1 --2- 172.21.15.42:0/3472425766 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4aac0a2130 0x7f4aac0a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:57.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.156+0000 7f4aabfff700 1 -- 172.21.15.42:0/3472425766 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4aac0a2130 msgr2=0x7f4aac0a2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:57.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.156+0000 7f4aabfff700 1 --2- 172.21.15.42:0/3472425766 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4aac0a2130 0x7f4aac0a2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:57.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.156+0000 7f4aabfff700 1 -- 172.21.15.42:0/3472425766 >> v2:172.21.15.84:3300/0 conn(0x7f4aac0ab410 msgr2=0x7f4aac0a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:57.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.156+0000 7f4aabfff700 1 --2- 172.21.15.42:0/3472425766 >> v2:172.21.15.84:3300/0 conn(0x7f4aac0ab410 0x7f4aac0a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:57.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.156+0000 7f4aabfff700 1 -- 172.21.15.42:0/3472425766 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac0a3420 con 0x7f4aac0a6a90 2020-04-02T23:24:57.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.157+0000 7f4aabfff700 1 --2- 172.21.15.42:0/3472425766 >> v2:172.21.15.42:3300/0 conn(0x7f4aac0a6a90 0x7f4aac0a1cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4aa0002f30 tx=0x7f4aa0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.157+0000 7f4aabfff700 1 --2- 172.21.15.42:0/3472425766 >> v2:172.21.15.42:3300/0 conn(0x7f4aac0a6a90 0x7f4aac0a1cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4aa0002f30 tx=0x7f4aa0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.157+0000 7f4aabfff700 1 --2- 172.21.15.42:0/3472425766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4aac0a6a90 0x7f4aac0a1cd0 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f4aa0002f30 tx=0x7f4aa0007a40).ready entity=mon.0 client_cookie=5b016def09ac7808 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:57.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.157+0000 7f4aabfff700 1 --2- 172.21.15.42:0/3472425766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4aac0a6a90 0x7f4aac0a1cd0 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f4aa0002f30 tx=0x7f4aa0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.157+0000 7f4aab7fe700 1 -- 172.21.15.42:0/3472425766 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa00115c0 con 0x7f4aac0a6a90 2020-04-02T23:24:57.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.157+0000 7f4aabfff700 1 --2- 172.21.15.42:0/3472425766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4aac0a6a90 0x7f4aac0a1cd0 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f4aa0002f30 tx=0x7f4aa0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.157+0000 7f4aab7fe700 1 -- 172.21.15.42:0/3472425766 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa0011720 con 0x7f4aac0a6a90 2020-04-02T23:24:57.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.157+0000 7f4aabfff700 1 --2- 172.21.15.42:0/3472425766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4aac0a6a90 0x7f4aac0a1cd0 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f4aa0002f30 tx=0x7f4aa0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.157+0000 7f4aab7fe700 1 -- 172.21.15.42:0/3472425766 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa0011b00 con 0x7f4aac0a6a90 2020-04-02T23:24:57.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.157+0000 7f4ab3250700 1 -- 172.21.15.42:0/3472425766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4aac0a6a90 msgr2=0x7f4aac0a1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:57.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.157+0000 7f4ab3250700 1 --2- 172.21.15.42:0/3472425766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4aac0a6a90 0x7f4aac0a1cd0 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f4aa0002f30 tx=0x7f4aa0007a40).stop 2020-04-02T23:24:57.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.157+0000 7f4ab3250700 1 -- 172.21.15.42:0/3472425766 shutdown_connections 2020-04-02T23:24:57.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.157+0000 7f4ab3250700 1 --2- 172.21.15.42:0/3472425766 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4aac0a2130 0x7f4aac0a2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:57.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.157+0000 7f4ab3250700 1 --2- 172.21.15.42:0/3472425766 >> v2:172.21.15.84:3300/0 conn(0x7f4aac0ab410 0x7f4aac0a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:57.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.157+0000 7f4ab3250700 1 --2- 172.21.15.42:0/3472425766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4aac0a6a90 0x7f4aac0a1cd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:57.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.157+0000 7f4ab3250700 1 -- 172.21.15.42:0/3472425766 >> 172.21.15.42:0/3472425766 conn(0x7f4aac05b720 msgr2=0x7f4aac0aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:57.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.157+0000 7f4ab3250700 1 -- 172.21.15.42:0/3472425766 shutdown_connections 2020-04-02T23:24:57.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.157+0000 7f4ab3250700 1 -- 172.21.15.42:0/3472425766 wait complete. 2020-04-02T23:24:57.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.158+0000 7f4ab3250700 1 Processor -- start 2020-04-02T23:24:57.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.158+0000 7f4ab3250700 1 -- start start 2020-04-02T23:24:57.169 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.159+0000 7f4ab3250700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4aac0a2130 0x7f4aac09ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:57.169 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.159+0000 7f4ab3250700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4aac0ab410 0x7f4aac1387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:57.169 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.159+0000 7f4ab3250700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aac09d290 con 0x7f4aac0a6a90 2020-04-02T23:24:57.169 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.159+0000 7f4ab3250700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aac09d500 con 0x7f4aac0a2130 2020-04-02T23:24:57.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.159+0000 7f4ab3250700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac063210 con 0x7f4aac0ab410 2020-04-02T23:24:57.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.159+0000 7f4aabfff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f4aac0a6a90 0x7f4aac064dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59658/0 (socket says 172.21.15.42:59658) 2020-04-02T23:24:57.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.159+0000 7f4aabfff700 1 -- 172.21.15.42:0/447788284 learned_addr learned my addr 172.21.15.42:0/447788284 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:57.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.159+0000 7f4ab0fec700 1 --2- 172.21.15.42:0/447788284 >> v2:172.21.15.84:3300/0 conn(0x7f4aac0a2130 0x7f4aac09ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:57.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.159+0000 7f4ab17ed700 1 --2- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4aac0ab410 0x7f4aac1387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:57.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.159+0000 7f4aa9ffb700 1 -- 172.21.15.42:0/447788284 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074614706 0 0) 0x7f4aac09d290 con 0x7f4aac0a6a90 2020-04-02T23:24:57.170 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.159+0000 7f4aa9ffb700 1 -- 172.21.15.42:0/447788284 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a8c002fe0 con 0x7f4aac0a6a90 2020-04-02T23:24:57.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.159+0000 7f4ab0fec700 1 -- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4aac0ab410 msgr2=0x7f4aac1387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:57.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.159+0000 7f4ab0fec700 1 --2- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4aac0ab410 0x7f4aac1387d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:57.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.160+0000 7f4ab0fec700 1 -- 172.21.15.42:0/447788284 >> v1:172.21.15.42:6789/0 conn(0x7f4aac0a6a90 legacy=0x7f4aac064dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:57.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.160+0000 7f4ab0fec700 1 -- 172.21.15.42:0/447788284 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac0634b0 con 0x7f4aac0a2130 2020-04-02T23:24:57.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.160+0000 7f4ab0fec700 1 --2- 172.21.15.42:0/447788284 >> v2:172.21.15.84:3300/0 conn(0x7f4aac0a2130 0x7f4aac09ce30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4a9c002f30 tx=0x7f4a9c010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.160+0000 7f4ab0fec700 1 --2- 172.21.15.42:0/447788284 >> v2:172.21.15.84:3300/0 conn(0x7f4aac0a2130 0x7f4aac09ce30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4a9c002f30 tx=0x7f4a9c010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.171 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.160+0000 7f4ab0fec700 1 --2- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0a2130 0x7f4aac09ce30 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f4a9c002f30 tx=0x7f4a9c010b40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:57.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.160+0000 7f4ab0fec700 1 --2- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0a2130 0x7f4aac09ce30 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f4a9c002f30 tx=0x7f4a9c010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.160+0000 7f4aa9ffb700 1 -- 172.21.15.42:0/447788284 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a9c013060 con 0x7f4aac0a2130 2020-04-02T23:24:57.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.160+0000 7f4ab0fec700 1 --2- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0a2130 0x7f4aac09ce30 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f4a9c002f30 tx=0x7f4a9c010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.160+0000 7f4ab0fec700 1 --2- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0a2130 0x7f4aac09ce30 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f4a9c002f30 tx=0x7f4a9c010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.160+0000 7f4aa9ffb700 1 -- 172.21.15.42:0/447788284 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9c007530 con 0x7f4aac0a2130 2020-04-02T23:24:57.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.160+0000 7f4aa9ffb700 1 -- 172.21.15.42:0/447788284 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a9c0058b0 con 0x7f4aac0a2130 2020-04-02T23:24:57.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.160+0000 7f4ab3250700 1 -- 172.21.15.42:0/447788284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aac063950 con 0x7f4aac0a2130 2020-04-02T23:24:57.172 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.160+0000 7f4ab3250700 1 -- 172.21.15.42:0/447788284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aac09d9f0 con 0x7f4aac0a2130 2020-04-02T23:24:57.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.161+0000 7f4ab0fec700 1 --2- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0a2130 0x7f4aac09ce30 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f4a9c002f30 tx=0x7f4a9c010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.161+0000 7f4ab3250700 1 -- 172.21.15.42:0/447788284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aac09d640 con 0x7f4aac0a2130 2020-04-02T23:24:57.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.161+0000 7f4aa9ffb700 1 -- 172.21.15.42:0/447788284 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f4a9c005b20 con 0x7f4aac0a2130 2020-04-02T23:24:57.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.161+0000 7f4ab0fec700 1 --2- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0a2130 0x7f4aac09ce30 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f4a9c002f30 tx=0x7f4a9c010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.161+0000 7f4aa9ffb700 1 --2- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4a8c04d8d0 0x7f4a8c04fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:57.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.161+0000 7f4aa9ffb700 1 -- 172.21.15.42:0/447788284 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4a9c060c30 con 0x7f4aac0a2130 2020-04-02T23:24:57.173 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.161+0000 7f4aabfff700 1 --2- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4a8c04d8d0 0x7f4a8c04fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:57.174 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.162+0000 7f4aabfff700 1 --2- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4a8c04d8d0 0x7f4a8c04fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4aac0a6860 tx=0x7f4aa0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.174 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.162+0000 7f4aabfff700 1 --2- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4a8c04d8d0 0x7f4a8c04fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4aac0a6860 tx=0x7f4aa0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.174 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.162+0000 7f4aabfff700 1 --2- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4a8c04d8d0 0x7f4a8c04fd90 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f4aac0a6860 tx=0x7f4aa0007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:57.174 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.165+0000 7f4ab0fec700 1 --2- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0a2130 0x7f4aac09ce30 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f4a9c002f30 tx=0x7f4a9c010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.174 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.165+0000 7f4aa9ffb700 1 -- 172.21.15.42:0/447788284 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f4a9c03c390 con 0x7f4aac0a2130 2020-04-02T23:24:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.311+0000 7f4ab3250700 1 -- 172.21.15.42:0/447788284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4aac05d2e0 con 0x7f4aac0a2130 2020-04-02T23:24:57.314 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.312+0000 7f4ab0fec700 1 --2- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0a2130 0x7f4aac09ce30 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7f4a9c002f30 tx=0x7f4a9c010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.314 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.312+0000 7f4aa9ffb700 1 -- 172.21.15.42:0/447788284 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4a9c03f9b0 con 0x7f4aac0a2130 2020-04-02T23:24:57.314 INFO:teuthology.orchestra.run.smithi042.stdout:60129542150 2020-04-02T23:24:57.315 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.313+0000 7f4ab3250700 1 -- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4a8c04d8d0 msgr2=0x7f4a8c04fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.313+0000 7f4ab3250700 1 --2- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4a8c04d8d0 0x7f4a8c04fd90 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f4aac0a6860 tx=0x7f4aa0007a40).stop 2020-04-02T23:24:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.313+0000 7f4ab3250700 1 -- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0a2130 msgr2=0x7f4aac09ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.313+0000 7f4ab3250700 1 --2- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0a2130 0x7f4aac09ce30 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7f4a9c002f30 tx=0x7f4a9c010b40).stop 2020-04-02T23:24:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.313+0000 7f4ab3250700 1 -- 172.21.15.42:0/447788284 shutdown_connections 2020-04-02T23:24:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.313+0000 7f4ab3250700 1 --2- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4a8c04d8d0 0x7f4a8c04fd90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.313+0000 7f4ab3250700 1 --2- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4aac0ab410 0x7f4aac1387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:57.317 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.313+0000 7f4ab3250700 1 --2- 172.21.15.42:0/447788284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0a2130 0x7f4aac09ce30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:57.317 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.313+0000 7f4ab3250700 1 -- 172.21.15.42:0/447788284 >> 172.21.15.42:0/447788284 conn(0x7f4aac05b720 msgr2=0x7f4aac0a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:57.317 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.313+0000 7f4ab3250700 1 -- 172.21.15.42:0/447788284 shutdown_connections 2020-04-02T23:24:57.317 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.313+0000 7f4ab3250700 1 -- 172.21.15.42:0/447788284 wait complete. 2020-04-02T23:24:57.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.5 2020-04-02T23:24:57.326 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:57.339 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2020-04-02T23:24:57.494 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.492+0000 7f5b3d451700 1 Processor -- start 2020-04-02T23:24:57.495 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.492+0000 7f5b3d451700 1 -- start start 2020-04-02T23:24:57.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.493+0000 7f5b3d451700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5b380ab410 0x7f5b380a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:57.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.493+0000 7f5b3d451700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5b380a23e0 0x7f5b380a27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:57.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.493+0000 7f5b3d451700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b380a31b0 con 0x7f5b380a6a90 2020-04-02T23:24:57.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.493+0000 7f5b3d451700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b380a49f0 con 0x7f5b380a23e0 2020-04-02T23:24:57.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.493+0000 7f5b3d451700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3805ff40 con 0x7f5b380ab410 2020-04-02T23:24:57.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.493+0000 7f5b377fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5b380a23e0 0x7f5b380a27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:57.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.493+0000 7f5b367fc700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f5b380a6a90 0x7f5b380a1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59666/0 (socket says 172.21.15.42:59666) 2020-04-02T23:24:57.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.493+0000 7f5b367fc700 1 -- 172.21.15.42:0/4098235669 learned_addr learned my addr 172.21.15.42:0/4098235669 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:57.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.493+0000 7f5b377fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5b380a23e0 0x7f5b380a27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40244/0 (socket says 172.21.15.42:40244) 2020-04-02T23:24:57.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.494+0000 7f5b36ffd700 1 --2- 172.21.15.42:0/4098235669 >> v2:172.21.15.84:3300/0 conn(0x7f5b380ab410 0x7f5b380a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:57.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.494+0000 7f5b377fe700 1 -- 172.21.15.42:0/4098235669 >> v2:172.21.15.84:3300/0 conn(0x7f5b380ab410 msgr2=0x7f5b380a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:57.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.494+0000 7f5b377fe700 1 --2- 172.21.15.42:0/4098235669 >> v2:172.21.15.84:3300/0 conn(0x7f5b380ab410 0x7f5b380a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:57.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.494+0000 7f5b377fe700 1 -- 172.21.15.42:0/4098235669 >> v1:172.21.15.42:6789/0 conn(0x7f5b380a6a90 legacy=0x7f5b380a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:57.499 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.494+0000 7f5b35ffb700 1 -- 172.21.15.42:0/4098235669 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 580858366 0 0) 0x7f5b380a31b0 con 0x7f5b380a6a90 2020-04-02T23:24:57.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.494+0000 7f5b377fe700 1 -- 172.21.15.42:0/4098235669 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b380a3420 con 0x7f5b380a23e0 2020-04-02T23:24:57.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.494+0000 7f5b377fe700 1 --2- 172.21.15.42:0/4098235669 >> v2:172.21.15.42:3300/0 conn(0x7f5b380a23e0 0x7f5b380a27e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5b300032b0 tx=0x7f5b30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.494+0000 7f5b377fe700 1 --2- 172.21.15.42:0/4098235669 >> v2:172.21.15.42:3300/0 conn(0x7f5b380a23e0 0x7f5b380a27e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5b300032b0 tx=0x7f5b30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.494+0000 7f5b377fe700 1 --2- 172.21.15.42:0/4098235669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b380a23e0 0x7f5b380a27e0 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7f5b300032b0 tx=0x7f5b30007dc0).ready entity=mon.0 client_cookie=241228ae38117498 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:57.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.494+0000 7f5b377fe700 1 --2- 172.21.15.42:0/4098235669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b380a23e0 0x7f5b380a27e0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f5b300032b0 tx=0x7f5b30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.494+0000 7f5b35ffb700 1 -- 172.21.15.42:0/4098235669 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b3000a160 con 0x7f5b380a23e0 2020-04-02T23:24:57.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.494+0000 7f5b377fe700 1 --2- 172.21.15.42:0/4098235669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b380a23e0 0x7f5b380a27e0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f5b300032b0 tx=0x7f5b30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.500 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.494+0000 7f5b35ffb700 1 -- 172.21.15.42:0/4098235669 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3000a2c0 con 0x7f5b380a23e0 2020-04-02T23:24:57.501 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.494+0000 7f5b377fe700 1 --2- 172.21.15.42:0/4098235669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b380a23e0 0x7f5b380a27e0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f5b300032b0 tx=0x7f5b30007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.501 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.494+0000 7f5b35ffb700 1 -- 172.21.15.42:0/4098235669 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b3000a660 con 0x7f5b380a23e0 2020-04-02T23:24:57.501 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.494+0000 7f5b3d451700 1 -- 172.21.15.42:0/4098235669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b380a23e0 msgr2=0x7f5b380a27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:57.501 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.494+0000 7f5b3d451700 1 --2- 172.21.15.42:0/4098235669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b380a23e0 0x7f5b380a27e0 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7f5b300032b0 tx=0x7f5b30007dc0).stop 2020-04-02T23:24:57.501 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.495+0000 7f5b3d451700 1 -- 172.21.15.42:0/4098235669 shutdown_connections 2020-04-02T23:24:57.501 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.495+0000 7f5b3d451700 1 --2- 172.21.15.42:0/4098235669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b380a23e0 0x7f5b380a27e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:57.501 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.495+0000 7f5b3d451700 1 --2- 172.21.15.42:0/4098235669 >> v2:172.21.15.84:3300/0 conn(0x7f5b380ab410 0x7f5b380a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:57.502 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.495+0000 7f5b3d451700 1 -- 172.21.15.42:0/4098235669 >> 172.21.15.42:0/4098235669 conn(0x7f5b3805b720 msgr2=0x7f5b380aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:57.502 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.495+0000 7f5b3d451700 1 -- 172.21.15.42:0/4098235669 shutdown_connections 2020-04-02T23:24:57.502 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.495+0000 7f5b3d451700 1 -- 172.21.15.42:0/4098235669 wait complete. 2020-04-02T23:24:57.502 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.496+0000 7f5b3d451700 1 Processor -- start 2020-04-02T23:24:57.502 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.496+0000 7f5b3d451700 1 -- start start 2020-04-02T23:24:57.505 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.496+0000 7f5b3d451700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5b380a6a90 0x7f5b38065630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:57.505 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.496+0000 7f5b3d451700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5b380ab410 0x7f5b38066430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:57.506 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.496+0000 7f5b3d451700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b38064830 con 0x7f5b380a23e0 2020-04-02T23:24:57.506 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.496+0000 7f5b3d451700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b38062cc0 con 0x7f5b380a6a90 2020-04-02T23:24:57.506 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.496+0000 7f5b3d451700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3809aab0 con 0x7f5b380ab410 2020-04-02T23:24:57.506 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.496+0000 7f5b36ffd700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f5b380a23e0 0x7f5b38065d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59670/0 (socket says 172.21.15.42:59670) 2020-04-02T23:24:57.506 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.496+0000 7f5b36ffd700 1 -- 172.21.15.42:0/3949451308 learned_addr learned my addr 172.21.15.42:0/3949451308 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:57.506 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.496+0000 7f5b367fc700 1 --2- 172.21.15.42:0/3949451308 >> v2:172.21.15.42:3300/0 conn(0x7f5b380a6a90 0x7f5b38065630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:57.506 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.497+0000 7f5b2ffff700 1 -- 172.21.15.42:0/3949451308 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959161651 0 0) 0x7f5b38064830 con 0x7f5b380a23e0 2020-04-02T23:24:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.497+0000 7f5b377fe700 1 --2- 172.21.15.42:0/3949451308 >> v2:172.21.15.84:3300/0 conn(0x7f5b380ab410 0x7f5b38066430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.497+0000 7f5b2ffff700 1 -- 172.21.15.42:0/3949451308 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b1c002fe0 con 0x7f5b380a23e0 2020-04-02T23:24:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.497+0000 7f5b367fc700 1 -- 172.21.15.42:0/3949451308 >> v2:172.21.15.84:3300/0 conn(0x7f5b380ab410 msgr2=0x7f5b38066430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.497+0000 7f5b367fc700 1 --2- 172.21.15.42:0/3949451308 >> v2:172.21.15.84:3300/0 conn(0x7f5b380ab410 0x7f5b38066430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.497+0000 7f5b367fc700 1 -- 172.21.15.42:0/3949451308 >> v1:172.21.15.42:6789/0 conn(0x7f5b380a23e0 legacy=0x7f5b38065d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.497+0000 7f5b367fc700 1 -- 172.21.15.42:0/3949451308 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b380a2040 con 0x7f5b380a6a90 2020-04-02T23:24:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.497+0000 7f5b377fe700 1 --2- 172.21.15.42:0/3949451308 >> v2:172.21.15.84:3300/0 conn(0x7f5b380ab410 0x7f5b38066430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:24:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.497+0000 7f5b367fc700 1 --2- 172.21.15.42:0/3949451308 >> v2:172.21.15.42:3300/0 conn(0x7f5b380a6a90 0x7f5b38065630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5b28000b80 tx=0x7f5b280108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.508 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.497+0000 7f5b367fc700 1 --2- 172.21.15.42:0/3949451308 >> v2:172.21.15.42:3300/0 conn(0x7f5b380a6a90 0x7f5b38065630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5b28000b80 tx=0x7f5b280108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.508 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.497+0000 7f5b367fc700 1 --2- 172.21.15.42:0/3949451308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b380a6a90 0x7f5b38065630 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7f5b28000b80 tx=0x7f5b280108c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:57.508 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.497+0000 7f5b367fc700 1 --2- 172.21.15.42:0/3949451308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b380a6a90 0x7f5b38065630 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f5b28000b80 tx=0x7f5b280108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.508 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.497+0000 7f5b2ffff700 1 -- 172.21.15.42:0/3949451308 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b28005ca0 con 0x7f5b380a6a90 2020-04-02T23:24:57.508 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.497+0000 7f5b367fc700 1 --2- 172.21.15.42:0/3949451308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b380a6a90 0x7f5b38065630 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f5b28000b80 tx=0x7f5b280108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.508 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.497+0000 7f5b367fc700 1 --2- 172.21.15.42:0/3949451308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b380a6a90 0x7f5b38065630 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f5b28000b80 tx=0x7f5b280108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.508 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.497+0000 7f5b2ffff700 1 -- 172.21.15.42:0/3949451308 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b28005e00 con 0x7f5b380a6a90 2020-04-02T23:24:57.509 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.497+0000 7f5b3d451700 1 -- 172.21.15.42:0/3949451308 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b38064fe0 con 0x7f5b380a6a90 2020-04-02T23:24:57.509 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.497+0000 7f5b2ffff700 1 -- 172.21.15.42:0/3949451308 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b280062b0 con 0x7f5b380a6a90 2020-04-02T23:24:57.509 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.497+0000 7f5b3d451700 1 -- 172.21.15.42:0/3949451308 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b38066eb0 con 0x7f5b380a6a90 2020-04-02T23:24:57.509 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.498+0000 7f5b367fc700 1 --2- 172.21.15.42:0/3949451308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b380a6a90 0x7f5b38065630 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f5b28000b80 tx=0x7f5b280108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.509 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.498+0000 7f5b3d451700 1 -- 172.21.15.42:0/3949451308 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b38064e40 con 0x7f5b380a6a90 2020-04-02T23:24:57.509 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.498+0000 7f5b2ffff700 1 -- 172.21.15.42:0/3949451308 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f5b280064e0 con 0x7f5b380a6a90 2020-04-02T23:24:57.509 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.498+0000 7f5b367fc700 1 --2- 172.21.15.42:0/3949451308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b380a6a90 0x7f5b38065630 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f5b28000b80 tx=0x7f5b280108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.510 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.498+0000 7f5b2ffff700 1 --2- 172.21.15.42:0/3949451308 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f5b1c04d8d0 0x7f5b1c04fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:57.510 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.498+0000 7f5b2ffff700 1 -- 172.21.15.42:0/3949451308 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f5b28060f50 con 0x7f5b380a6a90 2020-04-02T23:24:57.510 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.499+0000 7f5b36ffd700 1 --2- 172.21.15.42:0/3949451308 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f5b1c04d8d0 0x7f5b1c04fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:57.510 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.499+0000 7f5b36ffd700 1 --2- 172.21.15.42:0/3949451308 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f5b1c04d8d0 0x7f5b1c04fd90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5b20002f30 tx=0x7f5b20002340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.510 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.499+0000 7f5b36ffd700 1 --2- 172.21.15.42:0/3949451308 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f5b1c04d8d0 0x7f5b1c04fd90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5b20002f30 tx=0x7f5b20002340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.510 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.499+0000 7f5b36ffd700 1 --2- 172.21.15.42:0/3949451308 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f5b1c04d8d0 0x7f5b1c04fd90 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f5b20002f30 tx=0x7f5b20002340).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:57.510 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.502+0000 7f5b367fc700 1 --2- 172.21.15.42:0/3949451308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b380a6a90 0x7f5b38065630 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f5b28000b80 tx=0x7f5b280108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.510 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.502+0000 7f5b2ffff700 1 -- 172.21.15.42:0/3949451308 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f5b38064e40 con 0x7f5b380a6a90 2020-04-02T23:24:57.651 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.649+0000 7f5b3d451700 1 -- 172.21.15.42:0/3949451308 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5b38064e40 con 0x7f5b380a6a90 2020-04-02T23:24:57.651 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.649+0000 7f5b367fc700 1 --2- 172.21.15.42:0/3949451308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b380a6a90 0x7f5b38065630 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f5b28000b80 tx=0x7f5b280108c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.652 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.649+0000 7f5b2ffff700 1 -- 172.21.15.42:0/3949451308 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5b38064e40 con 0x7f5b380a6a90 2020-04-02T23:24:57.652 INFO:teuthology.orchestra.run.smithi042.stdout:60129542151 2020-04-02T23:24:57.653 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.650+0000 7f5b3d451700 1 -- 172.21.15.42:0/3949451308 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f5b1c04d8d0 msgr2=0x7f5b1c04fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:57.653 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.650+0000 7f5b3d451700 1 --2- 172.21.15.42:0/3949451308 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f5b1c04d8d0 0x7f5b1c04fd90 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f5b20002f30 tx=0x7f5b20002340).stop 2020-04-02T23:24:57.653 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.651+0000 7f5b3d451700 1 -- 172.21.15.42:0/3949451308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b380a6a90 msgr2=0x7f5b38065630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:57.653 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.651+0000 7f5b3d451700 1 --2- 172.21.15.42:0/3949451308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b380a6a90 0x7f5b38065630 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7f5b28000b80 tx=0x7f5b280108c0).stop 2020-04-02T23:24:57.653 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.651+0000 7f5b3d451700 1 -- 172.21.15.42:0/3949451308 shutdown_connections 2020-04-02T23:24:57.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.651+0000 7f5b3d451700 1 --2- 172.21.15.42:0/3949451308 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f5b1c04d8d0 0x7f5b1c04fd90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:57.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.651+0000 7f5b3d451700 1 --2- 172.21.15.42:0/3949451308 >> v2:172.21.15.84:3300/0 conn(0x7f5b380ab410 0x7f5b38066430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:57.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.651+0000 7f5b3d451700 1 --2- 172.21.15.42:0/3949451308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b380a6a90 0x7f5b38065630 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:57.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.651+0000 7f5b3d451700 1 -- 172.21.15.42:0/3949451308 >> 172.21.15.42:0/3949451308 conn(0x7f5b3805b720 msgr2=0x7f5b380aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:57.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.651+0000 7f5b3d451700 1 -- 172.21.15.42:0/3949451308 shutdown_connections 2020-04-02T23:24:57.654 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.651+0000 7f5b3d451700 1 -- 172.21.15.42:0/3949451308 wait complete. 2020-04-02T23:24:57.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.6 2020-04-02T23:24:57.663 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:57.676 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-04-02T23:24:57.830 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.829+0000 7fd8aa430700 1 Processor -- start 2020-04-02T23:24:57.831 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.829+0000 7fd8aa430700 1 -- start start 2020-04-02T23:24:57.833 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.829+0000 7fd8aa430700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd8a4067380 0x7fd8a40a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:57.834 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.829+0000 7fd8aa430700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd8a413a1d0 0x7fd8a413a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:57.835 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.829+0000 7fd8aa430700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a40a45f0 con 0x7fd8a40ab410 2020-04-02T23:24:57.835 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.829+0000 7fd8aa430700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a409f460 con 0x7fd8a4067380 2020-04-02T23:24:57.835 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.829+0000 7fd8aa430700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a405ff40 con 0x7fd8a413a1d0 2020-04-02T23:24:57.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.829+0000 7fd8a37fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd8a4067380 0x7fd8a40a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:57.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.829+0000 7fd8a37fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd8a4067380 0x7fd8a40a6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40256/0 (socket says 172.21.15.42:40256) 2020-04-02T23:24:57.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.829+0000 7fd8a37fe700 1 -- 172.21.15.42:0/3730512556 learned_addr learned my addr 172.21.15.42:0/3730512556 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:57.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.830+0000 7fd8a89cd700 1 --2- 172.21.15.42:0/3730512556 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd8a413a1d0 0x7fd8a413a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:57.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.830+0000 7fd8a37fe700 1 -- 172.21.15.42:0/3730512556 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd8a413a1d0 msgr2=0x7fd8a413a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:57.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.830+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/3730512556 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd8a413a1d0 0x7fd8a413a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:57.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.830+0000 7fd8a37fe700 1 -- 172.21.15.42:0/3730512556 >> v1:172.21.15.84:6789/0 conn(0x7fd8a40ab410 legacy=0x7fd8a40a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:57.836 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.830+0000 7fd8a37fe700 1 -- 172.21.15.42:0/3730512556 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a40a4850 con 0x7fd8a4067380 2020-04-02T23:24:57.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.830+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/3730512556 >> v2:172.21.15.42:3300/0 conn(0x7fd8a4067380 0x7fd8a40a6d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd8a405bc20 tx=0x7fd898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.830+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/3730512556 >> v2:172.21.15.42:3300/0 conn(0x7fd8a4067380 0x7fd8a40a6d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd8a405bc20 tx=0x7fd898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.830+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/3730512556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8a4067380 0x7fd8a40a6d40 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7fd8a405bc20 tx=0x7fd898007a40).ready entity=mon.0 client_cookie=29ee0f6870b39c04 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:57.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.830+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/3730512556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8a4067380 0x7fd8a40a6d40 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7fd8a405bc20 tx=0x7fd898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.830+0000 7fd8a2ffd700 1 -- 172.21.15.42:0/3730512556 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8980116e0 con 0x7fd8a4067380 2020-04-02T23:24:57.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.830+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/3730512556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8a4067380 0x7fd8a40a6d40 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7fd8a405bc20 tx=0x7fd898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.830+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/3730512556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8a4067380 0x7fd8a40a6d40 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7fd8a405bc20 tx=0x7fd898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.838 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.830+0000 7fd8a2ffd700 1 -- 172.21.15.42:0/3730512556 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd898011840 con 0x7fd8a4067380 2020-04-02T23:24:57.838 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.830+0000 7fd8a2ffd700 1 -- 172.21.15.42:0/3730512556 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd898011c60 con 0x7fd8a4067380 2020-04-02T23:24:57.838 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.830+0000 7fd8aa430700 1 -- 172.21.15.42:0/3730512556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8a4067380 msgr2=0x7fd8a40a6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:57.838 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.830+0000 7fd8aa430700 1 --2- 172.21.15.42:0/3730512556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8a4067380 0x7fd8a40a6d40 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7fd8a405bc20 tx=0x7fd898007a40).stop 2020-04-02T23:24:57.838 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.831+0000 7fd8aa430700 1 -- 172.21.15.42:0/3730512556 shutdown_connections 2020-04-02T23:24:57.838 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.831+0000 7fd8aa430700 1 --2- 172.21.15.42:0/3730512556 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd8a413a1d0 0x7fd8a413a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:57.838 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.831+0000 7fd8aa430700 1 --2- 172.21.15.42:0/3730512556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8a4067380 0x7fd8a40a6d40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:57.839 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.831+0000 7fd8aa430700 1 -- 172.21.15.42:0/3730512556 >> 172.21.15.42:0/3730512556 conn(0x7fd8a405b720 msgr2=0x7fd8a40aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:57.839 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.831+0000 7fd8aa430700 1 -- 172.21.15.42:0/3730512556 shutdown_connections 2020-04-02T23:24:57.839 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.831+0000 7fd8aa430700 1 -- 172.21.15.42:0/3730512556 wait complete. 2020-04-02T23:24:57.839 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.832+0000 7fd8aa430700 1 Processor -- start 2020-04-02T23:24:57.839 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.832+0000 7fd8aa430700 1 -- start start 2020-04-02T23:24:57.844 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.832+0000 7fd8aa430700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd8a4067380 0x7fd8a4066290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:57.844 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.832+0000 7fd8aa430700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd8a40ab410 0x7fd8a4064020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:57.844 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.832+0000 7fd8aa430700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a409a6f0 con 0x7fd8a413a1d0 2020-04-02T23:24:57.844 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.832+0000 7fd8aa430700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a40666f0 con 0x7fd8a4067380 2020-04-02T23:24:57.844 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.832+0000 7fd8aa430700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a4063010 con 0x7fd8a40ab410 2020-04-02T23:24:57.845 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a89cd700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd8a413a1d0 0x7fd8a4139620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59688/0 (socket says 172.21.15.42:59688) 2020-04-02T23:24:57.845 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a89cd700 1 -- 172.21.15.42:0/988833060 learned_addr learned my addr 172.21.15.42:0/988833060 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:57.845 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a3fff700 1 --2- 172.21.15.42:0/988833060 >> v2:172.21.15.84:3300/0 conn(0x7fd8a4067380 0x7fd8a4066290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:57.845 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd8a40ab410 0x7fd8a4064020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:57.845 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a17fa700 1 -- 172.21.15.42:0/988833060 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879826226 0 0) 0x7fd8a409a6f0 con 0x7fd8a413a1d0 2020-04-02T23:24:57.845 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a17fa700 1 -- 172.21.15.42:0/988833060 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd884002fe0 con 0x7fd8a413a1d0 2020-04-02T23:24:57.845 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a17fa700 1 -- 172.21.15.42:0/988833060 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3198846232 0 0) 0x7fd884002fe0 con 0x7fd8a413a1d0 2020-04-02T23:24:57.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a17fa700 1 -- 172.21.15.42:0/988833060 --> v1:172.21.15.42:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd8a409a6f0 con 0x7fd8a413a1d0 2020-04-02T23:24:57.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a17fa700 1 -- 172.21.15.42:0/988833060 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7fd89c001ab0 con 0x7fd8a413a1d0 2020-04-02T23:24:57.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a17fa700 1 -- 172.21.15.42:0/988833060 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd8a40ab410 msgr2=0x7fd8a4064020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:57.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a17fa700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd8a40ab410 0x7fd8a4064020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:57.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a17fa700 1 -- 172.21.15.42:0/988833060 >> v2:172.21.15.84:3300/0 conn(0x7fd8a4067380 msgr2=0x7fd8a4066290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:57.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a17fa700 1 --2- 172.21.15.42:0/988833060 >> v2:172.21.15.84:3300/0 conn(0x7fd8a4067380 0x7fd8a4066290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:57.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a17fa700 1 -- 172.21.15.42:0/988833060 >> v1:172.21.15.42:6789/0 conn(0x7fd8a413a1d0 legacy=0x7fd8a4139620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:57.846 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a17fa700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd8a40ab410 0x7fd8840049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:57.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a17fa700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd884004e10 0x7fd884005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:57.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a17fa700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd884003a30 0x7fd884003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:57.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a17fa700 1 -- 172.21.15.42:0/988833060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a40666f0 con 0x7fd884004e10 2020-04-02T23:24:57.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a17fa700 1 -- 172.21.15.42:0/988833060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a4063010 con 0x7fd884003a30 2020-04-02T23:24:57.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a17fa700 1 -- 172.21.15.42:0/988833060 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8840044e0 con 0x7fd8a40ab410 2020-04-02T23:24:57.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd884004e10 0x7fd884005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:57.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a3fff700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd8a40ab410 0x7fd8840049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:57.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.833+0000 7fd8a89cd700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd884003a30 0x7fd884003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:57.848 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.834+0000 7fd8a37fe700 1 -- 172.21.15.42:0/988833060 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd8a40ab410 msgr2=0x7fd8840049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:57.848 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.834+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd8a40ab410 0x7fd8840049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:57.848 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.834+0000 7fd8a37fe700 1 -- 172.21.15.42:0/988833060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd884003a30 msgr2=0x7fd884003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:57.848 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.834+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd884003a30 0x7fd884003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:57.848 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.834+0000 7fd8a37fe700 1 -- 172.21.15.42:0/988833060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a40632b0 con 0x7fd884004e10 2020-04-02T23:24:57.848 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.834+0000 7fd8a89cd700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd884003a30 0x7fd884003eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:24:57.848 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.834+0000 7fd8aa430700 1 -- 172.21.15.42:0/988833060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a4063750 con 0x7fd884004e10 2020-04-02T23:24:57.849 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.834+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd884004e10 0x7fd884005230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd8a405bc20 tx=0x7fd898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.849 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.834+0000 7fd8aa430700 1 -- 172.21.15.42:0/988833060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a413c270 con 0x7fd884004e10 2020-04-02T23:24:57.849 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.834+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd884004e10 0x7fd884005230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd8a405bc20 tx=0x7fd898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.849 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.834+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd884004e10 0x7fd884005230 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7fd8a405bc20 tx=0x7fd898007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:57.849 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.834+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd884004e10 0x7fd884005230 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fd8a405bc20 tx=0x7fd898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.849 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.834+0000 7fd8a17fa700 1 -- 172.21.15.42:0/988833060 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8980058b0 con 0x7fd884004e10 2020-04-02T23:24:57.849 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.834+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd884004e10 0x7fd884005230 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fd8a405bc20 tx=0x7fd898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.834+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd884004e10 0x7fd884005230 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fd8a405bc20 tx=0x7fd898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.834+0000 7fd8a17fa700 1 -- 172.21.15.42:0/988833060 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8980140a0 con 0x7fd884004e10 2020-04-02T23:24:57.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.834+0000 7fd8a17fa700 1 -- 172.21.15.42:0/988833060 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd898005c00 con 0x7fd884004e10 2020-04-02T23:24:57.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.834+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd884004e10 0x7fd884005230 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fd8a405bc20 tx=0x7fd898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.835+0000 7fd8aa430700 1 -- 172.21.15.42:0/988833060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd880003340 con 0x7fd884004e10 2020-04-02T23:24:57.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.835+0000 7fd8a17fa700 1 -- 172.21.15.42:0/988833060 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd898005d60 con 0x7fd884004e10 2020-04-02T23:24:57.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.835+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd884004e10 0x7fd884005230 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fd8a405bc20 tx=0x7fd898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.850 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.835+0000 7fd8a17fa700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd8840556e0 0x7fd884057ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:57.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.835+0000 7fd8a17fa700 1 -- 172.21.15.42:0/988833060 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd898061420 con 0x7fd884004e10 2020-04-02T23:24:57.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.835+0000 7fd8a3fff700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd8840556e0 0x7fd884057ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:57.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.836+0000 7fd8a3fff700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd8840556e0 0x7fd884057ba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd894000e90 tx=0x7fd89400caa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.836+0000 7fd8a3fff700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd8840556e0 0x7fd884057ba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd894000e90 tx=0x7fd89400caa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.836+0000 7fd8a3fff700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd8840556e0 0x7fd884057ba0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fd894000e90 tx=0x7fd89400caa0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:57.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.838+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd884004e10 0x7fd884005230 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fd8a405bc20 tx=0x7fd898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.838+0000 7fd8a17fa700 1 -- 172.21.15.42:0/988833060 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fd89803cc40 con 0x7fd884004e10 2020-04-02T23:24:57.990 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.988+0000 7fd8aa430700 1 -- 172.21.15.42:0/988833060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd8800021d0 con 0x7fd884004e10 2020-04-02T23:24:57.990 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.988+0000 7fd8a37fe700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd884004e10 0x7fd884005230 secure :-1 s=THROTTLE_DONE pgs=156 cs=0 l=1 rx=0x7fd8a405bc20 tx=0x7fd898007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:57.990 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.988+0000 7fd8a17fa700 1 -- 172.21.15.42:0/988833060 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd898040260 con 0x7fd884004e10 2020-04-02T23:24:57.991 INFO:teuthology.orchestra.run.smithi042.stdout:64424509445 2020-04-02T23:24:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.989+0000 7fd8aa430700 1 -- 172.21.15.42:0/988833060 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd8840556e0 msgr2=0x7fd884057ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.989+0000 7fd8aa430700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd8840556e0 0x7fd884057ba0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fd894000e90 tx=0x7fd89400caa0).stop 2020-04-02T23:24:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.989+0000 7fd8aa430700 1 -- 172.21.15.42:0/988833060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd884004e10 msgr2=0x7fd884005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.989+0000 7fd8aa430700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd884004e10 0x7fd884005230 secure :-1 s=READY pgs=156 cs=0 l=1 rx=0x7fd8a405bc20 tx=0x7fd898007a40).stop 2020-04-02T23:24:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.989+0000 7fd8a89cd700 1 -- 172.21.15.42:0/988833060 reap_dead start 2020-04-02T23:24:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.989+0000 7fd8aa430700 1 -- 172.21.15.42:0/988833060 shutdown_connections 2020-04-02T23:24:57.992 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.989+0000 7fd8aa430700 1 --2- 172.21.15.42:0/988833060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd884004e10 0x7fd884005230 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:57.993 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.989+0000 7fd8aa430700 1 -- 172.21.15.42:0/988833060 >> 172.21.15.42:0/988833060 conn(0x7fd8a405b720 msgr2=0x7fd8a4069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:57.993 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.989+0000 7fd8aa430700 1 -- 172.21.15.42:0/988833060 shutdown_connections 2020-04-02T23:24:57.993 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:57.990+0000 7fd8aa430700 1 -- 172.21.15.42:0/988833060 wait complete. 2020-04-02T23:24:58.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.7 2020-04-02T23:24:58.002 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-04-02T23:24:58.002 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:58.015 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-02T23:24:58.174 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.172+0000 7fd568611700 1 Processor -- start 2020-04-02T23:24:58.174 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.172+0000 7fd568611700 1 -- start start 2020-04-02T23:24:58.177 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.172+0000 7fd568611700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd5601398d0 0x7fd560139d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:58.177 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.172+0000 7fd568611700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5600a31b0 con 0x7fd5600a6d40 2020-04-02T23:24:58.177 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.172+0000 7fd568611700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5600a49f0 con 0x7fd5600ab410 2020-04-02T23:24:58.177 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.172+0000 7fd568611700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56005ff40 con 0x7fd5601398d0 2020-04-02T23:24:58.177 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd565bac700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd5600a6d40 0x7fd5601391c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59698/0 (socket says 172.21.15.42:59698) 2020-04-02T23:24:58.178 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd565bac700 1 -- 172.21.15.42:0/1051668454 learned_addr learned my addr 172.21.15.42:0/1051668454 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:58.178 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd566bae700 1 --2- 172.21.15.42:0/1051668454 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd5601398d0 0x7fd560139d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:58.178 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd5653ab700 1 -- 172.21.15.42:0/1051668454 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619916112 0 0) 0x7fd5600a31b0 con 0x7fd5600a6d40 2020-04-02T23:24:58.178 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd5653ab700 1 -- 172.21.15.42:0/1051668454 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd54c003230 con 0x7fd5600a6d40 2020-04-02T23:24:58.178 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd5653ab700 1 -- 172.21.15.42:0/1051668454 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531034635 0 0) 0x7fd5600a49f0 con 0x7fd5600ab410 2020-04-02T23:24:58.178 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd5653ab700 1 -- 172.21.15.42:0/1051668454 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5600a31b0 con 0x7fd5600ab410 2020-04-02T23:24:58.178 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd566bae700 1 -- 172.21.15.42:0/1051668454 >> v1:172.21.15.84:6789/0 conn(0x7fd5600ab410 legacy=0x7fd5600a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:58.178 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd5653ab700 1 -- 172.21.15.42:0/1051668454 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2671851451 0 0) 0x7fd54c003230 con 0x7fd5600a6d40 2020-04-02T23:24:58.179 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd566bae700 1 -- 172.21.15.42:0/1051668454 >> v1:172.21.15.42:6789/0 conn(0x7fd5600a6d40 legacy=0x7fd5601391c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:58.179 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd566bae700 1 -- 172.21.15.42:0/1051668454 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5600a3420 con 0x7fd5601398d0 2020-04-02T23:24:58.179 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd566bae700 1 --2- 172.21.15.42:0/1051668454 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd5601398d0 0x7fd560139d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd5540010d0 tx=0x7fd5500088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.179 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd566bae700 1 --2- 172.21.15.42:0/1051668454 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd5601398d0 0x7fd560139d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd5540010d0 tx=0x7fd5500088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.179 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd566bae700 1 --2- 172.21.15.42:0/1051668454 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd5601398d0 0x7fd560139d20 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7fd5540010d0 tx=0x7fd5500088e0).ready entity=mon.2 client_cookie=caa533a31d30b678 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:58.179 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd566bae700 1 --2- 172.21.15.42:0/1051668454 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd5601398d0 0x7fd560139d20 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fd5540010d0 tx=0x7fd5500088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.179 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd5653ab700 1 -- 172.21.15.42:0/1051668454 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5540016d0 con 0x7fd5601398d0 2020-04-02T23:24:58.180 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd566bae700 1 --2- 172.21.15.42:0/1051668454 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd5601398d0 0x7fd560139d20 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fd5540010d0 tx=0x7fd5500088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.180 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd566bae700 1 --2- 172.21.15.42:0/1051668454 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd5601398d0 0x7fd560139d20 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fd5540010d0 tx=0x7fd5500088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.180 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd5653ab700 1 -- 172.21.15.42:0/1051668454 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd550008e40 con 0x7fd5601398d0 2020-04-02T23:24:58.180 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd5653ab700 1 -- 172.21.15.42:0/1051668454 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd550011400 con 0x7fd5601398d0 2020-04-02T23:24:58.180 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd568611700 1 -- 172.21.15.42:0/1051668454 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd5601398d0 msgr2=0x7fd560139d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:58.180 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.173+0000 7fd568611700 1 --2- 172.21.15.42:0/1051668454 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd5601398d0 0x7fd560139d20 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7fd5540010d0 tx=0x7fd5500088e0).stop 2020-04-02T23:24:58.180 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.174+0000 7fd568611700 1 -- 172.21.15.42:0/1051668454 shutdown_connections 2020-04-02T23:24:58.180 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.174+0000 7fd568611700 1 --2- 172.21.15.42:0/1051668454 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fd5601398d0 0x7fd560139d20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:58.181 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.174+0000 7fd568611700 1 -- 172.21.15.42:0/1051668454 >> 172.21.15.42:0/1051668454 conn(0x7fd56005b720 msgr2=0x7fd5600aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:58.181 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.174+0000 7fd568611700 1 -- 172.21.15.42:0/1051668454 shutdown_connections 2020-04-02T23:24:58.181 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.174+0000 7fd568611700 1 -- 172.21.15.42:0/1051668454 wait complete. 2020-04-02T23:24:58.181 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.175+0000 7fd568611700 1 Processor -- start 2020-04-02T23:24:58.181 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.175+0000 7fd568611700 1 -- start start 2020-04-02T23:24:58.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.175+0000 7fd568611700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd5600a6d40 0x7fd56009ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:58.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.175+0000 7fd568611700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5601329d0 con 0x7fd5600ab410 2020-04-02T23:24:58.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.175+0000 7fd568611700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56009bea0 con 0x7fd5601398d0 2020-04-02T23:24:58.184 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.175+0000 7fd568611700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5600a0850 con 0x7fd5600a6d40 2020-04-02T23:24:58.185 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.176+0000 7fd565bac700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd5600ab410 0x7fd56012d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59706/0 (socket says 172.21.15.42:59706) 2020-04-02T23:24:58.185 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.176+0000 7fd5663ad700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd5600a6d40 0x7fd56009ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:58.185 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.176+0000 7fd565bac700 1 -- 172.21.15.42:0/3255181145 learned_addr learned my addr 172.21.15.42:0/3255181145 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:58.185 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.176+0000 7fd55f7fe700 1 -- 172.21.15.42:0/3255181145 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656360910 0 0) 0x7fd5601329d0 con 0x7fd5600ab410 2020-04-02T23:24:58.185 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.176+0000 7fd55f7fe700 1 -- 172.21.15.42:0/3255181145 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd540002fe0 con 0x7fd5600ab410 2020-04-02T23:24:58.185 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.176+0000 7fd5663ad700 1 -- 172.21.15.42:0/3255181145 >> v1:172.21.15.84:6789/0 conn(0x7fd5601398d0 legacy=0x7fd56012b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:58.185 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.176+0000 7fd5663ad700 1 -- 172.21.15.42:0/3255181145 >> v1:172.21.15.42:6789/0 conn(0x7fd5600ab410 legacy=0x7fd56012d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:58.186 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.176+0000 7fd5663ad700 1 -- 172.21.15.42:0/3255181145 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56009aab0 con 0x7fd5600a6d40 2020-04-02T23:24:58.186 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.176+0000 7fd5663ad700 1 --2- 172.21.15.42:0/3255181145 >> v2:172.21.15.42:3300/0 conn(0x7fd5600a6d40 0x7fd56009ba40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd558001450 tx=0x7fd558010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.186 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.176+0000 7fd5663ad700 1 --2- 172.21.15.42:0/3255181145 >> v2:172.21.15.42:3300/0 conn(0x7fd5600a6d40 0x7fd56009ba40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd558001450 tx=0x7fd558010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.186 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.176+0000 7fd5663ad700 1 --2- 172.21.15.42:0/3255181145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5600a6d40 0x7fd56009ba40 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7fd558001450 tx=0x7fd558010c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:58.186 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.176+0000 7fd5663ad700 1 --2- 172.21.15.42:0/3255181145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5600a6d40 0x7fd56009ba40 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fd558001450 tx=0x7fd558010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.186 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.176+0000 7fd55f7fe700 1 -- 172.21.15.42:0/3255181145 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5580122c0 con 0x7fd5600a6d40 2020-04-02T23:24:58.186 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.176+0000 7fd5663ad700 1 --2- 172.21.15.42:0/3255181145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5600a6d40 0x7fd56009ba40 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fd558001450 tx=0x7fd558010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.176+0000 7fd568611700 1 -- 172.21.15.42:0/3255181145 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56009af80 con 0x7fd5600a6d40 2020-04-02T23:24:58.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.176+0000 7fd55f7fe700 1 -- 172.21.15.42:0/3255181145 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd558012420 con 0x7fd5600a6d40 2020-04-02T23:24:58.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.176+0000 7fd5663ad700 1 --2- 172.21.15.42:0/3255181145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5600a6d40 0x7fd56009ba40 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fd558001450 tx=0x7fd558010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.176+0000 7fd55f7fe700 1 -- 172.21.15.42:0/3255181145 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5580127c0 con 0x7fd5600a6d40 2020-04-02T23:24:58.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.176+0000 7fd568611700 1 -- 172.21.15.42:0/3255181145 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56012cd50 con 0x7fd5600a6d40 2020-04-02T23:24:58.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.177+0000 7fd5663ad700 1 --2- 172.21.15.42:0/3255181145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5600a6d40 0x7fd56009ba40 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fd558001450 tx=0x7fd558010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.177+0000 7fd55f7fe700 1 -- 172.21.15.42:0/3255181145 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fd5580129c0 con 0x7fd5600a6d40 2020-04-02T23:24:58.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.177+0000 7fd5663ad700 1 --2- 172.21.15.42:0/3255181145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5600a6d40 0x7fd56009ba40 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fd558001450 tx=0x7fd558010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.188 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.177+0000 7fd568611700 1 -- 172.21.15.42:0/3255181145 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56005d2e0 con 0x7fd5600a6d40 2020-04-02T23:24:58.188 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.178+0000 7fd55f7fe700 1 --2- 172.21.15.42:0/3255181145 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd54004d810 0x7fd54004fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:58.188 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.178+0000 7fd55f7fe700 1 -- 172.21.15.42:0/3255181145 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd558061610 con 0x7fd5600a6d40 2020-04-02T23:24:58.188 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.178+0000 7fd565bac700 1 --2- 172.21.15.42:0/3255181145 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd54004d810 0x7fd54004fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:58.188 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.178+0000 7fd565bac700 1 --2- 172.21.15.42:0/3255181145 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd54004d810 0x7fd54004fcd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd554001000 tx=0x7fd554001ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.188 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.178+0000 7fd565bac700 1 --2- 172.21.15.42:0/3255181145 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd54004d810 0x7fd54004fcd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd554001000 tx=0x7fd554001ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.188 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.178+0000 7fd565bac700 1 --2- 172.21.15.42:0/3255181145 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd54004d810 0x7fd54004fcd0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7fd554001000 tx=0x7fd554001ac0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:58.189 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.181+0000 7fd5663ad700 1 --2- 172.21.15.42:0/3255181145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5600a6d40 0x7fd56009ba40 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fd558001450 tx=0x7fd558010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.189 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.181+0000 7fd55f7fe700 1 -- 172.21.15.42:0/3255181145 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fd55803ccf0 con 0x7fd5600a6d40 2020-04-02T23:24:58.323 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.321+0000 7fd568611700 1 -- 172.21.15.42:0/3255181145 --> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd56012cee0 con 0x7fd54004d810 2020-04-02T23:24:58.328 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.325+0000 7fd565bac700 1 --2- 172.21.15.42:0/3255181145 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd54004d810 0x7fd54004fcd0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7fd554001000 tx=0x7fd554001ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.328 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.325+0000 7fd55f7fe700 1 -- 172.21.15.42:0/3255181145 <== mgr.4100 v2:172.21.15.84:6800/23437 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82474 (secure 0 0 0) 0x7fd56012cee0 con 0x7fd54004d810 2020-04-02T23:24:58.328 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:24:58.329 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.326+0000 7fd568611700 1 -- 172.21.15.42:0/3255181145 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd54004d810 msgr2=0x7fd54004fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:58.330 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.326+0000 7fd568611700 1 --2- 172.21.15.42:0/3255181145 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd54004d810 0x7fd54004fcd0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7fd554001000 tx=0x7fd554001ac0).stop 2020-04-02T23:24:58.330 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.326+0000 7fd568611700 1 -- 172.21.15.42:0/3255181145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5600a6d40 msgr2=0x7fd56009ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:58.330 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.326+0000 7fd568611700 1 --2- 172.21.15.42:0/3255181145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5600a6d40 0x7fd56009ba40 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7fd558001450 tx=0x7fd558010c20).stop 2020-04-02T23:24:58.330 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.326+0000 7fd568611700 1 -- 172.21.15.42:0/3255181145 shutdown_connections 2020-04-02T23:24:58.330 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.326+0000 7fd568611700 1 --2- 172.21.15.42:0/3255181145 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fd54004d810 0x7fd54004fcd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:58.330 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.326+0000 7fd568611700 1 --2- 172.21.15.42:0/3255181145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5600a6d40 0x7fd56009ba40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:58.330 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.326+0000 7fd568611700 1 -- 172.21.15.42:0/3255181145 >> 172.21.15.42:0/3255181145 conn(0x7fd56005b720 msgr2=0x7fd560069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:58.331 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.327+0000 7fd568611700 1 -- 172.21.15.42:0/3255181145 shutdown_connections 2020-04-02T23:24:58.331 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.327+0000 7fd568611700 1 -- 172.21.15.42:0/3255181145 wait complete. 2020-04-02T23:24:58.331 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2020-04-02T23:24:58.339 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2020-04-02T23:24:57.075578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390848,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583872,"statfs":{"total":773094113280,"available":764501884928,"internally_reserved":8589934592,"allocated":2228224,"data_stored":879380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.090768"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.993801+0000","last_change":"2020-04-02T23:24:47.993492+0000","last_active":"2020-04-02T23:24:47.993801+0000","last_peered":"2020-04-02T23:24:47.993801+0000","last_clean":"2020-04-02T23:24:47.993801+0000","last_became_active":"2020-04-02T23:24:47.993002+0000","last_became_peered":"2020-04-02T23:24:47.993002+0000","last_unstale":"2020-04-02T23:24:47.993801+0000","last_undegraded":"2020-04-02T23:24:47.993801+0000","last_fullsized":"2020-04-02T23:24:47.993801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"14","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.990633+0000","last_change":"2020-04-02T23:24:42.210860+0000","last_active":"2020-04-02T23:24:47.990633+0000","last_peered":"2020-04-02T23:24:47.990633+0000","last_clean":"2020-04-02T23:24:47.990633+0000","last_became_active":"2020-04-02T23:24:42.210455+0000","last_became_peered":"2020-04-02T23:24:42.210455+0000","last_unstale":"2020-04-02T23:24:47.990633+0000","last_undegraded":"2020-04-02T23:24:47.990633+0000","last_fullsized":"2020-04-02T23:24:47.990633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'6","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:24:51.027476+0000","last_change":"2020-04-02T23:24:44.978026+0000","last_active":"2020-04-02T23:24:51.027476+0000","last_peered":"2020-04-02T23:24:51.027476+0000","last_clean":"2020-04-02T23:24:51.027476+0000","last_became_active":"2020-04-02T23:24:44.977559+0000","last_became_peered":"2020-04-02T23:24:44.977559+0000","last_unstale":"2020-04-02T23:24:51.027476+0000","last_undegraded":"2020-04-02T23:24:51.027476+0000","last_fullsized":"2020-04-02T23:24:51.027476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:48.354756+0000","last_change":"2020-04-02T23:24:48.354332+0000","last_active":"2020-04-02T23:24:48.354756+0000","last_peered":"2020-04-02T23:24:48.354756+0000","last_clean":"2020-04-02T23:24:48.354756+0000","last_became_active":"2020-04-02T23:24:48.353610+0000","last_became_peered":"2020-04-02T23:24:48.353610+0000","last_unstale":"2020-04-02T23:24:48.354756+0000","last_undegraded":"2020-04-02T23:24:48.354756+0000","last_fullsized":"2020-04-02T23:24:48.354756+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983921+0000","last_change":"2020-04-02T23:24:42.210957+0000","last_active":"2020-04-02T23:24:47.983921+0000","last_peered":"2020-04-02T23:24:47.983921+0000","last_clean":"2020-04-02T23:24:47.983921+0000","last_became_active":"2020-04-02T23:24:42.210546+0000","last_became_peered":"2020-04-02T23:24:42.210546+0000","last_unstale":"2020-04-02T23:24:47.983921+0000","last_undegraded":"2020-04-02T23:24:47.983921+0000","last_fullsized":"2020-04-02T23:24:47.983921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"26'5","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:24:51.017852+0000","last_change":"2020-04-02T23:24:44.977311+0000","last_active":"2020-04-02T23:24:51.017852+0000","last_peered":"2020-04-02T23:24:51.017852+0000","last_clean":"2020-04-02T23:24:51.017852+0000","last_became_active":"2020-04-02T23:24:44.976952+0000","last_became_peered":"2020-04-02T23:24:44.976952+0000","last_unstale":"2020-04-02T23:24:51.017852+0000","last_undegraded":"2020-04-02T23:24:51.017852+0000","last_fullsized":"2020-04-02T23:24:51.017852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:48.354958+0000","last_change":"2020-04-02T23:24:48.354357+0000","last_active":"2020-04-02T23:24:48.354958+0000","last_peered":"2020-04-02T23:24:48.354958+0000","last_clean":"2020-04-02T23:24:48.354958+0000","last_became_active":"2020-04-02T23:24:48.353668+0000","last_became_peered":"2020-04-02T23:24:48.353668+0000","last_unstale":"2020-04-02T23:24:48.354958+0000","last_undegraded":"2020-04-02T23:24:48.354958+0000","last_fullsized":"2020-04-02T23:24:48.354958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.986299+0000","last_change":"2020-04-02T23:24:41.967219+0000","last_active":"2020-04-02T23:24:47.986299+0000","last_peered":"2020-04-02T23:24:47.986299+0000","last_clean":"2020-04-02T23:24:47.986299+0000","last_became_active":"2020-04-02T23:24:41.966868+0000","last_became_peered":"2020-04-02T23:24:41.966868+0000","last_unstale":"2020-04-02T23:24:47.986299+0000","last_undegraded":"2020-04-02T23:24:47.986299+0000","last_fullsized":"2020-04-02T23:24:47.986299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"26'8","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:24:51.020962+0000","last_change":"2020-04-02T23:24:44.978238+0000","last_active":"2020-04-02T23:24:51.020962+0000","last_peered":"2020-04-02T23:24:51.020962+0000","last_clean":"2020-04-02T23:24:51.020962+0000","last_became_active":"2020-04-02T23:24:44.977934+0000","last_became_peered":"2020-04-02T23:24:44.977934+0000","last_unstale":"2020-04-02T23:24:51.020962+0000","last_undegraded":"2020-04-02T23:24:51.020962+0000","last_fullsized":"2020-04-02T23:24:51.020962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:48.354977+0000","last_change":"2020-04-02T23:24:48.354531+0000","last_active":"2020-04-02T23:24:48.354977+0000","last_peered":"2020-04-02T23:24:48.354977+0000","last_clean":"2020-04-02T23:24:48.354977+0000","last_became_active":"2020-04-02T23:24:48.353432+0000","last_became_peered":"2020-04-02T23:24:48.353432+0000","last_unstale":"2020-04-02T23:24:48.354977+0000","last_undegraded":"2020-04-02T23:24:48.354977+0000","last_fullsized":"2020-04-02T23:24:48.354977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983940+0000","last_change":"2020-04-02T23:24:42.200692+0000","last_active":"2020-04-02T23:24:47.983940+0000","last_peered":"2020-04-02T23:24:47.983940+0000","last_clean":"2020-04-02T23:24:47.983940+0000","last_became_active":"2020-04-02T23:24:42.200326+0000","last_became_peered":"2020-04-02T23:24:42.200326+0000","last_unstale":"2020-04-02T23:24:47.983940+0000","last_undegraded":"2020-04-02T23:24:47.983940+0000","last_fullsized":"2020-04-02T23:24:47.983940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:48.178748+0000","last_change":"2020-04-02T23:24:37.115477+0000","last_active":"2020-04-02T23:24:48.178748+0000","last_peered":"2020-04-02T23:24:48.178748+0000","last_clean":"2020-04-02T23:24:48.178748+0000","last_became_active":"2020-04-02T23:24:37.114896+0000","last_became_peered":"2020-04-02T23:24:37.114896+0000","last_unstale":"2020-04-02T23:24:48.178748+0000","last_undegraded":"2020-04-02T23:24:48.178748+0000","last_fullsized":"2020-04-02T23:24:48.178748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:28.069299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:28.069299+0000","last_clean_scrub_stamp":"2020-04-02T23:24:28.069299+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"26'1","reported_seq":"12","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:24:48.397471+0000","last_change":"2020-04-02T23:24:44.977844+0000","last_active":"2020-04-02T23:24:48.397471+0000","last_peered":"2020-04-02T23:24:48.397471+0000","last_clean":"2020-04-02T23:24:48.397471+0000","last_became_active":"2020-04-02T23:24:44.977355+0000","last_became_peered":"2020-04-02T23:24:44.977355+0000","last_unstale":"2020-04-02T23:24:48.397471+0000","last_undegraded":"2020-04-02T23:24:48.397471+0000","last_fullsized":"2020-04-02T23:24:48.397471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:48.180975+0000","last_change":"2020-04-02T23:24:48.180609+0000","last_active":"2020-04-02T23:24:48.180975+0000","last_peered":"2020-04-02T23:24:48.180975+0000","last_clean":"2020-04-02T23:24:48.180975+0000","last_became_active":"2020-04-02T23:24:48.179989+0000","last_became_peered":"2020-04-02T23:24:48.179989+0000","last_unstale":"2020-04-02T23:24:48.180975+0000","last_undegraded":"2020-04-02T23:24:48.180975+0000","last_fullsized":"2020-04-02T23:24:48.180975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983937+0000","last_change":"2020-04-02T23:24:41.967177+0000","last_active":"2020-04-02T23:24:47.983937+0000","last_peered":"2020-04-02T23:24:47.983937+0000","last_clean":"2020-04-02T23:24:47.983937+0000","last_became_active":"2020-04-02T23:24:41.966804+0000","last_became_peered":"2020-04-02T23:24:41.966804+0000","last_unstale":"2020-04-02T23:24:47.983937+0000","last_undegraded":"2020-04-02T23:24:47.983937+0000","last_fullsized":"2020-04-02T23:24:47.983937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.986201+0000","last_change":"2020-04-02T23:24:44.977656+0000","last_active":"2020-04-02T23:24:47.986201+0000","last_peered":"2020-04-02T23:24:47.986201+0000","last_clean":"2020-04-02T23:24:47.986201+0000","last_became_active":"2020-04-02T23:24:44.977243+0000","last_became_peered":"2020-04-02T23:24:44.977243+0000","last_unstale":"2020-04-02T23:24:47.986201+0000","last_undegraded":"2020-04-02T23:24:47.986201+0000","last_fullsized":"2020-04-02T23:24:47.986201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:48.354950+0000","last_change":"2020-04-02T23:24:48.354355+0000","last_active":"2020-04-02T23:24:48.354950+0000","last_peered":"2020-04-02T23:24:48.354950+0000","last_clean":"2020-04-02T23:24:48.354950+0000","last_became_active":"2020-04-02T23:24:48.353592+0000","last_became_peered":"2020-04-02T23:24:48.353592+0000","last_unstale":"2020-04-02T23:24:48.354950+0000","last_undegraded":"2020-04-02T23:24:48.354950+0000","last_fullsized":"2020-04-02T23:24:48.354950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.984549+0000","last_change":"2020-04-02T23:24:41.965438+0000","last_active":"2020-04-02T23:24:47.984549+0000","last_peered":"2020-04-02T23:24:47.984549+0000","last_clean":"2020-04-02T23:24:47.984549+0000","last_became_active":"2020-04-02T23:24:41.965120+0000","last_became_peered":"2020-04-02T23:24:41.965120+0000","last_unstale":"2020-04-02T23:24:47.984549+0000","last_undegraded":"2020-04-02T23:24:47.984549+0000","last_fullsized":"2020-04-02T23:24:47.984549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'8","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:24:51.023434+0000","last_change":"2020-04-02T23:24:44.980384+0000","last_active":"2020-04-02T23:24:51.023434+0000","last_peered":"2020-04-02T23:24:51.023434+0000","last_clean":"2020-04-02T23:24:51.023434+0000","last_became_active":"2020-04-02T23:24:44.980010+0000","last_became_peered":"2020-04-02T23:24:44.980010+0000","last_unstale":"2020-04-02T23:24:51.023434+0000","last_undegraded":"2020-04-02T23:24:51.023434+0000","last_fullsized":"2020-04-02T23:24:51.023434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:48.181523+0000","last_change":"2020-04-02T23:24:48.180789+0000","last_active":"2020-04-02T23:24:48.181523+0000","last_peered":"2020-04-02T23:24:48.181523+0000","last_clean":"2020-04-02T23:24:48.181523+0000","last_became_active":"2020-04-02T23:24:48.179994+0000","last_became_peered":"2020-04-02T23:24:48.179994+0000","last_unstale":"2020-04-02T23:24:48.181523+0000","last_undegraded":"2020-04-02T23:24:48.181523+0000","last_fullsized":"2020-04-02T23:24:48.181523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'7","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:24:51.023367+0000","last_change":"2020-04-02T23:24:44.979136+0000","last_active":"2020-04-02T23:24:51.023367+0000","last_peered":"2020-04-02T23:24:51.023367+0000","last_clean":"2020-04-02T23:24:51.023367+0000","last_became_active":"2020-04-02T23:24:44.978145+0000","last_became_peered":"2020-04-02T23:24:44.978145+0000","last_unstale":"2020-04-02T23:24:51.023367+0000","last_undegraded":"2020-04-02T23:24:51.023367+0000","last_fullsized":"2020-04-02T23:24:51.023367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"14","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.990041+0000","last_change":"2020-04-02T23:24:42.311572+0000","last_active":"2020-04-02T23:24:47.990041+0000","last_peered":"2020-04-02T23:24:47.990041+0000","last_clean":"2020-04-02T23:24:47.990041+0000","last_became_active":"2020-04-02T23:24:42.311136+0000","last_became_peered":"2020-04-02T23:24:42.311136+0000","last_unstale":"2020-04-02T23:24:47.990041+0000","last_undegraded":"2020-04-02T23:24:47.990041+0000","last_fullsized":"2020-04-02T23:24:47.990041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:48.181420+0000","last_change":"2020-04-02T23:24:48.180425+0000","last_active":"2020-04-02T23:24:48.181420+0000","last_peered":"2020-04-02T23:24:48.181420+0000","last_clean":"2020-04-02T23:24:48.181420+0000","last_became_active":"2020-04-02T23:24:48.179883+0000","last_became_peered":"2020-04-02T23:24:48.179883+0000","last_unstale":"2020-04-02T23:24:48.181420+0000","last_undegraded":"2020-04-02T23:24:48.181420+0000","last_fullsized":"2020-04-02T23:24:48.181420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983945+0000","last_change":"2020-04-02T23:24:42.311312+0000","last_active":"2020-04-02T23:24:47.983945+0000","last_peered":"2020-04-02T23:24:47.983945+0000","last_clean":"2020-04-02T23:24:47.983945+0000","last_became_active":"2020-04-02T23:24:42.310964+0000","last_became_peered":"2020-04-02T23:24:42.310964+0000","last_unstale":"2020-04-02T23:24:47.983945+0000","last_undegraded":"2020-04-02T23:24:47.983945+0000","last_fullsized":"2020-04-02T23:24:47.983945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'4","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:24:51.023002+0000","last_change":"2020-04-02T23:24:44.974217+0000","last_active":"2020-04-02T23:24:51.023002+0000","last_peered":"2020-04-02T23:24:51.023002+0000","last_clean":"2020-04-02T23:24:51.023002+0000","last_became_active":"2020-04-02T23:24:44.973795+0000","last_became_peered":"2020-04-02T23:24:44.973795+0000","last_unstale":"2020-04-02T23:24:51.023002+0000","last_undegraded":"2020-04-02T23:24:51.023002+0000","last_fullsized":"2020-04-02T23:24:51.023002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":109351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":109917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048876,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322964,"statfs":{"total":96636764160,"available":95562715136,"internally_reserved":1073741824,"allocated":299008,"data_stored":111603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":110877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":109385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":109351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":109545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":109351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]}]}} 2020-04-02T23:24:58.342 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:58.357 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-02T23:24:58.510 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.508+0000 7f46da418700 1 Processor -- start 2020-04-02T23:24:58.510 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.508+0000 7f46da418700 1 -- start start 2020-04-02T23:24:58.513 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.509+0000 7f46da418700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f46d41398d0 0x7f46d4139d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:58.513 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.509+0000 7f46da418700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d40a31b0 con 0x7f46d40a6d40 2020-04-02T23:24:58.514 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.509+0000 7f46da418700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d40a49f0 con 0x7f46d40ab410 2020-04-02T23:24:58.514 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.509+0000 7f46da418700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d405ff40 con 0x7f46d41398d0 2020-04-02T23:24:58.514 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.509+0000 7f46d37fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f46d40a6d40 0x7f46d41391c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59714/0 (socket says 172.21.15.42:59714) 2020-04-02T23:24:58.514 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.509+0000 7f46d37fe700 1 -- 172.21.15.42:0/3070911768 learned_addr learned my addr 172.21.15.42:0/3070911768 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:58.514 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.509+0000 7f46d89b5700 1 --2- 172.21.15.42:0/3070911768 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f46d41398d0 0x7f46d4139d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:58.514 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.509+0000 7f46d2ffd700 1 -- 172.21.15.42:0/3070911768 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498734274 0 0) 0x7f46d40a31b0 con 0x7f46d40a6d40 2020-04-02T23:24:58.514 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.509+0000 7f46d2ffd700 1 -- 172.21.15.42:0/3070911768 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46c0003230 con 0x7f46d40a6d40 2020-04-02T23:24:58.515 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.509+0000 7f46d2ffd700 1 -- 172.21.15.42:0/3070911768 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318211707 0 0) 0x7f46d40a49f0 con 0x7f46d40ab410 2020-04-02T23:24:58.515 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.509+0000 7f46d2ffd700 1 -- 172.21.15.42:0/3070911768 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46d40a31b0 con 0x7f46d40ab410 2020-04-02T23:24:58.515 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.509+0000 7f46d89b5700 1 -- 172.21.15.42:0/3070911768 >> v1:172.21.15.84:6789/0 conn(0x7f46d40ab410 legacy=0x7f46d40a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:58.515 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.509+0000 7f46d2ffd700 1 -- 172.21.15.42:0/3070911768 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3012619818 0 0) 0x7f46c0003230 con 0x7f46d40a6d40 2020-04-02T23:24:58.515 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.509+0000 7f46d89b5700 1 -- 172.21.15.42:0/3070911768 >> v1:172.21.15.42:6789/0 conn(0x7f46d40a6d40 legacy=0x7f46d41391c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:58.515 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.509+0000 7f46d89b5700 1 -- 172.21.15.42:0/3070911768 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d40a3420 con 0x7f46d41398d0 2020-04-02T23:24:58.515 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.509+0000 7f46d89b5700 1 --2- 172.21.15.42:0/3070911768 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f46d41398d0 0x7f46d4139d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f46c80010d0 tx=0x7f46cc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.515 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.509+0000 7f46d89b5700 1 --2- 172.21.15.42:0/3070911768 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f46d41398d0 0x7f46d4139d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f46c80010d0 tx=0x7f46cc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.516 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.509+0000 7f46d89b5700 1 --2- 172.21.15.42:0/3070911768 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f46d41398d0 0x7f46d4139d20 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f46c80010d0 tx=0x7f46cc008c60).ready entity=mon.2 client_cookie=b7cf54683a22a971 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:58.516 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.510+0000 7f46d89b5700 1 --2- 172.21.15.42:0/3070911768 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f46d41398d0 0x7f46d4139d20 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f46c80010d0 tx=0x7f46cc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.516 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.510+0000 7f46d2ffd700 1 -- 172.21.15.42:0/3070911768 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46c80016d0 con 0x7f46d41398d0 2020-04-02T23:24:58.516 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.510+0000 7f46d89b5700 1 --2- 172.21.15.42:0/3070911768 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f46d41398d0 0x7f46d4139d20 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f46c80010d0 tx=0x7f46cc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.516 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.510+0000 7f46d2ffd700 1 -- 172.21.15.42:0/3070911768 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46cc013c90 con 0x7f46d41398d0 2020-04-02T23:24:58.516 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.510+0000 7f46d89b5700 1 --2- 172.21.15.42:0/3070911768 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f46d41398d0 0x7f46d4139d20 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f46c80010d0 tx=0x7f46cc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.516 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.510+0000 7f46d2ffd700 1 -- 172.21.15.42:0/3070911768 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46cc013e00 con 0x7f46d41398d0 2020-04-02T23:24:58.517 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.510+0000 7f46da418700 1 -- 172.21.15.42:0/3070911768 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f46d41398d0 msgr2=0x7f46d4139d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:58.517 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.510+0000 7f46da418700 1 --2- 172.21.15.42:0/3070911768 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f46d41398d0 0x7f46d4139d20 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f46c80010d0 tx=0x7f46cc008c60).stop 2020-04-02T23:24:58.517 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.510+0000 7f46da418700 1 -- 172.21.15.42:0/3070911768 shutdown_connections 2020-04-02T23:24:58.517 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.510+0000 7f46da418700 1 --2- 172.21.15.42:0/3070911768 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f46d41398d0 0x7f46d4139d20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:58.517 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.510+0000 7f46da418700 1 -- 172.21.15.42:0/3070911768 >> 172.21.15.42:0/3070911768 conn(0x7f46d405b720 msgr2=0x7f46d40aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:58.517 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.510+0000 7f46da418700 1 -- 172.21.15.42:0/3070911768 shutdown_connections 2020-04-02T23:24:58.517 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.510+0000 7f46da418700 1 -- 172.21.15.42:0/3070911768 wait complete. 2020-04-02T23:24:58.517 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.511+0000 7f46da418700 1 Processor -- start 2020-04-02T23:24:58.518 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.511+0000 7f46da418700 1 -- start start 2020-04-02T23:24:58.521 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.512+0000 7f46da418700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f46d40a6d40 0x7f46d40625f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:58.521 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.512+0000 7f46da418700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f46d41398d0 0x7f46d409c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:58.521 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.512+0000 7f46da418700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d409aab0 con 0x7f46d40ab410 2020-04-02T23:24:58.521 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.512+0000 7f46da418700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d4061d10 con 0x7f46d41398d0 2020-04-02T23:24:58.521 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.512+0000 7f46da418700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d409d4f0 con 0x7f46d40a6d40 2020-04-02T23:24:58.521 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.512+0000 7f46d89b5700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f46d41398d0 0x7f46d409c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:58.522 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.512+0000 7f46d89b5700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f46d41398d0 0x7f46d409c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40298/0 (socket says 172.21.15.42:40298) 2020-04-02T23:24:58.522 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.512+0000 7f46d89b5700 1 -- 172.21.15.42:0/4098141522 learned_addr learned my addr 172.21.15.42:0/4098141522 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:58.522 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.512+0000 7f46d3fff700 1 --2- 172.21.15.42:0/4098141522 >> v2:172.21.15.84:3300/0 conn(0x7f46d40a6d40 0x7f46d40625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:58.522 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.512+0000 7f46d89b5700 1 -- 172.21.15.42:0/4098141522 >> v2:172.21.15.84:3300/0 conn(0x7f46d40a6d40 msgr2=0x7f46d40625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:58.522 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.512+0000 7f46d89b5700 1 --2- 172.21.15.42:0/4098141522 >> v2:172.21.15.84:3300/0 conn(0x7f46d40a6d40 0x7f46d40625f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:58.522 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.512+0000 7f46d89b5700 1 -- 172.21.15.42:0/4098141522 >> v1:172.21.15.84:6789/0 conn(0x7f46d40ab410 legacy=0x7f46d4135870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:58.522 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.512+0000 7f46d89b5700 1 -- 172.21.15.42:0/4098141522 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d409d790 con 0x7f46d41398d0 2020-04-02T23:24:58.523 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.512+0000 7f46d89b5700 1 --2- 172.21.15.42:0/4098141522 >> v2:172.21.15.42:3300/0 conn(0x7f46d41398d0 0x7f46d409c130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f46c80010d0 tx=0x7f46d40ab7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.523 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.512+0000 7f46d89b5700 1 --2- 172.21.15.42:0/4098141522 >> v2:172.21.15.42:3300/0 conn(0x7f46d41398d0 0x7f46d409c130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f46c80010d0 tx=0x7f46d40ab7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.523 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.512+0000 7f46d89b5700 1 --2- 172.21.15.42:0/4098141522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46d41398d0 0x7f46d409c130 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f46c80010d0 tx=0x7f46d40ab7f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:58.523 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.512+0000 7f46d89b5700 1 --2- 172.21.15.42:0/4098141522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46d41398d0 0x7f46d409c130 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f46c80010d0 tx=0x7f46d40ab7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.523 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.512+0000 7f46d17fa700 1 -- 172.21.15.42:0/4098141522 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46cc005c30 con 0x7f46d41398d0 2020-04-02T23:24:58.523 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.512+0000 7f46d89b5700 1 --2- 172.21.15.42:0/4098141522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46d41398d0 0x7f46d409c130 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f46c80010d0 tx=0x7f46d40ab7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.523 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.512+0000 7f46d89b5700 1 --2- 172.21.15.42:0/4098141522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46d41398d0 0x7f46d409c130 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f46c80010d0 tx=0x7f46d40ab7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.523 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.513+0000 7f46d17fa700 1 -- 172.21.15.42:0/4098141522 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46cc005d90 con 0x7f46d41398d0 2020-04-02T23:24:58.524 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.513+0000 7f46da418700 1 -- 172.21.15.42:0/4098141522 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d4135f80 con 0x7f46d41398d0 2020-04-02T23:24:58.524 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.513+0000 7f46d17fa700 1 -- 172.21.15.42:0/4098141522 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46cc007340 con 0x7f46d41398d0 2020-04-02T23:24:58.524 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.513+0000 7f46da418700 1 -- 172.21.15.42:0/4098141522 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d409ffb0 con 0x7f46d41398d0 2020-04-02T23:24:58.524 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.513+0000 7f46d89b5700 1 --2- 172.21.15.42:0/4098141522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46d41398d0 0x7f46d409c130 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f46c80010d0 tx=0x7f46d40ab7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.524 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.513+0000 7f46da418700 1 -- 172.21.15.42:0/4098141522 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d405d2e0 con 0x7f46d41398d0 2020-04-02T23:24:58.524 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.514+0000 7f46d17fa700 1 -- 172.21.15.42:0/4098141522 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f46cc0075b0 con 0x7f46d41398d0 2020-04-02T23:24:58.524 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.514+0000 7f46d89b5700 1 --2- 172.21.15.42:0/4098141522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46d41398d0 0x7f46d409c130 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f46c80010d0 tx=0x7f46d40ab7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.525 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.514+0000 7f46d17fa700 1 --2- 172.21.15.42:0/4098141522 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f46b404d5d0 0x7f46b404fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:58.525 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.514+0000 7f46d17fa700 1 -- 172.21.15.42:0/4098141522 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f46cc063a00 con 0x7f46d41398d0 2020-04-02T23:24:58.525 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.514+0000 7f46d3fff700 1 --2- 172.21.15.42:0/4098141522 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f46b404d5d0 0x7f46b404fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:58.525 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.514+0000 7f46d3fff700 1 --2- 172.21.15.42:0/4098141522 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f46b404d5d0 0x7f46b404fa90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f46c40010d0 tx=0x7f46c4003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.525 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.514+0000 7f46d3fff700 1 --2- 172.21.15.42:0/4098141522 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f46b404d5d0 0x7f46b404fa90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f46c40010d0 tx=0x7f46c4003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.525 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.514+0000 7f46d3fff700 1 --2- 172.21.15.42:0/4098141522 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f46b404d5d0 0x7f46b404fa90 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f46c40010d0 tx=0x7f46c4003e60).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:58.525 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.517+0000 7f46d89b5700 1 --2- 172.21.15.42:0/4098141522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46d41398d0 0x7f46d409c130 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f46c80010d0 tx=0x7f46d40ab7f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.526 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.517+0000 7f46d17fa700 1 -- 172.21.15.42:0/4098141522 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f46cc03f220 con 0x7f46d41398d0 2020-04-02T23:24:58.661 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.659+0000 7f46da418700 1 -- 172.21.15.42:0/4098141522 --> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46d409d370 con 0x7f46b404d5d0 2020-04-02T23:24:58.665 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.662+0000 7f46d3fff700 1 --2- 172.21.15.42:0/4098141522 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f46b404d5d0 0x7f46b404fa90 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f46c40010d0 tx=0x7f46c4003e60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.666 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.662+0000 7f46d17fa700 1 -- 172.21.15.42:0/4098141522 <== mgr.4100 v2:172.21.15.84:6800/23437 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82474 (secure 0 0 0) 0x7f46c4008260 con 0x7f46b404d5d0 2020-04-02T23:24:58.666 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.663+0000 7f46da418700 1 -- 172.21.15.42:0/4098141522 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f46b404d5d0 msgr2=0x7f46b404fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:58.666 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.663+0000 7f46da418700 1 --2- 172.21.15.42:0/4098141522 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f46b404d5d0 0x7f46b404fa90 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f46c40010d0 tx=0x7f46c4003e60).stop 2020-04-02T23:24:58.666 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.663+0000 7f46da418700 1 -- 172.21.15.42:0/4098141522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46d41398d0 msgr2=0x7f46d409c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:58.666 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.663+0000 7f46da418700 1 --2- 172.21.15.42:0/4098141522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46d41398d0 0x7f46d409c130 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f46c80010d0 tx=0x7f46d40ab7f0).stop 2020-04-02T23:24:58.666 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.663+0000 7f46da418700 1 -- 172.21.15.42:0/4098141522 shutdown_connections 2020-04-02T23:24:58.667 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.663+0000 7f46da418700 1 --2- 172.21.15.42:0/4098141522 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f46b404d5d0 0x7f46b404fa90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:58.667 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.663+0000 7f46da418700 1 --2- 172.21.15.42:0/4098141522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46d41398d0 0x7f46d409c130 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:58.667 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.663+0000 7f46da418700 1 --2- 172.21.15.42:0/4098141522 >> v2:172.21.15.84:3300/0 conn(0x7f46d40a6d40 0x7f46d40625f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:58.667 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.663+0000 7f46da418700 1 -- 172.21.15.42:0/4098141522 >> 172.21.15.42:0/4098141522 conn(0x7f46d405b720 msgr2=0x7f46d40aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:58.667 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.664+0000 7f46da418700 1 -- 172.21.15.42:0/4098141522 shutdown_connections 2020-04-02T23:24:58.667 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.664+0000 7f46da418700 1 -- 172.21.15.42:0/4098141522 wait complete. 2020-04-02T23:24:58.667 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:24:58.668 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2020-04-02T23:24:58.676 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2020-04-02T23:24:57.075578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390848,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583872,"statfs":{"total":773094113280,"available":764501884928,"internally_reserved":8589934592,"allocated":2228224,"data_stored":879380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.090768"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.993801+0000","last_change":"2020-04-02T23:24:47.993492+0000","last_active":"2020-04-02T23:24:47.993801+0000","last_peered":"2020-04-02T23:24:47.993801+0000","last_clean":"2020-04-02T23:24:47.993801+0000","last_became_active":"2020-04-02T23:24:47.993002+0000","last_became_peered":"2020-04-02T23:24:47.993002+0000","last_unstale":"2020-04-02T23:24:47.993801+0000","last_undegraded":"2020-04-02T23:24:47.993801+0000","last_fullsized":"2020-04-02T23:24:47.993801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"14","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.990633+0000","last_change":"2020-04-02T23:24:42.210860+0000","last_active":"2020-04-02T23:24:47.990633+0000","last_peered":"2020-04-02T23:24:47.990633+0000","last_clean":"2020-04-02T23:24:47.990633+0000","last_became_active":"2020-04-02T23:24:42.210455+0000","last_became_peered":"2020-04-02T23:24:42.210455+0000","last_unstale":"2020-04-02T23:24:47.990633+0000","last_undegraded":"2020-04-02T23:24:47.990633+0000","last_fullsized":"2020-04-02T23:24:47.990633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'6","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:24:51.027476+0000","last_change":"2020-04-02T23:24:44.978026+0000","last_active":"2020-04-02T23:24:51.027476+0000","last_peered":"2020-04-02T23:24:51.027476+0000","last_clean":"2020-04-02T23:24:51.027476+0000","last_became_active":"2020-04-02T23:24:44.977559+0000","last_became_peered":"2020-04-02T23:24:44.977559+0000","last_unstale":"2020-04-02T23:24:51.027476+0000","last_undegraded":"2020-04-02T23:24:51.027476+0000","last_fullsized":"2020-04-02T23:24:51.027476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:48.354756+0000","last_change":"2020-04-02T23:24:48.354332+0000","last_active":"2020-04-02T23:24:48.354756+0000","last_peered":"2020-04-02T23:24:48.354756+0000","last_clean":"2020-04-02T23:24:48.354756+0000","last_became_active":"2020-04-02T23:24:48.353610+0000","last_became_peered":"2020-04-02T23:24:48.353610+0000","last_unstale":"2020-04-02T23:24:48.354756+0000","last_undegraded":"2020-04-02T23:24:48.354756+0000","last_fullsized":"2020-04-02T23:24:48.354756+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983921+0000","last_change":"2020-04-02T23:24:42.210957+0000","last_active":"2020-04-02T23:24:47.983921+0000","last_peered":"2020-04-02T23:24:47.983921+0000","last_clean":"2020-04-02T23:24:47.983921+0000","last_became_active":"2020-04-02T23:24:42.210546+0000","last_became_peered":"2020-04-02T23:24:42.210546+0000","last_unstale":"2020-04-02T23:24:47.983921+0000","last_undegraded":"2020-04-02T23:24:47.983921+0000","last_fullsized":"2020-04-02T23:24:47.983921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"26'5","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:24:51.017852+0000","last_change":"2020-04-02T23:24:44.977311+0000","last_active":"2020-04-02T23:24:51.017852+0000","last_peered":"2020-04-02T23:24:51.017852+0000","last_clean":"2020-04-02T23:24:51.017852+0000","last_became_active":"2020-04-02T23:24:44.976952+0000","last_became_peered":"2020-04-02T23:24:44.976952+0000","last_unstale":"2020-04-02T23:24:51.017852+0000","last_undegraded":"2020-04-02T23:24:51.017852+0000","last_fullsized":"2020-04-02T23:24:51.017852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:48.354958+0000","last_change":"2020-04-02T23:24:48.354357+0000","last_active":"2020-04-02T23:24:48.354958+0000","last_peered":"2020-04-02T23:24:48.354958+0000","last_clean":"2020-04-02T23:24:48.354958+0000","last_became_active":"2020-04-02T23:24:48.353668+0000","last_became_peered":"2020-04-02T23:24:48.353668+0000","last_unstale":"2020-04-02T23:24:48.354958+0000","last_undegraded":"2020-04-02T23:24:48.354958+0000","last_fullsized":"2020-04-02T23:24:48.354958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.986299+0000","last_change":"2020-04-02T23:24:41.967219+0000","last_active":"2020-04-02T23:24:47.986299+0000","last_peered":"2020-04-02T23:24:47.986299+0000","last_clean":"2020-04-02T23:24:47.986299+0000","last_became_active":"2020-04-02T23:24:41.966868+0000","last_became_peered":"2020-04-02T23:24:41.966868+0000","last_unstale":"2020-04-02T23:24:47.986299+0000","last_undegraded":"2020-04-02T23:24:47.986299+0000","last_fullsized":"2020-04-02T23:24:47.986299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"26'8","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:24:51.020962+0000","last_change":"2020-04-02T23:24:44.978238+0000","last_active":"2020-04-02T23:24:51.020962+0000","last_peered":"2020-04-02T23:24:51.020962+0000","last_clean":"2020-04-02T23:24:51.020962+0000","last_became_active":"2020-04-02T23:24:44.977934+0000","last_became_peered":"2020-04-02T23:24:44.977934+0000","last_unstale":"2020-04-02T23:24:51.020962+0000","last_undegraded":"2020-04-02T23:24:51.020962+0000","last_fullsized":"2020-04-02T23:24:51.020962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:48.354977+0000","last_change":"2020-04-02T23:24:48.354531+0000","last_active":"2020-04-02T23:24:48.354977+0000","last_peered":"2020-04-02T23:24:48.354977+0000","last_clean":"2020-04-02T23:24:48.354977+0000","last_became_active":"2020-04-02T23:24:48.353432+0000","last_became_peered":"2020-04-02T23:24:48.353432+0000","last_unstale":"2020-04-02T23:24:48.354977+0000","last_undegraded":"2020-04-02T23:24:48.354977+0000","last_fullsized":"2020-04-02T23:24:48.354977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983940+0000","last_change":"2020-04-02T23:24:42.200692+0000","last_active":"2020-04-02T23:24:47.983940+0000","last_peered":"2020-04-02T23:24:47.983940+0000","last_clean":"2020-04-02T23:24:47.983940+0000","last_became_active":"2020-04-02T23:24:42.200326+0000","last_became_peered":"2020-04-02T23:24:42.200326+0000","last_unstale":"2020-04-02T23:24:47.983940+0000","last_undegraded":"2020-04-02T23:24:47.983940+0000","last_fullsized":"2020-04-02T23:24:47.983940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:48.178748+0000","last_change":"2020-04-02T23:24:37.115477+0000","last_active":"2020-04-02T23:24:48.178748+0000","last_peered":"2020-04-02T23:24:48.178748+0000","last_clean":"2020-04-02T23:24:48.178748+0000","last_became_active":"2020-04-02T23:24:37.114896+0000","last_became_peered":"2020-04-02T23:24:37.114896+0000","last_unstale":"2020-04-02T23:24:48.178748+0000","last_undegraded":"2020-04-02T23:24:48.178748+0000","last_fullsized":"2020-04-02T23:24:48.178748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:28.069299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:28.069299+0000","last_clean_scrub_stamp":"2020-04-02T23:24:28.069299+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"26'1","reported_seq":"12","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:24:48.397471+0000","last_change":"2020-04-02T23:24:44.977844+0000","last_active":"2020-04-02T23:24:48.397471+0000","last_peered":"2020-04-02T23:24:48.397471+0000","last_clean":"2020-04-02T23:24:48.397471+0000","last_became_active":"2020-04-02T23:24:44.977355+0000","last_became_peered":"2020-04-02T23:24:44.977355+0000","last_unstale":"2020-04-02T23:24:48.397471+0000","last_undegraded":"2020-04-02T23:24:48.397471+0000","last_fullsized":"2020-04-02T23:24:48.397471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:48.180975+0000","last_change":"2020-04-02T23:24:48.180609+0000","last_active":"2020-04-02T23:24:48.180975+0000","last_peered":"2020-04-02T23:24:48.180975+0000","last_clean":"2020-04-02T23:24:48.180975+0000","last_became_active":"2020-04-02T23:24:48.179989+0000","last_became_peered":"2020-04-02T23:24:48.179989+0000","last_unstale":"2020-04-02T23:24:48.180975+0000","last_undegraded":"2020-04-02T23:24:48.180975+0000","last_fullsized":"2020-04-02T23:24:48.180975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983937+0000","last_change":"2020-04-02T23:24:41.967177+0000","last_active":"2020-04-02T23:24:47.983937+0000","last_peered":"2020-04-02T23:24:47.983937+0000","last_clean":"2020-04-02T23:24:47.983937+0000","last_became_active":"2020-04-02T23:24:41.966804+0000","last_became_peered":"2020-04-02T23:24:41.966804+0000","last_unstale":"2020-04-02T23:24:47.983937+0000","last_undegraded":"2020-04-02T23:24:47.983937+0000","last_fullsized":"2020-04-02T23:24:47.983937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.986201+0000","last_change":"2020-04-02T23:24:44.977656+0000","last_active":"2020-04-02T23:24:47.986201+0000","last_peered":"2020-04-02T23:24:47.986201+0000","last_clean":"2020-04-02T23:24:47.986201+0000","last_became_active":"2020-04-02T23:24:44.977243+0000","last_became_peered":"2020-04-02T23:24:44.977243+0000","last_unstale":"2020-04-02T23:24:47.986201+0000","last_undegraded":"2020-04-02T23:24:47.986201+0000","last_fullsized":"2020-04-02T23:24:47.986201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:48.354950+0000","last_change":"2020-04-02T23:24:48.354355+0000","last_active":"2020-04-02T23:24:48.354950+0000","last_peered":"2020-04-02T23:24:48.354950+0000","last_clean":"2020-04-02T23:24:48.354950+0000","last_became_active":"2020-04-02T23:24:48.353592+0000","last_became_peered":"2020-04-02T23:24:48.353592+0000","last_unstale":"2020-04-02T23:24:48.354950+0000","last_undegraded":"2020-04-02T23:24:48.354950+0000","last_fullsized":"2020-04-02T23:24:48.354950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.984549+0000","last_change":"2020-04-02T23:24:41.965438+0000","last_active":"2020-04-02T23:24:47.984549+0000","last_peered":"2020-04-02T23:24:47.984549+0000","last_clean":"2020-04-02T23:24:47.984549+0000","last_became_active":"2020-04-02T23:24:41.965120+0000","last_became_peered":"2020-04-02T23:24:41.965120+0000","last_unstale":"2020-04-02T23:24:47.984549+0000","last_undegraded":"2020-04-02T23:24:47.984549+0000","last_fullsized":"2020-04-02T23:24:47.984549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'8","reported_seq":"19","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:24:51.023434+0000","last_change":"2020-04-02T23:24:44.980384+0000","last_active":"2020-04-02T23:24:51.023434+0000","last_peered":"2020-04-02T23:24:51.023434+0000","last_clean":"2020-04-02T23:24:51.023434+0000","last_became_active":"2020-04-02T23:24:44.980010+0000","last_became_peered":"2020-04-02T23:24:44.980010+0000","last_unstale":"2020-04-02T23:24:51.023434+0000","last_undegraded":"2020-04-02T23:24:51.023434+0000","last_fullsized":"2020-04-02T23:24:51.023434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:48.181523+0000","last_change":"2020-04-02T23:24:48.180789+0000","last_active":"2020-04-02T23:24:48.181523+0000","last_peered":"2020-04-02T23:24:48.181523+0000","last_clean":"2020-04-02T23:24:48.181523+0000","last_became_active":"2020-04-02T23:24:48.179994+0000","last_became_peered":"2020-04-02T23:24:48.179994+0000","last_unstale":"2020-04-02T23:24:48.181523+0000","last_undegraded":"2020-04-02T23:24:48.181523+0000","last_fullsized":"2020-04-02T23:24:48.181523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'7","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:24:51.023367+0000","last_change":"2020-04-02T23:24:44.979136+0000","last_active":"2020-04-02T23:24:51.023367+0000","last_peered":"2020-04-02T23:24:51.023367+0000","last_clean":"2020-04-02T23:24:51.023367+0000","last_became_active":"2020-04-02T23:24:44.978145+0000","last_became_peered":"2020-04-02T23:24:44.978145+0000","last_unstale":"2020-04-02T23:24:51.023367+0000","last_undegraded":"2020-04-02T23:24:51.023367+0000","last_fullsized":"2020-04-02T23:24:51.023367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"14","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.990041+0000","last_change":"2020-04-02T23:24:42.311572+0000","last_active":"2020-04-02T23:24:47.990041+0000","last_peered":"2020-04-02T23:24:47.990041+0000","last_clean":"2020-04-02T23:24:47.990041+0000","last_became_active":"2020-04-02T23:24:42.311136+0000","last_became_peered":"2020-04-02T23:24:42.311136+0000","last_unstale":"2020-04-02T23:24:47.990041+0000","last_undegraded":"2020-04-02T23:24:47.990041+0000","last_fullsized":"2020-04-02T23:24:47.990041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:48.181420+0000","last_change":"2020-04-02T23:24:48.180425+0000","last_active":"2020-04-02T23:24:48.181420+0000","last_peered":"2020-04-02T23:24:48.181420+0000","last_clean":"2020-04-02T23:24:48.181420+0000","last_became_active":"2020-04-02T23:24:48.179883+0000","last_became_peered":"2020-04-02T23:24:48.179883+0000","last_unstale":"2020-04-02T23:24:48.181420+0000","last_undegraded":"2020-04-02T23:24:48.181420+0000","last_fullsized":"2020-04-02T23:24:48.181420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983945+0000","last_change":"2020-04-02T23:24:42.311312+0000","last_active":"2020-04-02T23:24:47.983945+0000","last_peered":"2020-04-02T23:24:47.983945+0000","last_clean":"2020-04-02T23:24:47.983945+0000","last_became_active":"2020-04-02T23:24:42.310964+0000","last_became_peered":"2020-04-02T23:24:42.310964+0000","last_unstale":"2020-04-02T23:24:47.983945+0000","last_undegraded":"2020-04-02T23:24:47.983945+0000","last_fullsized":"2020-04-02T23:24:47.983945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'4","reported_seq":"15","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:24:51.023002+0000","last_change":"2020-04-02T23:24:44.974217+0000","last_active":"2020-04-02T23:24:51.023002+0000","last_peered":"2020-04-02T23:24:51.023002+0000","last_clean":"2020-04-02T23:24:51.023002+0000","last_became_active":"2020-04-02T23:24:44.973795+0000","last_became_peered":"2020-04-02T23:24:44.973795+0000","last_unstale":"2020-04-02T23:24:51.023002+0000","last_undegraded":"2020-04-02T23:24:51.023002+0000","last_fullsized":"2020-04-02T23:24:51.023002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":109351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":109917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048876,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322964,"statfs":{"total":96636764160,"available":95562715136,"internally_reserved":1073741824,"allocated":299008,"data_stored":111603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":110877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":109385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":109351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":109545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":109351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]}]}} 2020-04-02T23:24:58.679 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-04-02T23:24:58.680 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-04-02T23:24:58.680 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-04-02T23:24:58.680 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:58.694 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-04-02T23:24:58.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.844+0000 7f4486d9b700 1 Processor -- start 2020-04-02T23:24:58.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.845+0000 7f4486d9b700 1 -- start start 2020-04-02T23:24:58.853 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.845+0000 7f4486d9b700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44800ad620 0x7f44800a83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:58.853 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.845+0000 7f4486d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f44800a69b0 0x7f448013a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:58.854 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.845+0000 7f4486d9b700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44800a8a40 con 0x7f44800a6530 2020-04-02T23:24:58.854 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.845+0000 7f4486d9b700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44800a5af0 con 0x7f44800a69b0 2020-04-02T23:24:58.854 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.845+0000 7f4486d9b700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44800a5d90 con 0x7f44800ad620 2020-04-02T23:24:58.854 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.845+0000 7f447ffff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f44800a6530 0x7f4480139d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59726/0 (socket says 172.21.15.42:59726) 2020-04-02T23:24:58.854 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.845+0000 7f447ffff700 1 -- 172.21.15.42:0/3215983602 learned_addr learned my addr 172.21.15.42:0/3215983602 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:58.854 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f4485338700 1 --2- 172.21.15.42:0/3215983602 >> v2:172.21.15.84:3300/0 conn(0x7f44800a69b0 0x7f448013a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:58.854 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f4484b37700 1 --2- 172.21.15.42:0/3215983602 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44800ad620 0x7f44800a83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f447f7fe700 1 -- 172.21.15.42:0/3215983602 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459330559 0 0) 0x7f44800a8a40 con 0x7f44800a6530 2020-04-02T23:24:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f447f7fe700 1 -- 172.21.15.42:0/3215983602 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f446c003230 con 0x7f44800a6530 2020-04-02T23:24:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f447f7fe700 1 -- 172.21.15.42:0/3215983602 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 118098255 0 0) 0x7f446c003230 con 0x7f44800a6530 2020-04-02T23:24:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f447f7fe700 1 -- 172.21.15.42:0/3215983602 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44800ad620 msgr2=0x7f44800a83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f447f7fe700 1 --2- 172.21.15.42:0/3215983602 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44800ad620 0x7f44800a83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f447f7fe700 1 -- 172.21.15.42:0/3215983602 >> v2:172.21.15.84:3300/0 conn(0x7f44800a69b0 msgr2=0x7f448013a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f447f7fe700 1 --2- 172.21.15.42:0/3215983602 >> v2:172.21.15.84:3300/0 conn(0x7f44800a69b0 0x7f448013a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:58.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f447f7fe700 1 -- 172.21.15.42:0/3215983602 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44800a6230 con 0x7f44800a6530 2020-04-02T23:24:58.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f447f7fe700 1 -- 172.21.15.42:0/3215983602 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7f44740016d0 con 0x7f44800a6530 2020-04-02T23:24:58.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f447f7fe700 1 -- 172.21.15.42:0/3215983602 >> v1:172.21.15.42:6789/0 conn(0x7f44800a6530 legacy=0x7f4480139d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:58.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f447f7fe700 1 --2- 172.21.15.42:0/3215983602 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44800ad620 0x7f446c003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:58.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f447f7fe700 1 --2- 172.21.15.42:0/3215983602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f446c003b80 0x7f446c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:58.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f447f7fe700 1 --2- 172.21.15.42:0/3215983602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f446c0045c0 0x7f446c004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:58.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f447f7fe700 1 -- 172.21.15.42:0/3215983602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44800a5af0 con 0x7f446c0045c0 2020-04-02T23:24:58.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f447f7fe700 1 -- 172.21.15.42:0/3215983602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44800a5d90 con 0x7f446c003b80 2020-04-02T23:24:58.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f447f7fe700 1 -- 172.21.15.42:0/3215983602 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c005050 con 0x7f44800ad620 2020-04-02T23:24:58.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f4485338700 1 --2- 172.21.15.42:0/3215983602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f446c0045c0 0x7f446c004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:58.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f4484b37700 1 --2- 172.21.15.42:0/3215983602 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44800ad620 0x7f446c003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:58.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f447ffff700 1 --2- 172.21.15.42:0/3215983602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f446c003b80 0x7f446c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:58.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f4485338700 1 -- 172.21.15.42:0/3215983602 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44800ad620 msgr2=0x7f446c003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:58.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f4485338700 1 --2- 172.21.15.42:0/3215983602 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f44800ad620 0x7f446c003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:58.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f4485338700 1 -- 172.21.15.42:0/3215983602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f446c003b80 msgr2=0x7f446c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:58.858 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f4485338700 1 --2- 172.21.15.42:0/3215983602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f446c003b80 0x7f446c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:58.858 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f4485338700 1 -- 172.21.15.42:0/3215983602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c003230 con 0x7f446c0045c0 2020-04-02T23:24:58.858 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f4485338700 1 --2- 172.21.15.42:0/3215983602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f446c0045c0 0x7f446c004a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f44780032b0 tx=0x7f44780103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.858 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f4485338700 1 --2- 172.21.15.42:0/3215983602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f446c0045c0 0x7f446c004a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f44780032b0 tx=0x7f44780103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.858 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.846+0000 7f4485338700 1 --2- 172.21.15.42:0/3215983602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f446c0045c0 0x7f446c004a20 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f44780032b0 tx=0x7f44780103a0).ready entity=mon.0 client_cookie=d1b2ee952dd29da8 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:58.858 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.847+0000 7f4485338700 1 --2- 172.21.15.42:0/3215983602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f446c0045c0 0x7f446c004a20 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f44780032b0 tx=0x7f44780103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.858 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.847+0000 7f447f7fe700 1 -- 172.21.15.42:0/3215983602 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44780110c0 con 0x7f446c0045c0 2020-04-02T23:24:58.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.847+0000 7f4485338700 1 --2- 172.21.15.42:0/3215983602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f446c0045c0 0x7f446c004a20 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f44780032b0 tx=0x7f44780103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.847+0000 7f447f7fe700 1 -- 172.21.15.42:0/3215983602 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4478011220 con 0x7f446c0045c0 2020-04-02T23:24:58.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.847+0000 7f4485338700 1 --2- 172.21.15.42:0/3215983602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f446c0045c0 0x7f446c004a20 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f44780032b0 tx=0x7f44780103a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.847+0000 7f447f7fe700 1 -- 172.21.15.42:0/3215983602 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44780115c0 con 0x7f446c0045c0 2020-04-02T23:24:58.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.847+0000 7f4486d9b700 1 -- 172.21.15.42:0/3215983602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f446c0045c0 msgr2=0x7f446c004a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:58.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.847+0000 7f4486d9b700 1 --2- 172.21.15.42:0/3215983602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f446c0045c0 0x7f446c004a20 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f44780032b0 tx=0x7f44780103a0).stop 2020-04-02T23:24:58.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.847+0000 7f4485338700 1 -- 172.21.15.42:0/3215983602 reap_dead start 2020-04-02T23:24:58.859 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.847+0000 7f4486d9b700 1 -- 172.21.15.42:0/3215983602 shutdown_connections 2020-04-02T23:24:58.860 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.847+0000 7f4486d9b700 1 -- 172.21.15.42:0/3215983602 >> 172.21.15.42:0/3215983602 conn(0x7f4480062930 msgr2=0x7f44800acb90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:58.860 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.847+0000 7f4486d9b700 1 -- 172.21.15.42:0/3215983602 shutdown_connections 2020-04-02T23:24:58.860 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.847+0000 7f4486d9b700 1 -- 172.21.15.42:0/3215983602 wait complete. 2020-04-02T23:24:58.860 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.848+0000 7f4486d9b700 1 Processor -- start 2020-04-02T23:24:58.860 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.848+0000 7f4486d9b700 1 -- start start 2020-04-02T23:24:58.860 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f4486d9b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4480135b00 0x7f4480137890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:58.860 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f4486d9b700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4480137ec0 con 0x7f448009f0b0 2020-04-02T23:24:58.861 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f4486d9b700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4480135660 con 0x7f448009b290 2020-04-02T23:24:58.861 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f4486d9b700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4480133960 con 0x7f4480135b00 2020-04-02T23:24:58.861 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f447ffff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4480135b00 0x7f4480137890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:58.861 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f4484b37700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f448009f0b0 0x7f4480134850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59736/0 (socket says 172.21.15.42:59736) 2020-04-02T23:24:58.861 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f4484b37700 1 -- 172.21.15.42:0/1494411627 learned_addr learned my addr 172.21.15.42:0/1494411627 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:58.861 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f447ffff700 1 -- 172.21.15.42:0/1494411627 >> v1:172.21.15.84:6789/0 conn(0x7f448009b290 legacy=0x7f448009b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:58.861 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f447ffff700 1 -- 172.21.15.42:0/1494411627 >> v1:172.21.15.42:6789/0 conn(0x7f448009f0b0 legacy=0x7f4480134850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:58.861 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f447ffff700 1 -- 172.21.15.42:0/1494411627 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44800a7b20 con 0x7f4480135b00 2020-04-02T23:24:58.862 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f447dffb700 1 -- 172.21.15.42:0/1494411627 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137326927 0 0) 0x7f4480137ec0 con 0x7f448009f0b0 2020-04-02T23:24:58.863 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f447ffff700 1 --2- 172.21.15.42:0/1494411627 >> v2:172.21.15.42:3300/0 conn(0x7f4480135b00 0x7f4480137890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f44740013e0 tx=0x7f44800a63c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.863 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f447ffff700 1 --2- 172.21.15.42:0/1494411627 >> v2:172.21.15.42:3300/0 conn(0x7f4480135b00 0x7f4480137890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f44740013e0 tx=0x7f44800a63c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.863 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f447ffff700 1 --2- 172.21.15.42:0/1494411627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4480135b00 0x7f4480137890 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7f44740013e0 tx=0x7f44800a63c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:58.864 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f447ffff700 1 --2- 172.21.15.42:0/1494411627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4480135b00 0x7f4480137890 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f44740013e0 tx=0x7f44800a63c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.864 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f447ffff700 1 --2- 172.21.15.42:0/1494411627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4480135b00 0x7f4480137890 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f44740013e0 tx=0x7f44800a63c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.864 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f447dffb700 1 -- 172.21.15.42:0/1494411627 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f447400cc70 con 0x7f4480135b00 2020-04-02T23:24:58.864 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f447ffff700 1 --2- 172.21.15.42:0/1494411627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4480135b00 0x7f4480137890 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f44740013e0 tx=0x7f44800a63c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.864 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f447dffb700 1 -- 172.21.15.42:0/1494411627 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447400cdd0 con 0x7f4480135b00 2020-04-02T23:24:58.864 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f447dffb700 1 -- 172.21.15.42:0/1494411627 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4474012a70 con 0x7f4480135b00 2020-04-02T23:24:58.864 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.849+0000 7f4486d9b700 1 -- 172.21.15.42:0/1494411627 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448009be00 con 0x7f4480135b00 2020-04-02T23:24:58.865 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.850+0000 7f4486d9b700 1 -- 172.21.15.42:0/1494411627 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f448014fa20 con 0x7f4480135b00 2020-04-02T23:24:58.865 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.850+0000 7f447ffff700 1 --2- 172.21.15.42:0/1494411627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4480135b00 0x7f4480137890 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f44740013e0 tx=0x7f44800a63c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.865 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.850+0000 7f447dffb700 1 -- 172.21.15.42:0/1494411627 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f4474012ce0 con 0x7f4480135b00 2020-04-02T23:24:58.865 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.850+0000 7f447ffff700 1 --2- 172.21.15.42:0/1494411627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4480135b00 0x7f4480137890 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f44740013e0 tx=0x7f44800a63c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.865 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.851+0000 7f4486d9b700 1 -- 172.21.15.42:0/1494411627 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44800a7cb0 con 0x7f4480135b00 2020-04-02T23:24:58.865 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.851+0000 7f447dffb700 1 --2- 172.21.15.42:0/1494411627 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f446004d410 0x7f446004f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:58.865 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.851+0000 7f447dffb700 1 -- 172.21.15.42:0/1494411627 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f44740612b0 con 0x7f4480135b00 2020-04-02T23:24:58.866 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.851+0000 7f4484b37700 1 --2- 172.21.15.42:0/1494411627 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f446004d410 0x7f446004f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:58.866 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.851+0000 7f4484b37700 1 --2- 172.21.15.42:0/1494411627 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f446004d410 0x7f446004f8d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4470002ed0 tx=0x7f447000c9a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.866 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.851+0000 7f4484b37700 1 --2- 172.21.15.42:0/1494411627 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f446004d410 0x7f446004f8d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4470002ed0 tx=0x7f447000c9a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.866 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.851+0000 7f4484b37700 1 --2- 172.21.15.42:0/1494411627 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f446004d410 0x7f446004f8d0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f4470002ed0 tx=0x7f447000c9a0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:58.867 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.854+0000 7f447ffff700 1 --2- 172.21.15.42:0/1494411627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4480135b00 0x7f4480137890 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f44740013e0 tx=0x7f44800a63c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:58.867 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:58.854+0000 7f447dffb700 1 -- 172.21.15.42:0/1494411627 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f447403ca70 con 0x7f4480135b00 2020-04-02T23:24:59.054 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.052+0000 7f4486d9b700 1 -- 172.21.15.42:0/1494411627 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4480137cf0 con 0x7f4480135b00 2020-04-02T23:24:59.055 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.052+0000 7f447ffff700 1 --2- 172.21.15.42:0/1494411627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4480135b00 0x7f4480137890 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f44740013e0 tx=0x7f44800a63c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.055 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.052+0000 7f447dffb700 1 -- 172.21.15.42:0/1494411627 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f4474040090 con 0x7f4480135b00 2020-04-02T23:24:59.055 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:24:59.056 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.053+0000 7f4486d9b700 1 -- 172.21.15.42:0/1494411627 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f446004d410 msgr2=0x7f446004f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:59.056 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.053+0000 7f4486d9b700 1 --2- 172.21.15.42:0/1494411627 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f446004d410 0x7f446004f8d0 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7f4470002ed0 tx=0x7f447000c9a0).stop 2020-04-02T23:24:59.056 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.053+0000 7f4486d9b700 1 -- 172.21.15.42:0/1494411627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4480135b00 msgr2=0x7f4480137890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:59.057 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.053+0000 7f4486d9b700 1 --2- 172.21.15.42:0/1494411627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4480135b00 0x7f4480137890 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7f44740013e0 tx=0x7f44800a63c0).stop 2020-04-02T23:24:59.057 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.054+0000 7f4486d9b700 1 -- 172.21.15.42:0/1494411627 shutdown_connections 2020-04-02T23:24:59.057 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.054+0000 7f4486d9b700 1 --2- 172.21.15.42:0/1494411627 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f446004d410 0x7f446004f8d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:59.057 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.054+0000 7f4486d9b700 1 --2- 172.21.15.42:0/1494411627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4480135b00 0x7f4480137890 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:59.057 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.054+0000 7f4486d9b700 1 -- 172.21.15.42:0/1494411627 >> 172.21.15.42:0/1494411627 conn(0x7f4480062930 msgr2=0x7f4480069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:59.057 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.054+0000 7f4486d9b700 1 -- 172.21.15.42:0/1494411627 shutdown_connections 2020-04-02T23:24:59.057 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.054+0000 7f4486d9b700 1 -- 172.21.15.42:0/1494411627 wait complete. 2020-04-02T23:24:59.068 INFO:teuthology.orchestra.run.smithi042.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-04-02T23:24:59.068 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-04-02T23:24:59.069 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:59.082 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:24:59.236 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.234+0000 7faa7e6c8700 1 Processor -- start 2020-04-02T23:24:59.236 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.234+0000 7faa7e6c8700 1 -- start start 2020-04-02T23:24:59.243 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.234+0000 7faa7e6c8700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faa780a6d40 0x7faa781391c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:59.243 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.234+0000 7faa7e6c8700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7faa78139620 0x7faa78139a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:59.243 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.234+0000 7faa7e6c8700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa780a31b0 con 0x7faa780ab410 2020-04-02T23:24:59.243 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.234+0000 7faa7e6c8700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa780a49f0 con 0x7faa78139620 2020-04-02T23:24:59.244 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.234+0000 7faa7e6c8700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa7805ff40 con 0x7faa780a6d40 2020-04-02T23:24:59.244 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa7cc65700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7faa78139620 0x7faa78139a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:59.244 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa77fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7faa780ab410 0x7faa780a6630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59744/0 (socket says 172.21.15.42:59744) 2020-04-02T23:24:59.244 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa7cc65700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7faa78139620 0x7faa78139a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40324/0 (socket says 172.21.15.42:40324) 2020-04-02T23:24:59.245 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa77fff700 1 -- 172.21.15.42:0/3068604369 learned_addr learned my addr 172.21.15.42:0/3068604369 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:59.245 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa777fe700 1 --2- 172.21.15.42:0/3068604369 >> v2:172.21.15.84:3300/0 conn(0x7faa780a6d40 0x7faa781391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:59.245 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa7cc65700 1 -- 172.21.15.42:0/3068604369 >> v2:172.21.15.84:3300/0 conn(0x7faa780a6d40 msgr2=0x7faa781391c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:59.245 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa7cc65700 1 --2- 172.21.15.42:0/3068604369 >> v2:172.21.15.84:3300/0 conn(0x7faa780a6d40 0x7faa781391c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:59.245 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa76ffd700 1 -- 172.21.15.42:0/3068604369 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890260401 0 0) 0x7faa780a31b0 con 0x7faa780ab410 2020-04-02T23:24:59.246 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa7cc65700 1 -- 172.21.15.42:0/3068604369 >> v1:172.21.15.42:6789/0 conn(0x7faa780ab410 legacy=0x7faa780a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:59.246 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa7cc65700 1 -- 172.21.15.42:0/3068604369 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa780a3420 con 0x7faa78139620 2020-04-02T23:24:59.246 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa7cc65700 1 --2- 172.21.15.42:0/3068604369 >> v2:172.21.15.42:3300/0 conn(0x7faa78139620 0x7faa78139a70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faa700032b0 tx=0x7faa70007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.246 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa7cc65700 1 --2- 172.21.15.42:0/3068604369 >> v2:172.21.15.42:3300/0 conn(0x7faa78139620 0x7faa78139a70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faa700032b0 tx=0x7faa70007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.247 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa7cc65700 1 --2- 172.21.15.42:0/3068604369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa78139620 0x7faa78139a70 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7faa700032b0 tx=0x7faa70007dc0).ready entity=mon.0 client_cookie=6dd23783512e0f68 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:59.247 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa7cc65700 1 --2- 172.21.15.42:0/3068604369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa78139620 0x7faa78139a70 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7faa700032b0 tx=0x7faa70007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.247 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa76ffd700 1 -- 172.21.15.42:0/3068604369 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa70011e20 con 0x7faa78139620 2020-04-02T23:24:59.247 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa7cc65700 1 --2- 172.21.15.42:0/3068604369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa78139620 0x7faa78139a70 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7faa700032b0 tx=0x7faa70007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.247 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa7cc65700 1 --2- 172.21.15.42:0/3068604369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa78139620 0x7faa78139a70 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7faa700032b0 tx=0x7faa70007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.248 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa76ffd700 1 -- 172.21.15.42:0/3068604369 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7000a160 con 0x7faa78139620 2020-04-02T23:24:59.248 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa76ffd700 1 -- 172.21.15.42:0/3068604369 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa7000a500 con 0x7faa78139620 2020-04-02T23:24:59.248 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa7e6c8700 1 -- 172.21.15.42:0/3068604369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa78139620 msgr2=0x7faa78139a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:59.248 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.235+0000 7faa7e6c8700 1 --2- 172.21.15.42:0/3068604369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa78139620 0x7faa78139a70 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7faa700032b0 tx=0x7faa70007dc0).stop 2020-04-02T23:24:59.249 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.236+0000 7faa7e6c8700 1 -- 172.21.15.42:0/3068604369 shutdown_connections 2020-04-02T23:24:59.249 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.236+0000 7faa7e6c8700 1 --2- 172.21.15.42:0/3068604369 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa78139620 0x7faa78139a70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:59.249 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.236+0000 7faa7e6c8700 1 --2- 172.21.15.42:0/3068604369 >> v2:172.21.15.84:3300/0 conn(0x7faa780a6d40 0x7faa781391c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:59.249 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.236+0000 7faa7e6c8700 1 -- 172.21.15.42:0/3068604369 >> 172.21.15.42:0/3068604369 conn(0x7faa7805b720 msgr2=0x7faa780aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:59.250 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.236+0000 7faa7e6c8700 1 -- 172.21.15.42:0/3068604369 shutdown_connections 2020-04-02T23:24:59.250 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.236+0000 7faa7e6c8700 1 -- 172.21.15.42:0/3068604369 wait complete. 2020-04-02T23:24:59.250 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.237+0000 7faa7e6c8700 1 Processor -- start 2020-04-02T23:24:59.250 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.237+0000 7faa7e6c8700 1 -- start start 2020-04-02T23:24:59.250 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.237+0000 7faa7e6c8700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa780a6d40 0x7faa7809c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:59.251 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.237+0000 7faa7e6c8700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa780a5fb0 con 0x7faa780ab410 2020-04-02T23:24:59.251 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.237+0000 7faa7e6c8700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa780666c0 con 0x7faa78139620 2020-04-02T23:24:59.251 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.237+0000 7faa7e6c8700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa78066960 con 0x7faa780a6d40 2020-04-02T23:24:59.251 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa777fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7faa780ab410 0x7faa78065500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59752/0 (socket says 172.21.15.42:59752) 2020-04-02T23:24:59.251 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa777fe700 1 -- 172.21.15.42:0/3374625972 learned_addr learned my addr 172.21.15.42:0/3374625972 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:24:59.252 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa77fff700 1 --2- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa780a6d40 0x7faa7809c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:59.252 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa757fa700 1 -- 172.21.15.42:0/3374625972 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654926779 0 0) 0x7faa780a5fb0 con 0x7faa780ab410 2020-04-02T23:24:59.252 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa757fa700 1 -- 172.21.15.42:0/3374625972 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa58002fe0 con 0x7faa780ab410 2020-04-02T23:24:59.252 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa757fa700 1 -- 172.21.15.42:0/3374625972 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521139955 0 0) 0x7faa780666c0 con 0x7faa78139620 2020-04-02T23:24:59.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa757fa700 1 -- 172.21.15.42:0/3374625972 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa780a5fb0 con 0x7faa78139620 2020-04-02T23:24:59.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa757fa700 1 -- 172.21.15.42:0/3374625972 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3649473452 0 0) 0x7faa58002fe0 con 0x7faa780ab410 2020-04-02T23:24:59.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa77fff700 1 -- 172.21.15.42:0/3374625972 >> v1:172.21.15.84:6789/0 conn(0x7faa78139620 legacy=0x7faa78133690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:59.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa77fff700 1 -- 172.21.15.42:0/3374625972 >> v1:172.21.15.42:6789/0 conn(0x7faa780ab410 legacy=0x7faa78065500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:59.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa77fff700 1 -- 172.21.15.42:0/3374625972 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa78066c00 con 0x7faa780a6d40 2020-04-02T23:24:59.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa77fff700 1 --2- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa780a6d40 0x7faa7809c770 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faa6c0015f0 tx=0x7faa68010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa77fff700 1 --2- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa780a6d40 0x7faa7809c770 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faa6c0015f0 tx=0x7faa68010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa77fff700 1 --2- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa780a6d40 0x7faa7809c770 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7faa6c0015f0 tx=0x7faa68010900).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:59.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa77fff700 1 --2- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa780a6d40 0x7faa7809c770 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7faa6c0015f0 tx=0x7faa68010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa757fa700 1 -- 172.21.15.42:0/3374625972 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa6c001490 con 0x7faa780a6d40 2020-04-02T23:24:59.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa77fff700 1 --2- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa780a6d40 0x7faa7809c770 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7faa6c0015f0 tx=0x7faa68010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.255 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa77fff700 1 --2- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa780a6d40 0x7faa7809c770 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7faa6c0015f0 tx=0x7faa68010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.255 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa757fa700 1 -- 172.21.15.42:0/3374625972 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa68005ab0 con 0x7faa780a6d40 2020-04-02T23:24:59.255 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa7e6c8700 1 -- 172.21.15.42:0/3374625972 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa78065c10 con 0x7faa780a6d40 2020-04-02T23:24:59.255 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.238+0000 7faa757fa700 1 -- 172.21.15.42:0/3374625972 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa68005e50 con 0x7faa780a6d40 2020-04-02T23:24:59.255 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.239+0000 7faa7e6c8700 1 -- 172.21.15.42:0/3374625972 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa780a58e0 con 0x7faa780a6d40 2020-04-02T23:24:59.255 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.239+0000 7faa77fff700 1 --2- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa780a6d40 0x7faa7809c770 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7faa6c0015f0 tx=0x7faa68010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.255 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.239+0000 7faa7e6c8700 1 -- 172.21.15.42:0/3374625972 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa7805d2e0 con 0x7faa780a6d40 2020-04-02T23:24:59.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.240+0000 7faa757fa700 1 -- 172.21.15.42:0/3374625972 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7faa6800a320 con 0x7faa780a6d40 2020-04-02T23:24:59.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.240+0000 7faa77fff700 1 --2- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa780a6d40 0x7faa7809c770 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7faa6c0015f0 tx=0x7faa68010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.240+0000 7faa757fa700 1 --2- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7faa5804d950 0x7faa5804fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:59.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.240+0000 7faa757fa700 1 -- 172.21.15.42:0/3374625972 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7faa68060a30 con 0x7faa780a6d40 2020-04-02T23:24:59.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.240+0000 7faa777fe700 1 --2- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7faa5804d950 0x7faa5804fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:59.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.240+0000 7faa777fe700 1 --2- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7faa5804d950 0x7faa5804fe10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faa6c001630 tx=0x7faa6c0018b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.240+0000 7faa777fe700 1 --2- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7faa5804d950 0x7faa5804fe10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faa6c001630 tx=0x7faa6c0018b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.257 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.240+0000 7faa777fe700 1 --2- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7faa5804d950 0x7faa5804fe10 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7faa6c001630 tx=0x7faa6c0018b0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:59.257 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.244+0000 7faa77fff700 1 --2- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa780a6d40 0x7faa7809c770 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7faa6c0015f0 tx=0x7faa68010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.258 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.244+0000 7faa757fa700 1 -- 172.21.15.42:0/3374625972 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7faa6803c130 con 0x7faa780a6d40 2020-04-02T23:24:59.391 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.389+0000 7faa7e6c8700 1 -- 172.21.15.42:0/3374625972 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa78056c50 con 0x7faa780a6d40 2020-04-02T23:24:59.393 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.391+0000 7faa77fff700 1 --2- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa780a6d40 0x7faa7809c770 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7faa6c0015f0 tx=0x7faa68010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.393 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.391+0000 7faa757fa700 1 -- 172.21.15.42:0/3374625972 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16299 (secure 0 0 0) 0x7faa6803f750 con 0x7faa780a6d40 2020-04-02T23:24:59.393 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:24:59.393 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":26,"fsid":"571c521c-9ca7-4052-ba5b-7a77e18ff12c","created":"2020-04-02T23:24:23.980442+0000","modified":"2020-04-02T23:24:48.393847+0000","last_up_change":"2020-04-02T23:24:36.096260+0000","last_in_change":"2020-04-02T23:24:36.096260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:24:27.091980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:24:40.298468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:24:43.688260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:24:45.991301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"976aac36-1cf8-408b-bf56-9f0eefe43b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":24836},{"type":"v1","addr":"172.21.15.42:6801","nonce":24836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":24836},{"type":"v1","addr":"172.21.15.42:6803","nonce":24836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":24836},{"type":"v1","addr":"172.21.15.42:6807","nonce":24836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":24836},{"type":"v1","addr":"172.21.15.42:6805","nonce":24836}]},"public_addr":"172.21.15.42:6801/24836","cluster_addr":"172.21.15.42:6803/24836","heartbeat_back_addr":"172.21.15.42:6807/24836","heartbeat_front_addr":"172.21.15.42:6805/24836","state":["exists","up"]},{"osd":1,"uuid":"22c1e489-ab99-4205-ba9d-fbfc144d2a8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":24881},{"type":"v1","addr":"172.21.15.42:6809","nonce":24881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":24881},{"type":"v1","addr":"172.21.15.42:6811","nonce":24881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":24881},{"type":"v1","addr":"172.21.15.42:6815","nonce":24881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":24881},{"type":"v1","addr":"172.21.15.42:6813","nonce":24881}]},"public_addr":"172.21.15.42:6809/24881","cluster_addr":"172.21.15.42:6811/24881","heartbeat_back_addr":"172.21.15.42:6815/24881","heartbeat_front_addr":"172.21.15.42:6813/24881","state":["exists","up"]},{"osd":2,"uuid":"f0b18b09-93c0-4286-8d15-746611ba53cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":24917},{"type":"v1","addr":"172.21.15.42:6817","nonce":24917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":24917},{"type":"v1","addr":"172.21.15.42:6819","nonce":24917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":24917},{"type":"v1","addr":"172.21.15.42:6823","nonce":24917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":24917},{"type":"v1","addr":"172.21.15.42:6821","nonce":24917}]},"public_addr":"172.21.15.42:6817/24917","cluster_addr":"172.21.15.42:6819/24917","heartbeat_back_addr":"172.21.15.42:6823/24917","heartbeat_front_addr":"172.21.15.42:6821/24917","state":["exists","up"]},{"osd":3,"uuid":"989d4a69-9abe-44de-95f2-6c7cbbe07471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":24940},{"type":"v1","addr":"172.21.15.42:6825","nonce":24940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":24940},{"type":"v1","addr":"172.21.15.42:6827","nonce":24940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":24940},{"type":"v1","addr":"172.21.15.42:6831","nonce":24940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":24940},{"type":"v1","addr":"172.21.15.42:6829","nonce":24940}]},"public_addr":"172.21.15.42:6825/24940","cluster_addr":"172.21.15.42:6827/24940","heartbeat_back_addr":"172.21.15.42:6831/24940","heartbeat_front_addr":"172.21.15.42:6829/24940","state":["exists","up"]},{"osd":4,"uuid":"b1a2ce60-ae80-4f8a-97a3-4fbb1399fdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":24239},{"type":"v1","addr":"172.21.15.84:6803","nonce":24239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":24239},{"type":"v1","addr":"172.21.15.84:6805","nonce":24239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":24239},{"type":"v1","addr":"172.21.15.84:6809","nonce":24239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":24239},{"type":"v1","addr":"172.21.15.84:6807","nonce":24239}]},"public_addr":"172.21.15.84:6803/24239","cluster_addr":"172.21.15.84:6805/24239","heartbeat_back_addr":"172.21.15.84:6809/24239","heartbeat_front_addr":"172.21.15.84:6807/24239","state":["exists","up"]},{"osd":5,"uuid":"396b36e5-7226-4e8e-aa8a-749cb5cec101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":24276},{"type":"v1","addr":"172.21.15.84:6811","nonce":24276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":24276},{"type":"v1","addr":"172.21.15.84:6813","nonce":24276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":24276},{"type":"v1","addr":"172.21.15.84:6817","nonce":24276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":24276},{"type":"v1","addr":"172.21.15.84:6815","nonce":24276}]},"public_addr":"172.21.15.84:6811/24276","cluster_addr":"172.21.15.84:6813/24276","heartbeat_back_addr":"172.21.15.84:6817/24276","heartbeat_front_addr":"172.21.15.84:6815/24276","state":["exists","up"]},{"osd":6,"uuid":"884bb915-28c3-463d-8046-e2908f6e8e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":24319},{"type":"v1","addr":"172.21.15.84:6819","nonce":24319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":24319},{"type":"v1","addr":"172.21.15.84:6821","nonce":24319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":24319},{"type":"v1","addr":"172.21.15.84:6825","nonce":24319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":24319},{"type":"v1","addr":"172.21.15.84:6823","nonce":24319}]},"public_addr":"172.21.15.84:6819/24319","cluster_addr":"172.21.15.84:6821/24319","heartbeat_back_addr":"172.21.15.84:6825/24319","heartbeat_front_addr":"172.21.15.84:6823/24319","state":["exists","up"]},{"osd":7,"uuid":"70e90d1d-f081-4de5-af4b-e987c159e597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":24349},{"type":"v1","addr":"172.21.15.84:6827","nonce":24349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":24349},{"type":"v1","addr":"172.21.15.84:6829","nonce":24349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":24349},{"type":"v1","addr":"172.21.15.84:6833","nonce":24349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":24349},{"type":"v1","addr":"172.21.15.84:6831","nonce":24349}]},"public_addr":"172.21.15.84:6827/24349","cluster_addr":"172.21.15.84:6829/24349","heartbeat_back_addr":"172.21.15.84:6833/24349","heartbeat_front_addr":"172.21.15.84:6831/24349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.195657+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.241354+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.257764+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.368827+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.967296+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.991068+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.077047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.095727+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:24:59.395 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.392+0000 7faa7e6c8700 1 -- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7faa5804d950 msgr2=0x7faa5804fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:59.395 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.392+0000 7faa7e6c8700 1 --2- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7faa5804d950 0x7faa5804fe10 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7faa6c001630 tx=0x7faa6c0018b0).stop 2020-04-02T23:24:59.395 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.392+0000 7faa7e6c8700 1 -- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa780a6d40 msgr2=0x7faa7809c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:59.395 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.392+0000 7faa7e6c8700 1 --2- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa780a6d40 0x7faa7809c770 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7faa6c0015f0 tx=0x7faa68010900).stop 2020-04-02T23:24:59.395 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.392+0000 7faa7e6c8700 1 -- 172.21.15.42:0/3374625972 shutdown_connections 2020-04-02T23:24:59.395 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.392+0000 7faa7e6c8700 1 --2- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7faa5804d950 0x7faa5804fe10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:59.396 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.392+0000 7faa7e6c8700 1 --2- 172.21.15.42:0/3374625972 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7faa780a6d40 0x7faa7809c770 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:59.396 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.392+0000 7faa7e6c8700 1 -- 172.21.15.42:0/3374625972 >> 172.21.15.42:0/3374625972 conn(0x7faa7805b720 msgr2=0x7faa780aa0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:59.396 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.392+0000 7faa7e6c8700 1 -- 172.21.15.42:0/3374625972 shutdown_connections 2020-04-02T23:24:59.396 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.392+0000 7faa7e6c8700 1 -- 172.21.15.42:0/3374625972 wait complete. 2020-04-02T23:24:59.405 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:24:27.091980+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:24:40.298468+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:24:43.688260+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'26', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:24:45.991301+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'26', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-02T23:24:59.406 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:59.419 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-02T23:24:59.576 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.574+0000 7f26a5897700 1 Processor -- start 2020-04-02T23:24:59.577 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.574+0000 7f26a5897700 1 -- start start 2020-04-02T23:24:59.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.575+0000 7f26a5897700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f26a00aa1a0 0x7f26a0138720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:59.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.575+0000 7f26a5897700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f26a0138b80 0x7f26a005c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:59.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.575+0000 7f26a5897700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f26a005c4f0 0x7f26a009dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:59.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.575+0000 7f26a5897700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a00aacd0 con 0x7f26a005c4f0 2020-04-02T23:24:59.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.575+0000 7f26a5897700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a005c960 con 0x7f26a00aa1a0 2020-04-02T23:24:59.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.575+0000 7f26a5897700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a00a2980 con 0x7f26a0138b80 2020-04-02T23:24:59.584 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.575+0000 7f269f7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f26a005c4f0 0x7f26a009dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:59.584 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.575+0000 7f269f7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f26a005c4f0 0x7f26a009dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40334/0 (socket says 172.21.15.42:40334) 2020-04-02T23:24:59.584 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.575+0000 7f269f7fe700 1 -- 172.21.15.42:0/1604696051 learned_addr learned my addr 172.21.15.42:0/1604696051 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:59.584 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.575+0000 7f269effd700 1 --2- 172.21.15.42:0/1604696051 >> v2:172.21.15.84:3300/0 conn(0x7f26a00aa1a0 0x7f26a0138720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:59.584 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.575+0000 7f269e7fc700 1 --2- 172.21.15.42:0/1604696051 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f26a0138b80 0x7f26a005c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:59.584 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.575+0000 7f269f7fe700 1 -- 172.21.15.42:0/1604696051 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f26a0138b80 msgr2=0x7f26a005c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:59.585 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.575+0000 7f269f7fe700 1 --2- 172.21.15.42:0/1604696051 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f26a0138b80 0x7f26a005c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:59.585 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.575+0000 7f269f7fe700 1 -- 172.21.15.42:0/1604696051 >> v2:172.21.15.84:3300/0 conn(0x7f26a00aa1a0 msgr2=0x7f26a0138720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:59.585 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.575+0000 7f269f7fe700 1 --2- 172.21.15.42:0/1604696051 >> v2:172.21.15.84:3300/0 conn(0x7f26a00aa1a0 0x7f26a0138720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:59.585 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.575+0000 7f269f7fe700 1 -- 172.21.15.42:0/1604696051 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a013c100 con 0x7f26a005c4f0 2020-04-02T23:24:59.585 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.576+0000 7f269f7fe700 1 --2- 172.21.15.42:0/1604696051 >> v2:172.21.15.42:3300/0 conn(0x7f26a005c4f0 0x7f26a009dc40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2698002f30 tx=0x7f2698007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.585 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.576+0000 7f269f7fe700 1 --2- 172.21.15.42:0/1604696051 >> v2:172.21.15.42:3300/0 conn(0x7f26a005c4f0 0x7f26a009dc40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2698002f30 tx=0x7f2698007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.585 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.576+0000 7f269f7fe700 1 --2- 172.21.15.42:0/1604696051 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a005c4f0 0x7f26a009dc40 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7f2698002f30 tx=0x7f2698007a40).ready entity=mon.0 client_cookie=d6a52aa1909263d8 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:59.586 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.576+0000 7f269f7fe700 1 --2- 172.21.15.42:0/1604696051 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a005c4f0 0x7f26a009dc40 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7f2698002f30 tx=0x7f2698007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.586 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.576+0000 7f269f7fe700 1 --2- 172.21.15.42:0/1604696051 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a005c4f0 0x7f26a009dc40 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7f2698002f30 tx=0x7f2698007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.586 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.576+0000 7f269dffb700 1 -- 172.21.15.42:0/1604696051 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2698011720 con 0x7f26a005c4f0 2020-04-02T23:24:59.586 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.576+0000 7f269f7fe700 1 --2- 172.21.15.42:0/1604696051 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a005c4f0 0x7f26a009dc40 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7f2698002f30 tx=0x7f2698007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.586 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.576+0000 7f269dffb700 1 -- 172.21.15.42:0/1604696051 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2698011880 con 0x7f26a005c4f0 2020-04-02T23:24:59.586 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.576+0000 7f269dffb700 1 -- 172.21.15.42:0/1604696051 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2698011c60 con 0x7f26a005c4f0 2020-04-02T23:24:59.586 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.576+0000 7f26a5897700 1 -- 172.21.15.42:0/1604696051 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a005c4f0 msgr2=0x7f26a009dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:59.587 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.576+0000 7f26a5897700 1 --2- 172.21.15.42:0/1604696051 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a005c4f0 0x7f26a009dc40 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7f2698002f30 tx=0x7f2698007a40).stop 2020-04-02T23:24:59.587 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.576+0000 7f26a5897700 1 -- 172.21.15.42:0/1604696051 shutdown_connections 2020-04-02T23:24:59.587 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.576+0000 7f26a5897700 1 --2- 172.21.15.42:0/1604696051 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a005c4f0 0x7f26a009dc40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:59.587 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.576+0000 7f26a5897700 1 --2- 172.21.15.42:0/1604696051 >> v2:172.21.15.84:3300/0 conn(0x7f26a00aa1a0 0x7f26a0138720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:59.587 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.576+0000 7f26a5897700 1 --2- 172.21.15.42:0/1604696051 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f26a0138b80 0x7f26a005c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:59.587 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.576+0000 7f26a5897700 1 -- 172.21.15.42:0/1604696051 >> 172.21.15.42:0/1604696051 conn(0x7f26a00aedc0 msgr2=0x7f26a00af1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:59.587 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.576+0000 7f26a5897700 1 -- 172.21.15.42:0/1604696051 shutdown_connections 2020-04-02T23:24:59.587 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.576+0000 7f26a5897700 1 -- 172.21.15.42:0/1604696051 wait complete. 2020-04-02T23:24:59.588 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.577+0000 7f26a5897700 1 Processor -- start 2020-04-02T23:24:59.588 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.577+0000 7f26a5897700 1 -- start start 2020-04-02T23:24:59.588 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.578+0000 7f26a5897700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f26a00aa1a0 0x7f26a0132080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:59.588 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.578+0000 7f26a5897700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f26a0138b80 0x7f26a01324e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:59.588 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.578+0000 7f26a5897700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a00a4110 con 0x7f26a005c4f0 2020-04-02T23:24:59.588 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.578+0000 7f26a5897700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a00a34e0 con 0x7f26a00aa1a0 2020-04-02T23:24:59.589 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.578+0000 7f26a5897700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a01398d0 con 0x7f26a0138b80 2020-04-02T23:24:59.589 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.578+0000 7f269e7fc700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f26a00aa1a0 0x7f26a0132080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:59.589 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.578+0000 7f269e7fc700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f26a00aa1a0 0x7f26a0132080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40342/0 (socket says 172.21.15.42:40342) 2020-04-02T23:24:59.589 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.578+0000 7f269e7fc700 1 -- 172.21.15.42:0/230469111 learned_addr learned my addr 172.21.15.42:0/230469111 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:59.589 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.578+0000 7f269f7fe700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f26a0138b80 0x7f26a01324e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:59.589 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.578+0000 7f269e7fc700 1 -- 172.21.15.42:0/230469111 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f26a0138b80 msgr2=0x7f26a01324e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:59.589 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.578+0000 7f269e7fc700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f26a0138b80 0x7f26a01324e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:59.589 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.578+0000 7f269e7fc700 1 -- 172.21.15.42:0/230469111 >> v1:172.21.15.84:6789/0 conn(0x7f26a005c4f0 legacy=0x7f26a00a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:59.590 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.578+0000 7f269e7fc700 1 -- 172.21.15.42:0/230469111 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a00a1ae0 con 0x7f26a00aa1a0 2020-04-02T23:24:59.590 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.578+0000 7f269f7fe700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f26a0138b80 0x7f26a01324e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:24:59.590 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.578+0000 7f269e7fc700 1 --2- 172.21.15.42:0/230469111 >> v2:172.21.15.42:3300/0 conn(0x7f26a00aa1a0 0x7f26a0132080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26900032b0 tx=0x7f26900110a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.590 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.578+0000 7f269e7fc700 1 --2- 172.21.15.42:0/230469111 >> v2:172.21.15.42:3300/0 conn(0x7f26a00aa1a0 0x7f26a0132080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26900032b0 tx=0x7f26900110a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.590 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.578+0000 7f269e7fc700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a00aa1a0 0x7f26a0132080 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f26900032b0 tx=0x7f26900110a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:59.590 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.578+0000 7f269e7fc700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a00aa1a0 0x7f26a0132080 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f26900032b0 tx=0x7f26900110a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.590 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.579+0000 7f269e7fc700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a00aa1a0 0x7f26a0132080 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f26900032b0 tx=0x7f26900110a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.578+0000 7f268ffff700 1 -- 172.21.15.42:0/230469111 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2690005a40 con 0x7f26a00aa1a0 2020-04-02T23:24:59.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.579+0000 7f269e7fc700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a00aa1a0 0x7f26a0132080 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f26900032b0 tx=0x7f26900110a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.579+0000 7f268ffff700 1 -- 172.21.15.42:0/230469111 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2690005ba0 con 0x7f26a00aa1a0 2020-04-02T23:24:59.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.579+0000 7f26a5897700 1 -- 172.21.15.42:0/230469111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a0138810 con 0x7f26a00aa1a0 2020-04-02T23:24:59.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.579+0000 7f268ffff700 1 -- 172.21.15.42:0/230469111 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f269000a190 con 0x7f26a00aa1a0 2020-04-02T23:24:59.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.579+0000 7f26a5897700 1 -- 172.21.15.42:0/230469111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a00a2130 con 0x7f26a00aa1a0 2020-04-02T23:24:59.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.579+0000 7f269e7fc700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a00aa1a0 0x7f26a0132080 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f26900032b0 tx=0x7f26900110a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.580+0000 7f268ffff700 1 -- 172.21.15.42:0/230469111 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f2690007180 con 0x7f26a00aa1a0 2020-04-02T23:24:59.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.580+0000 7f269e7fc700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a00aa1a0 0x7f26a0132080 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f26900032b0 tx=0x7f26900110a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.580+0000 7f26a5897700 1 -- 172.21.15.42:0/230469111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a00a2f10 con 0x7f26a00aa1a0 2020-04-02T23:24:59.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.580+0000 7f268ffff700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f267c04d590 0x7f267c04fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:59.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.580+0000 7f268ffff700 1 -- 172.21.15.42:0/230469111 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f2690061300 con 0x7f26a00aa1a0 2020-04-02T23:24:59.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.580+0000 7f269effd700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f267c04d590 0x7f267c04fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:59.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.580+0000 7f269effd700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f267c04d590 0x7f267c04fa50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f26a0138660 tx=0x7f2694008d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.593 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.580+0000 7f269effd700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f267c04d590 0x7f267c04fa50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f26a0138660 tx=0x7f2694008d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.593 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.580+0000 7f269effd700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f267c04d590 0x7f267c04fa50 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f26a0138660 tx=0x7f2694008d10).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:59.593 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.583+0000 7f269e7fc700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a00aa1a0 0x7f26a0132080 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f26900032b0 tx=0x7f26900110a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.593 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.583+0000 7f268ffff700 1 -- 172.21.15.42:0/230469111 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f269003ca60 con 0x7f26a00aa1a0 2020-04-02T23:24:59.737 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.735+0000 7f26a5897700 1 -- 172.21.15.42:0/230469111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f26a0056c50 con 0x7f26a00aa1a0 2020-04-02T23:24:59.737 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.735+0000 7f269e7fc700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a00aa1a0 0x7f26a0132080 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7f26900032b0 tx=0x7f26900110a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.737 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.735+0000 7f268ffff700 1 -- 172.21.15.42:0/230469111 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2690040080 con 0x7f26a00aa1a0 2020-04-02T23:24:59.738 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2020-04-02T23:24:59.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.736+0000 7f26a5897700 1 -- 172.21.15.42:0/230469111 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f267c04d590 msgr2=0x7f267c04fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:59.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.736+0000 7f26a5897700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f267c04d590 0x7f267c04fa50 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f26a0138660 tx=0x7f2694008d10).stop 2020-04-02T23:24:59.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.736+0000 7f26a5897700 1 -- 172.21.15.42:0/230469111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a00aa1a0 msgr2=0x7f26a0132080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:59.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.736+0000 7f26a5897700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a00aa1a0 0x7f26a0132080 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7f26900032b0 tx=0x7f26900110a0).stop 2020-04-02T23:24:59.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.736+0000 7f26a5897700 1 -- 172.21.15.42:0/230469111 shutdown_connections 2020-04-02T23:24:59.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.736+0000 7f26a5897700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f267c04d590 0x7f267c04fa50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:59.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.736+0000 7f26a5897700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f26a0138b80 0x7f26a01324e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:59.740 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.736+0000 7f26a5897700 1 --2- 172.21.15.42:0/230469111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26a00aa1a0 0x7f26a0132080 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:59.740 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.736+0000 7f26a5897700 1 -- 172.21.15.42:0/230469111 >> 172.21.15.42:0/230469111 conn(0x7f26a00aedc0 msgr2=0x7f26a00abf70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:59.740 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.736+0000 7f26a5897700 1 -- 172.21.15.42:0/230469111 shutdown_connections 2020-04-02T23:24:59.740 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.737+0000 7f26a5897700 1 -- 172.21.15.42:0/230469111 wait complete. 2020-04-02T23:24:59.749 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:24:59.762 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-02T23:24:59.919 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.917+0000 7f0078907700 1 Processor -- start 2020-04-02T23:24:59.919 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.917+0000 7f0078907700 1 -- start start 2020-04-02T23:24:59.925 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.917+0000 7f0078907700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f00740aa1a0 0x7f0074138720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:59.925 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.917+0000 7f0078907700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0074141060 0x7f0074143450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:24:59.925 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f0078907700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00740a2980 con 0x7f0074138b80 2020-04-02T23:24:59.925 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f0078907700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00740aacd0 con 0x7f0074141060 2020-04-02T23:24:59.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f0078907700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007413c100 con 0x7f00740aa1a0 2020-04-02T23:24:59.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f0072d9d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0074141060 0x7f0074143450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:59.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f0072d9d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0074141060 0x7f0074143450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40348/0 (socket says 172.21.15.42:40348) 2020-04-02T23:24:59.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f0071d9b700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f0074138b80 0x7f007405c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59772/0 (socket says 172.21.15.42:59772) 2020-04-02T23:24:59.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f0072d9d700 1 -- 172.21.15.42:0/2682366414 learned_addr learned my addr 172.21.15.42:0/2682366414 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:59.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f007259c700 1 --2- 172.21.15.42:0/2682366414 >> v2:172.21.15.84:3300/0 conn(0x7f00740aa1a0 0x7f0074138720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:59.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f0072d9d700 1 -- 172.21.15.42:0/2682366414 >> v2:172.21.15.84:3300/0 conn(0x7f00740aa1a0 msgr2=0x7f0074138720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:24:59.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f0072d9d700 1 --2- 172.21.15.42:0/2682366414 >> v2:172.21.15.84:3300/0 conn(0x7f00740aa1a0 0x7f0074138720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:59.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f0072d9d700 1 -- 172.21.15.42:0/2682366414 >> v1:172.21.15.42:6789/0 conn(0x7f0074138b80 legacy=0x7f007405c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:59.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f0072d9d700 1 -- 172.21.15.42:0/2682366414 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007413c3a0 con 0x7f0074141060 2020-04-02T23:24:59.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f007159a700 1 -- 172.21.15.42:0/2682366414 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234034229 0 0) 0x7f00740a2980 con 0x7f0074138b80 2020-04-02T23:24:59.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f0072d9d700 1 --2- 172.21.15.42:0/2682366414 >> v2:172.21.15.42:3300/0 conn(0x7f0074141060 0x7f0074143450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0064002f30 tx=0x7f0064007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f0072d9d700 1 --2- 172.21.15.42:0/2682366414 >> v2:172.21.15.42:3300/0 conn(0x7f0074141060 0x7f0074143450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0064002f30 tx=0x7f0064007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f0072d9d700 1 --2- 172.21.15.42:0/2682366414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0074141060 0x7f0074143450 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f0064002f30 tx=0x7f0064007a40).ready entity=mon.0 client_cookie=368725006b00aee0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:59.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f0072d9d700 1 --2- 172.21.15.42:0/2682366414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0074141060 0x7f0074143450 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f0064002f30 tx=0x7f0064007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f007159a700 1 -- 172.21.15.42:0/2682366414 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0064011670 con 0x7f0074141060 2020-04-02T23:24:59.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f0072d9d700 1 --2- 172.21.15.42:0/2682366414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0074141060 0x7f0074143450 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f0064002f30 tx=0x7f0064007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f0072d9d700 1 --2- 172.21.15.42:0/2682366414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0074141060 0x7f0074143450 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7f0064002f30 tx=0x7f0064007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f007159a700 1 -- 172.21.15.42:0/2682366414 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00640117d0 con 0x7f0074141060 2020-04-02T23:24:59.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f007159a700 1 -- 172.21.15.42:0/2682366414 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0064011b70 con 0x7f0074141060 2020-04-02T23:24:59.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f0078907700 1 -- 172.21.15.42:0/2682366414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0074141060 msgr2=0x7f0074143450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:59.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.918+0000 7f0078907700 1 --2- 172.21.15.42:0/2682366414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0074141060 0x7f0074143450 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7f0064002f30 tx=0x7f0064007a40).stop 2020-04-02T23:24:59.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.919+0000 7f0078907700 1 -- 172.21.15.42:0/2682366414 shutdown_connections 2020-04-02T23:24:59.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.919+0000 7f0078907700 1 --2- 172.21.15.42:0/2682366414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0074141060 0x7f0074143450 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:59.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.919+0000 7f0078907700 1 --2- 172.21.15.42:0/2682366414 >> v2:172.21.15.84:3300/0 conn(0x7f00740aa1a0 0x7f0074138720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:24:59.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.919+0000 7f0078907700 1 -- 172.21.15.42:0/2682366414 >> 172.21.15.42:0/2682366414 conn(0x7f00740aedc0 msgr2=0x7f00740af1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:24:59.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.919+0000 7f0078907700 1 -- 172.21.15.42:0/2682366414 shutdown_connections 2020-04-02T23:24:59.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.919+0000 7f0078907700 1 -- 172.21.15.42:0/2682366414 wait complete. 2020-04-02T23:24:59.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.920+0000 7f0078907700 1 Processor -- start 2020-04-02T23:24:59.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.920+0000 7f0078907700 1 -- start start 2020-04-02T23:24:59.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.920+0000 7f0078907700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00740aa1a0 0x7f0074130480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:59.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.920+0000 7f0078907700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0074138b80 0x7f0074148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:59.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.920+0000 7f0078907700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0074149890 con 0x7f0074141060 2020-04-02T23:24:59.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.920+0000 7f0078907700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0074149680 con 0x7f0074138b80 2020-04-02T23:24:59.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.920+0000 7f0078907700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0074149b30 con 0x7f00740aa1a0 2020-04-02T23:24:59.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.920+0000 7f0071d9b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0074138b80 0x7f0074148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:59.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.921+0000 7f0071d9b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0074138b80 0x7f0074148dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40352/0 (socket says 172.21.15.42:40352) 2020-04-02T23:24:59.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.921+0000 7f0071d9b700 1 -- 172.21.15.42:0/346874567 learned_addr learned my addr 172.21.15.42:0/346874567 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:24:59.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.921+0000 7f007259c700 1 --2- 172.21.15.42:0/346874567 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00740aa1a0 0x7f0074130480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:59.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.921+0000 7f0071d9b700 1 -- 172.21.15.42:0/346874567 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00740aa1a0 msgr2=0x7f0074130480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:59.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.921+0000 7f0071d9b700 1 --2- 172.21.15.42:0/346874567 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00740aa1a0 0x7f0074130480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:24:59.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.921+0000 7f0071d9b700 1 -- 172.21.15.42:0/346874567 >> v1:172.21.15.84:6789/0 conn(0x7f0074141060 legacy=0x7f007412e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:24:59.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.921+0000 7f0071d9b700 1 -- 172.21.15.42:0/346874567 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007412e920 con 0x7f0074138b80 2020-04-02T23:24:59.932 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.921+0000 7f0071d9b700 1 --2- 172.21.15.42:0/346874567 >> v2:172.21.15.42:3300/0 conn(0x7f0074138b80 0x7f0074148dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0068000f00 tx=0x7f00680021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.932 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.921+0000 7f0071d9b700 1 --2- 172.21.15.42:0/346874567 >> v2:172.21.15.42:3300/0 conn(0x7f0074138b80 0x7f0074148dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0068000f00 tx=0x7f00680021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.932 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.921+0000 7f0071d9b700 1 --2- 172.21.15.42:0/346874567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0074138b80 0x7f0074148dc0 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7f0068000f00 tx=0x7f00680021b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:59.932 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.921+0000 7f0071d9b700 1 --2- 172.21.15.42:0/346874567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0074138b80 0x7f0074148dc0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f0068000f00 tx=0x7f00680021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.932 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.921+0000 7f0071d9b700 1 --2- 172.21.15.42:0/346874567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0074138b80 0x7f0074148dc0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f0068000f00 tx=0x7f00680021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.932 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.921+0000 7f0071d9b700 1 --2- 172.21.15.42:0/346874567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0074138b80 0x7f0074148dc0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f0068000f00 tx=0x7f00680021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.933 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.921+0000 7f00637fe700 1 -- 172.21.15.42:0/346874567 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f006800ccc0 con 0x7f0074138b80 2020-04-02T23:24:59.933 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.921+0000 7f00637fe700 1 -- 172.21.15.42:0/346874567 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006800ce20 con 0x7f0074138b80 2020-04-02T23:24:59.933 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.921+0000 7f00637fe700 1 -- 172.21.15.42:0/346874567 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0068004a60 con 0x7f0074138b80 2020-04-02T23:24:59.933 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.921+0000 7f0078907700 1 -- 172.21.15.42:0/346874567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0074149220 con 0x7f0074138b80 2020-04-02T23:24:59.933 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.921+0000 7f0078907700 1 -- 172.21.15.42:0/346874567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00740a6790 con 0x7f0074138b80 2020-04-02T23:24:59.933 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.922+0000 7f0071d9b700 1 --2- 172.21.15.42:0/346874567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0074138b80 0x7f0074148dc0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f0068000f00 tx=0x7f00680021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.933 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.922+0000 7f00637fe700 1 -- 172.21.15.42:0/346874567 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f0068004bc0 con 0x7f0074138b80 2020-04-02T23:24:59.934 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.922+0000 7f0071d9b700 1 --2- 172.21.15.42:0/346874567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0074138b80 0x7f0074148dc0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f0068000f00 tx=0x7f00680021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.934 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.922+0000 7f0078907700 1 -- 172.21.15.42:0/346874567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0074056c50 con 0x7f0074138b80 2020-04-02T23:24:59.934 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.922+0000 7f00637fe700 1 --2- 172.21.15.42:0/346874567 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f005004d560 0x7f005004fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:24:59.934 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.923+0000 7f00637fe700 1 -- 172.21.15.42:0/346874567 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f0068061200 con 0x7f0074138b80 2020-04-02T23:24:59.934 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.923+0000 7f007259c700 1 --2- 172.21.15.42:0/346874567 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f005004d560 0x7f005004fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:24:59.934 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.923+0000 7f007259c700 1 --2- 172.21.15.42:0/346874567 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f005004d560 0x7f005004fa20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f006c002f30 tx=0x7f006c00d8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.934 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.923+0000 7f007259c700 1 --2- 172.21.15.42:0/346874567 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f005004d560 0x7f005004fa20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f006c002f30 tx=0x7f006c00d8b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.935 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.923+0000 7f007259c700 1 --2- 172.21.15.42:0/346874567 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f005004d560 0x7f005004fa20 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f006c002f30 tx=0x7f006c00d8b0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:24:59.935 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.926+0000 7f0071d9b700 1 --2- 172.21.15.42:0/346874567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0074138b80 0x7f0074148dc0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f0068000f00 tx=0x7f00680021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:24:59.935 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:24:59.926+0000 7f00637fe700 1 -- 172.21.15.42:0/346874567 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f006803c960 con 0x7f0074138b80 2020-04-02T23:25:00.076 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.074+0000 7f0078907700 1 -- 172.21.15.42:0/346874567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f00740a8d90 con 0x7f0074138b80 2020-04-02T23:25:00.076 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.074+0000 7f0071d9b700 1 --2- 172.21.15.42:0/346874567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0074138b80 0x7f0074148dc0 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f0068000f00 tx=0x7f00680021b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.076 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.074+0000 7f00637fe700 1 -- 172.21.15.42:0/346874567 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f006803ff80 con 0x7f0074138b80 2020-04-02T23:25:00.077 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 8 2020-04-02T23:25:00.078 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.075+0000 7f0078907700 1 -- 172.21.15.42:0/346874567 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f005004d560 msgr2=0x7f005004fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:00.078 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.075+0000 7f0078907700 1 --2- 172.21.15.42:0/346874567 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f005004d560 0x7f005004fa20 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f006c002f30 tx=0x7f006c00d8b0).stop 2020-04-02T23:25:00.078 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.075+0000 7f0078907700 1 -- 172.21.15.42:0/346874567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0074138b80 msgr2=0x7f0074148dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:00.078 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.075+0000 7f0078907700 1 --2- 172.21.15.42:0/346874567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0074138b80 0x7f0074148dc0 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7f0068000f00 tx=0x7f00680021b0).stop 2020-04-02T23:25:00.078 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.075+0000 7f0078907700 1 -- 172.21.15.42:0/346874567 shutdown_connections 2020-04-02T23:25:00.079 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.075+0000 7f0078907700 1 --2- 172.21.15.42:0/346874567 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f005004d560 0x7f005004fa20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:00.079 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.075+0000 7f0078907700 1 --2- 172.21.15.42:0/346874567 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f00740aa1a0 0x7f0074130480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:00.079 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.075+0000 7f0078907700 1 --2- 172.21.15.42:0/346874567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0074138b80 0x7f0074148dc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:00.079 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.075+0000 7f0078907700 1 -- 172.21.15.42:0/346874567 >> 172.21.15.42:0/346874567 conn(0x7f00740aedc0 msgr2=0x7f00740af1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:25:00.079 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.076+0000 7f0078907700 1 -- 172.21.15.42:0/346874567 shutdown_connections 2020-04-02T23:25:00.079 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.076+0000 7f0078907700 1 -- 172.21.15.42:0/346874567 wait complete. 2020-04-02T23:25:00.088 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:00.101 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-02T23:25:00.257 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.255+0000 7f640869a700 1 Processor -- start 2020-04-02T23:25:00.257 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.255+0000 7f640869a700 1 -- start start 2020-04-02T23:25:00.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.256+0000 7f640869a700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f64001398d0 0x7f6400139d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:25:00.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.256+0000 7f640869a700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64000a31b0 con 0x7f64000ab410 2020-04-02T23:25:00.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.256+0000 7f640869a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64000a49f0 con 0x7f64000a6d40 2020-04-02T23:25:00.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.256+0000 7f640869a700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640005ff40 con 0x7f64001398d0 2020-04-02T23:25:00.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.256+0000 7f6406c37700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f64001398d0 0x7f6400139d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:00.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.256+0000 7f6406436700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f64000ab410 0x7f64000a6630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59784/0 (socket says 172.21.15.42:59784) 2020-04-02T23:25:00.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.256+0000 7f6406436700 1 -- 172.21.15.42:0/900747447 learned_addr learned my addr 172.21.15.42:0/900747447 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:25:00.261 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.256+0000 7f6406c37700 1 -- 172.21.15.42:0/900747447 >> v1:172.21.15.84:6789/0 conn(0x7f64000a6d40 legacy=0x7f64001391c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:00.261 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.256+0000 7f6406c37700 1 -- 172.21.15.42:0/900747447 >> v1:172.21.15.42:6789/0 conn(0x7f64000ab410 legacy=0x7f64000a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:00.261 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.256+0000 7f6405434700 1 -- 172.21.15.42:0/900747447 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463678687 0 0) 0x7f64000a31b0 con 0x7f64000ab410 2020-04-02T23:25:00.261 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.256+0000 7f6406c37700 1 -- 172.21.15.42:0/900747447 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64000a3420 con 0x7f64001398d0 2020-04-02T23:25:00.261 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.256+0000 7f6406c37700 1 --2- 172.21.15.42:0/900747447 >> v2:172.21.15.42:3300/0 conn(0x7f64001398d0 0x7f6400139d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f63f80032b0 tx=0x7f63f8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.261 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.256+0000 7f6406c37700 1 --2- 172.21.15.42:0/900747447 >> v2:172.21.15.42:3300/0 conn(0x7f64001398d0 0x7f6400139d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f63f80032b0 tx=0x7f63f8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.261 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.256+0000 7f6406c37700 1 --2- 172.21.15.42:0/900747447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64001398d0 0x7f6400139d20 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f63f80032b0 tx=0x7f63f8007dc0).ready entity=mon.0 client_cookie=e41a257f50c28fd2 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:00.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.257+0000 7f6406c37700 1 --2- 172.21.15.42:0/900747447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64001398d0 0x7f6400139d20 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f63f80032b0 tx=0x7f63f8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.257+0000 7f6405434700 1 -- 172.21.15.42:0/900747447 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63f800a160 con 0x7f64001398d0 2020-04-02T23:25:00.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.257+0000 7f6406c37700 1 --2- 172.21.15.42:0/900747447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64001398d0 0x7f6400139d20 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f63f80032b0 tx=0x7f63f8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.257+0000 7f6405434700 1 -- 172.21.15.42:0/900747447 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f800a2c0 con 0x7f64001398d0 2020-04-02T23:25:00.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.257+0000 7f6406c37700 1 --2- 172.21.15.42:0/900747447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64001398d0 0x7f6400139d20 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f63f80032b0 tx=0x7f63f8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.257+0000 7f6405434700 1 -- 172.21.15.42:0/900747447 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63f800a6a0 con 0x7f64001398d0 2020-04-02T23:25:00.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.257+0000 7f640869a700 1 -- 172.21.15.42:0/900747447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64001398d0 msgr2=0x7f6400139d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:00.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.257+0000 7f640869a700 1 --2- 172.21.15.42:0/900747447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64001398d0 0x7f6400139d20 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f63f80032b0 tx=0x7f63f8007dc0).stop 2020-04-02T23:25:00.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.257+0000 7f640869a700 1 -- 172.21.15.42:0/900747447 shutdown_connections 2020-04-02T23:25:00.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.257+0000 7f640869a700 1 --2- 172.21.15.42:0/900747447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64001398d0 0x7f6400139d20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:00.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.257+0000 7f640869a700 1 -- 172.21.15.42:0/900747447 >> 172.21.15.42:0/900747447 conn(0x7f640005b720 msgr2=0x7f64000aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:25:00.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.257+0000 7f640869a700 1 -- 172.21.15.42:0/900747447 shutdown_connections 2020-04-02T23:25:00.263 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.257+0000 7f640869a700 1 -- 172.21.15.42:0/900747447 wait complete. 2020-04-02T23:25:00.267 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.258+0000 7f640869a700 1 Processor -- start 2020-04-02T23:25:00.267 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.258+0000 7f640869a700 1 -- start start 2020-04-02T23:25:00.267 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f640869a700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f64000a6d40 0x7f640009b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:00.267 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f640869a700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f64000ab410 0x7f640009fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:00.267 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f640869a700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64000a0860 con 0x7f64001398d0 2020-04-02T23:25:00.267 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f640869a700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64000a05c0 con 0x7f64000a6d40 2020-04-02T23:25:00.267 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f640869a700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64000657b0 con 0x7f64000ab410 2020-04-02T23:25:00.268 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f6406436700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f64000a6d40 0x7f640009b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:00.268 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f6406c37700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f64001398d0 0x7f6400065c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59794/0 (socket says 172.21.15.42:59794) 2020-04-02T23:25:00.268 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f6406436700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f64000a6d40 0x7f640009b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40366/0 (socket says 172.21.15.42:40366) 2020-04-02T23:25:00.268 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f6406c37700 1 -- 172.21.15.42:0/324663655 learned_addr learned my addr 172.21.15.42:0/324663655 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:25:00.268 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f6405c35700 1 --2- 172.21.15.42:0/324663655 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f64000ab410 0x7f640009fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:00.268 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f63f37fe700 1 -- 172.21.15.42:0/324663655 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590661230 0 0) 0x7f64000a0860 con 0x7f64001398d0 2020-04-02T23:25:00.268 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f6406436700 1 -- 172.21.15.42:0/324663655 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f64000ab410 msgr2=0x7f640009fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:00.269 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f6406436700 1 --2- 172.21.15.42:0/324663655 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f64000ab410 0x7f640009fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:00.269 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f6406436700 1 -- 172.21.15.42:0/324663655 >> v1:172.21.15.42:6789/0 conn(0x7f64001398d0 legacy=0x7f6400065c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:00.269 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f6406436700 1 -- 172.21.15.42:0/324663655 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64000a02a0 con 0x7f64000a6d40 2020-04-02T23:25:00.269 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f6406436700 1 --2- 172.21.15.42:0/324663655 >> v2:172.21.15.42:3300/0 conn(0x7f64000a6d40 0x7f640009b970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f63fc000b80 tx=0x7f63fc010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.269 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f6406436700 1 --2- 172.21.15.42:0/324663655 >> v2:172.21.15.42:3300/0 conn(0x7f64000a6d40 0x7f640009b970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f63fc000b80 tx=0x7f63fc010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.269 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f6406436700 1 --2- 172.21.15.42:0/324663655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64000a6d40 0x7f640009b970 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f63fc000b80 tx=0x7f63fc010900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:00.269 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f6406436700 1 --2- 172.21.15.42:0/324663655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64000a6d40 0x7f640009b970 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f63fc000b80 tx=0x7f63fc010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.270 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f63f37fe700 1 -- 172.21.15.42:0/324663655 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63fc005ca0 con 0x7f64000a6d40 2020-04-02T23:25:00.270 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f6406436700 1 --2- 172.21.15.42:0/324663655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64000a6d40 0x7f640009b970 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f63fc000b80 tx=0x7f63fc010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.270 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f6406436700 1 --2- 172.21.15.42:0/324663655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64000a6d40 0x7f640009b970 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f63fc000b80 tx=0x7f63fc010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.270 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f63f37fe700 1 -- 172.21.15.42:0/324663655 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63fc005e00 con 0x7f64000a6d40 2020-04-02T23:25:00.270 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f63f37fe700 1 -- 172.21.15.42:0/324663655 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63fc0062b0 con 0x7f64000a6d40 2020-04-02T23:25:00.270 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f640869a700 1 -- 172.21.15.42:0/324663655 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6400066360 con 0x7f64000a6d40 2020-04-02T23:25:00.270 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.259+0000 7f640869a700 1 -- 172.21.15.42:0/324663655 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64001391d0 con 0x7f64000a6d40 2020-04-02T23:25:00.270 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.260+0000 7f6406436700 1 --2- 172.21.15.42:0/324663655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64000a6d40 0x7f640009b970 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f63fc000b80 tx=0x7f63fc010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.271 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.260+0000 7f640869a700 1 -- 172.21.15.42:0/324663655 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f640005d2e0 con 0x7f64000a6d40 2020-04-02T23:25:00.271 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.261+0000 7f63f37fe700 1 -- 172.21.15.42:0/324663655 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f63fc006520 con 0x7f64000a6d40 2020-04-02T23:25:00.271 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.261+0000 7f6406436700 1 --2- 172.21.15.42:0/324663655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64000a6d40 0x7f640009b970 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f63fc000b80 tx=0x7f63fc010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.271 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.261+0000 7f63f37fe700 1 --2- 172.21.15.42:0/324663655 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f63e004d530 0x7f63e004f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:00.271 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.261+0000 7f63f37fe700 1 -- 172.21.15.42:0/324663655 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f63fc060d70 con 0x7f64000a6d40 2020-04-02T23:25:00.271 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.261+0000 7f6405c35700 1 --2- 172.21.15.42:0/324663655 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f63e004d530 0x7f63e004f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:00.271 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.261+0000 7f6405c35700 1 --2- 172.21.15.42:0/324663655 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f63e004d530 0x7f63e004f9f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6400067760 tx=0x7f63f4003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.272 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.261+0000 7f6405c35700 1 --2- 172.21.15.42:0/324663655 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f63e004d530 0x7f63e004f9f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6400067760 tx=0x7f63f4003e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.272 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.261+0000 7f6405c35700 1 --2- 172.21.15.42:0/324663655 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f63e004d530 0x7f63e004f9f0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f6400067760 tx=0x7f63f4003e90).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:00.272 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.264+0000 7f6406436700 1 --2- 172.21.15.42:0/324663655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64000a6d40 0x7f640009b970 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f63fc000b80 tx=0x7f63fc010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.272 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.264+0000 7f63f37fe700 1 -- 172.21.15.42:0/324663655 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f63fc03c530 con 0x7f64000a6d40 2020-04-02T23:25:00.413 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.411+0000 7f640869a700 1 -- 172.21.15.42:0/324663655 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6400056c50 con 0x7f64000a6d40 2020-04-02T23:25:00.413 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.411+0000 7f6406436700 1 --2- 172.21.15.42:0/324663655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64000a6d40 0x7f640009b970 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f63fc000b80 tx=0x7f63fc010900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.413 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.411+0000 7f63f37fe700 1 -- 172.21.15.42:0/324663655 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+10 (secure 0 0 0) 0x7f63fc03fb50 con 0x7f64000a6d40 2020-04-02T23:25:00.414 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 8 2020-04-02T23:25:00.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.412+0000 7f640869a700 1 -- 172.21.15.42:0/324663655 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f63e004d530 msgr2=0x7f63e004f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:00.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.412+0000 7f640869a700 1 --2- 172.21.15.42:0/324663655 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f63e004d530 0x7f63e004f9f0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f6400067760 tx=0x7f63f4003e90).stop 2020-04-02T23:25:00.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.412+0000 7f640869a700 1 -- 172.21.15.42:0/324663655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64000a6d40 msgr2=0x7f640009b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:00.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.412+0000 7f640869a700 1 --2- 172.21.15.42:0/324663655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64000a6d40 0x7f640009b970 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f63fc000b80 tx=0x7f63fc010900).stop 2020-04-02T23:25:00.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.413+0000 7f640869a700 1 -- 172.21.15.42:0/324663655 shutdown_connections 2020-04-02T23:25:00.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.413+0000 7f640869a700 1 --2- 172.21.15.42:0/324663655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64000a6d40 0x7f640009b970 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:00.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.413+0000 7f640869a700 1 --2- 172.21.15.42:0/324663655 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f63e004d530 0x7f63e004f9f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:00.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.413+0000 7f640869a700 1 --2- 172.21.15.42:0/324663655 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f64000ab410 0x7f640009fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:00.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.413+0000 7f640869a700 1 -- 172.21.15.42:0/324663655 >> 172.21.15.42:0/324663655 conn(0x7f640005b720 msgr2=0x7f64000aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:25:00.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.413+0000 7f640869a700 1 -- 172.21.15.42:0/324663655 shutdown_connections 2020-04-02T23:25:00.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.413+0000 7f640869a700 1 -- 172.21.15.42:0/324663655 wait complete. 2020-04-02T23:25:00.425 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:00.438 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-02T23:25:00.594 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.592+0000 7f5256970700 1 Processor -- start 2020-04-02T23:25:00.594 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.592+0000 7f5256970700 1 -- start start 2020-04-02T23:25:00.597 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.592+0000 7f5256970700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52500ab410 0x7f52500a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:25:00.597 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.592+0000 7f5256970700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f52500a3d30 0x7f52500a21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:25:00.597 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.592+0000 7f5256970700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f525005ff40 con 0x7f52500a5250 2020-04-02T23:25:00.597 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.592+0000 7f5256970700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52500a4200 con 0x7f52500a3d30 2020-04-02T23:25:00.597 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.592+0000 7f5256970700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52500a44a0 con 0x7f52500ab410 2020-04-02T23:25:00.598 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.593+0000 7f5254f0d700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f52500a5250 0x7f52500a56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59802/0 (socket says 172.21.15.42:59802) 2020-04-02T23:25:00.598 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.593+0000 7f5254f0d700 1 -- 172.21.15.42:0/1111968624 learned_addr learned my addr 172.21.15.42:0/1111968624 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:25:00.598 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.593+0000 7f524ffff700 1 --2- 172.21.15.42:0/1111968624 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52500ab410 0x7f52500a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:00.598 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.593+0000 7f5247fff700 1 --2- 172.21.15.42:0/1111968624 >> v2:172.21.15.84:3300/0 conn(0x7f52500a3d30 0x7f52500a21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:00.598 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.593+0000 7f524f7fe700 1 -- 172.21.15.42:0/1111968624 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759976737 0 0) 0x7f525005ff40 con 0x7f52500a5250 2020-04-02T23:25:00.598 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.593+0000 7f524f7fe700 1 -- 172.21.15.42:0/1111968624 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5230003230 con 0x7f52500a5250 2020-04-02T23:25:00.598 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.593+0000 7f524ffff700 1 -- 172.21.15.42:0/1111968624 >> v2:172.21.15.84:3300/0 conn(0x7f52500a3d30 msgr2=0x7f52500a21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:25:00.599 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.593+0000 7f524ffff700 1 --2- 172.21.15.42:0/1111968624 >> v2:172.21.15.84:3300/0 conn(0x7f52500a3d30 0x7f52500a21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:25:00.599 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.593+0000 7f524f7fe700 1 -- 172.21.15.42:0/1111968624 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 658600304 0 0) 0x7f5230003230 con 0x7f52500a5250 2020-04-02T23:25:00.599 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.593+0000 7f524ffff700 1 -- 172.21.15.42:0/1111968624 >> v1:172.21.15.42:6789/0 conn(0x7f52500a5250 legacy=0x7f52500a56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:00.599 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.593+0000 7f524ffff700 1 -- 172.21.15.42:0/1111968624 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52500601a0 con 0x7f52500ab410 2020-04-02T23:25:00.599 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.593+0000 7f524ffff700 1 --2- 172.21.15.42:0/1111968624 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52500ab410 0x7f52500a1d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5248001bf0 tx=0x7f5240007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.599 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.593+0000 7f524ffff700 1 --2- 172.21.15.42:0/1111968624 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52500ab410 0x7f52500a1d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5248001bf0 tx=0x7f5240007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.599 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.593+0000 7f524ffff700 1 --2- 172.21.15.42:0/1111968624 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52500ab410 0x7f52500a1d60 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f5248001bf0 tx=0x7f5240007a40).ready entity=mon.2 client_cookie=4a4b1e0f6a19f1c9 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:00.599 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.593+0000 7f524ffff700 1 --2- 172.21.15.42:0/1111968624 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52500ab410 0x7f52500a1d60 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f5248001bf0 tx=0x7f5240007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.600 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.593+0000 7f524f7fe700 1 -- 172.21.15.42:0/1111968624 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5248001a50 con 0x7f52500ab410 2020-04-02T23:25:00.600 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.593+0000 7f524ffff700 1 --2- 172.21.15.42:0/1111968624 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52500ab410 0x7f52500a1d60 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f5248001bf0 tx=0x7f5240007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.600 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.593+0000 7f524ffff700 1 --2- 172.21.15.42:0/1111968624 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52500ab410 0x7f52500a1d60 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7f5248001bf0 tx=0x7f5240007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.600 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.593+0000 7f524f7fe700 1 -- 172.21.15.42:0/1111968624 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5240008b40 con 0x7f52500ab410 2020-04-02T23:25:00.600 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.594+0000 7f524f7fe700 1 -- 172.21.15.42:0/1111968624 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5240008ea0 con 0x7f52500ab410 2020-04-02T23:25:00.600 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.594+0000 7f5256970700 1 -- 172.21.15.42:0/1111968624 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52500ab410 msgr2=0x7f52500a1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:00.600 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.594+0000 7f5256970700 1 --2- 172.21.15.42:0/1111968624 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52500ab410 0x7f52500a1d60 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7f5248001bf0 tx=0x7f5240007a40).stop 2020-04-02T23:25:00.601 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.594+0000 7f5256970700 1 -- 172.21.15.42:0/1111968624 shutdown_connections 2020-04-02T23:25:00.601 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.594+0000 7f5256970700 1 --2- 172.21.15.42:0/1111968624 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f52500ab410 0x7f52500a1d60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:00.601 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.594+0000 7f5256970700 1 --2- 172.21.15.42:0/1111968624 >> v2:172.21.15.84:3300/0 conn(0x7f52500a3d30 0x7f52500a21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:25:00.601 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.594+0000 7f5256970700 1 -- 172.21.15.42:0/1111968624 >> 172.21.15.42:0/1111968624 conn(0x7f525005b720 msgr2=0x7f52500aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:25:00.601 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.594+0000 7f5256970700 1 -- 172.21.15.42:0/1111968624 shutdown_connections 2020-04-02T23:25:00.601 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.594+0000 7f5256970700 1 -- 172.21.15.42:0/1111968624 wait complete. 2020-04-02T23:25:00.601 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.595+0000 7f5256970700 1 Processor -- start 2020-04-02T23:25:00.601 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.595+0000 7f5256970700 1 -- start start 2020-04-02T23:25:00.605 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f5256970700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f52500a3d30 0x7f525009c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:00.605 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f5256970700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5250141210 con 0x7f52500ab410 2020-04-02T23:25:00.605 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f5256970700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52500a0a60 con 0x7f52500a5250 2020-04-02T23:25:00.605 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f5256970700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52500a0d00 con 0x7f52500a3d30 2020-04-02T23:25:00.605 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f5254f0d700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f52500ab410 0x7f525014a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59808/0 (socket says 172.21.15.42:59808) 2020-04-02T23:25:00.605 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f5254f0d700 1 -- 172.21.15.42:0/2403142663 learned_addr learned my addr 172.21.15.42:0/2403142663 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:25:00.605 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f524ffff700 1 --2- 172.21.15.42:0/2403142663 >> v2:172.21.15.84:3300/0 conn(0x7f52500a3d30 0x7f525009c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:00.606 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f524dffb700 1 -- 172.21.15.42:0/2403142663 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922390070 0 0) 0x7f5250141210 con 0x7f52500ab410 2020-04-02T23:25:00.606 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f524dffb700 1 -- 172.21.15.42:0/2403142663 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5234002fe0 con 0x7f52500ab410 2020-04-02T23:25:00.606 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f524ffff700 1 -- 172.21.15.42:0/2403142663 >> v1:172.21.15.84:6789/0 conn(0x7f52500a5250 legacy=0x7f525009db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:00.606 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f524dffb700 1 -- 172.21.15.42:0/2403142663 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917516474 0 0) 0x7f52500a0a60 con 0x7f52500a5250 2020-04-02T23:25:00.606 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f524ffff700 1 -- 172.21.15.42:0/2403142663 >> v1:172.21.15.42:6789/0 conn(0x7f52500ab410 legacy=0x7f525014a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:00.606 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f524ffff700 1 -- 172.21.15.42:0/2403142663 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525009e280 con 0x7f52500a3d30 2020-04-02T23:25:00.606 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f524ffff700 1 --2- 172.21.15.42:0/2403142663 >> v2:172.21.15.84:3300/0 conn(0x7f52500a3d30 0x7f525009c040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52500a0fd0 tx=0x7f5240007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.607 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f524ffff700 1 --2- 172.21.15.42:0/2403142663 >> v2:172.21.15.84:3300/0 conn(0x7f52500a3d30 0x7f525009c040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52500a0fd0 tx=0x7f5240007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.607 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f524ffff700 1 --2- 172.21.15.42:0/2403142663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500a3d30 0x7f525009c040 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f52500a0fd0 tx=0x7f5240007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:00.607 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f524ffff700 1 --2- 172.21.15.42:0/2403142663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500a3d30 0x7f525009c040 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f52500a0fd0 tx=0x7f5240007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.607 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f524dffb700 1 -- 172.21.15.42:0/2403142663 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5240007350 con 0x7f52500a3d30 2020-04-02T23:25:00.607 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f524ffff700 1 --2- 172.21.15.42:0/2403142663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500a3d30 0x7f525009c040 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f52500a0fd0 tx=0x7f5240007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.607 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f524ffff700 1 --2- 172.21.15.42:0/2403142663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500a3d30 0x7f525009c040 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f52500a0fd0 tx=0x7f5240007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.607 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f524dffb700 1 -- 172.21.15.42:0/2403142663 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52400074b0 con 0x7f52500a3d30 2020-04-02T23:25:00.607 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f524dffb700 1 -- 172.21.15.42:0/2403142663 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5240005ac0 con 0x7f52500a3d30 2020-04-02T23:25:00.608 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.596+0000 7f5256970700 1 -- 172.21.15.42:0/2403142663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525009c4a0 con 0x7f52500a3d30 2020-04-02T23:25:00.608 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.597+0000 7f5256970700 1 -- 172.21.15.42:0/2403142663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525014af30 con 0x7f52500a3d30 2020-04-02T23:25:00.608 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.597+0000 7f524ffff700 1 --2- 172.21.15.42:0/2403142663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500a3d30 0x7f525009c040 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f52500a0fd0 tx=0x7f5240007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.608 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.597+0000 7f5256970700 1 -- 172.21.15.42:0/2403142663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525005d2e0 con 0x7f52500a3d30 2020-04-02T23:25:00.608 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.598+0000 7f524dffb700 1 -- 172.21.15.42:0/2403142663 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f5240005cf0 con 0x7f52500a3d30 2020-04-02T23:25:00.608 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.598+0000 7f524ffff700 1 --2- 172.21.15.42:0/2403142663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500a3d30 0x7f525009c040 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f52500a0fd0 tx=0x7f5240007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.608 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.598+0000 7f524dffb700 1 --2- 172.21.15.42:0/2403142663 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f523404d880 0x7f523404fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:00.609 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.598+0000 7f524dffb700 1 -- 172.21.15.42:0/2403142663 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f52400615c0 con 0x7f52500a3d30 2020-04-02T23:25:00.609 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.598+0000 7f5247fff700 1 --2- 172.21.15.42:0/2403142663 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f523404d880 0x7f523404fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:00.609 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.598+0000 7f5247fff700 1 --2- 172.21.15.42:0/2403142663 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f523404d880 0x7f523404fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5238002ed0 tx=0x7f5238009900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.609 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.598+0000 7f5247fff700 1 --2- 172.21.15.42:0/2403142663 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f523404d880 0x7f523404fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5238002ed0 tx=0x7f5238009900).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.609 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.598+0000 7f5247fff700 1 --2- 172.21.15.42:0/2403142663 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f523404d880 0x7f523404fd40 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f5238002ed0 tx=0x7f5238009900).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:00.609 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.602+0000 7f524ffff700 1 --2- 172.21.15.42:0/2403142663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500a3d30 0x7f525009c040 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f52500a0fd0 tx=0x7f5240007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.609 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.602+0000 7f524dffb700 1 -- 172.21.15.42:0/2403142663 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f524003cde0 con 0x7f52500a3d30 2020-04-02T23:25:00.752 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.750+0000 7f5256970700 1 -- 172.21.15.42:0/2403142663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5250056c50 con 0x7f52500a3d30 2020-04-02T23:25:00.752 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.750+0000 7f524ffff700 1 --2- 172.21.15.42:0/2403142663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500a3d30 0x7f525009c040 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f52500a0fd0 tx=0x7f5240007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.753 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.750+0000 7f524dffb700 1 -- 172.21.15.42:0/2403142663 <== mon.1 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5240040400 con 0x7f52500a3d30 2020-04-02T23:25:00.753 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 8 2020-04-02T23:25:00.754 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.752+0000 7f5256970700 1 -- 172.21.15.42:0/2403142663 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f523404d880 msgr2=0x7f523404fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:00.754 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.752+0000 7f5256970700 1 --2- 172.21.15.42:0/2403142663 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f523404d880 0x7f523404fd40 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f5238002ed0 tx=0x7f5238009900).stop 2020-04-02T23:25:00.754 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.752+0000 7f5256970700 1 -- 172.21.15.42:0/2403142663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500a3d30 msgr2=0x7f525009c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:00.755 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.752+0000 7f5256970700 1 --2- 172.21.15.42:0/2403142663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500a3d30 0x7f525009c040 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f52500a0fd0 tx=0x7f5240007a40).stop 2020-04-02T23:25:00.755 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.752+0000 7f5256970700 1 -- 172.21.15.42:0/2403142663 shutdown_connections 2020-04-02T23:25:00.755 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.752+0000 7f5256970700 1 --2- 172.21.15.42:0/2403142663 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f523404d880 0x7f523404fd40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:00.755 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.752+0000 7f5256970700 1 --2- 172.21.15.42:0/2403142663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52500a3d30 0x7f525009c040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:00.755 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.752+0000 7f5256970700 1 -- 172.21.15.42:0/2403142663 >> 172.21.15.42:0/2403142663 conn(0x7f525005b720 msgr2=0x7f52500a6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:25:00.755 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.752+0000 7f5256970700 1 -- 172.21.15.42:0/2403142663 shutdown_connections 2020-04-02T23:25:00.755 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.752+0000 7f5256970700 1 -- 172.21.15.42:0/2403142663 wait complete. 2020-04-02T23:25:00.764 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:00.778 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:25:00.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.929+0000 7fe332d4a700 1 Processor -- start 2020-04-02T23:25:00.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.929+0000 7fe332d4a700 1 -- start start 2020-04-02T23:25:00.936 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.929+0000 7fe332d4a700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe32c0ab410 0x7fe32c0a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:25:00.936 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.929+0000 7fe332d4a700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe32c0a6a90 0x7fe32c0a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:25:00.936 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.929+0000 7fe332d4a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32c0a31b0 con 0x7fe32c0a2130 2020-04-02T23:25:00.937 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.929+0000 7fe332d4a700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32c0a49f0 con 0x7fe32c0ab410 2020-04-02T23:25:00.937 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.929+0000 7fe332d4a700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c05ff40 con 0x7fe32c0a6a90 2020-04-02T23:25:00.937 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.930+0000 7fe330ae6700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe32c0ab410 0x7fe32c0a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:00.937 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.930+0000 7fe330ae6700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe32c0ab410 0x7fe32c0a6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40388/0 (socket says 172.21.15.42:40388) 2020-04-02T23:25:00.937 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.930+0000 7fe330ae6700 1 -- 172.21.15.42:0/3892169844 learned_addr learned my addr 172.21.15.42:0/3892169844 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:25:00.937 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.930+0000 7fe32bfff700 1 --2- 172.21.15.42:0/3892169844 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe32c0a6a90 0x7fe32c0a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:00.937 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.930+0000 7fe330ae6700 1 -- 172.21.15.42:0/3892169844 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe32c0a6a90 msgr2=0x7fe32c0a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:25:00.938 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.930+0000 7fe330ae6700 1 --2- 172.21.15.42:0/3892169844 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe32c0a6a90 0x7fe32c0a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:25:00.938 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.930+0000 7fe330ae6700 1 -- 172.21.15.42:0/3892169844 >> v1:172.21.15.84:6789/0 conn(0x7fe32c0a2130 legacy=0x7fe32c0a2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:00.938 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.930+0000 7fe330ae6700 1 -- 172.21.15.42:0/3892169844 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c0a3420 con 0x7fe32c0ab410 2020-04-02T23:25:00.938 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.930+0000 7fe32b7fe700 1 -- 172.21.15.42:0/3892169844 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799747236 0 0) 0x7fe32c0a31b0 con 0x7fe32c0a2130 2020-04-02T23:25:00.938 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.930+0000 7fe330ae6700 1 --2- 172.21.15.42:0/3892169844 >> v2:172.21.15.42:3300/0 conn(0x7fe32c0ab410 0x7fe32c0a6630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe31c002f30 tx=0x7fe31c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.938 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.930+0000 7fe330ae6700 1 --2- 172.21.15.42:0/3892169844 >> v2:172.21.15.42:3300/0 conn(0x7fe32c0ab410 0x7fe32c0a6630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe31c002f30 tx=0x7fe31c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.938 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.930+0000 7fe330ae6700 1 --2- 172.21.15.42:0/3892169844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe32c0ab410 0x7fe32c0a6630 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7fe31c002f30 tx=0x7fe31c007a40).ready entity=mon.0 client_cookie=9d963b566dccd7b1 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:00.938 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.930+0000 7fe330ae6700 1 --2- 172.21.15.42:0/3892169844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe32c0ab410 0x7fe32c0a6630 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fe31c002f30 tx=0x7fe31c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.939 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.930+0000 7fe330ae6700 1 --2- 172.21.15.42:0/3892169844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe32c0ab410 0x7fe32c0a6630 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fe31c002f30 tx=0x7fe31c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.939 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.930+0000 7fe32b7fe700 1 -- 172.21.15.42:0/3892169844 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe31c011670 con 0x7fe32c0ab410 2020-04-02T23:25:00.939 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.930+0000 7fe330ae6700 1 --2- 172.21.15.42:0/3892169844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe32c0ab410 0x7fe32c0a6630 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7fe31c002f30 tx=0x7fe31c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.939 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.930+0000 7fe32b7fe700 1 -- 172.21.15.42:0/3892169844 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c0117d0 con 0x7fe32c0ab410 2020-04-02T23:25:00.939 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.930+0000 7fe32b7fe700 1 -- 172.21.15.42:0/3892169844 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe31c011bb0 con 0x7fe32c0ab410 2020-04-02T23:25:00.939 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.930+0000 7fe332d4a700 1 -- 172.21.15.42:0/3892169844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe32c0ab410 msgr2=0x7fe32c0a6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:00.939 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.930+0000 7fe332d4a700 1 --2- 172.21.15.42:0/3892169844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe32c0ab410 0x7fe32c0a6630 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7fe31c002f30 tx=0x7fe31c007a40).stop 2020-04-02T23:25:00.940 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.931+0000 7fe332d4a700 1 -- 172.21.15.42:0/3892169844 shutdown_connections 2020-04-02T23:25:00.940 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.931+0000 7fe332d4a700 1 --2- 172.21.15.42:0/3892169844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe32c0ab410 0x7fe32c0a6630 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:00.940 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.931+0000 7fe332d4a700 1 --2- 172.21.15.42:0/3892169844 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe32c0a6a90 0x7fe32c0a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:25:00.940 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.931+0000 7fe332d4a700 1 -- 172.21.15.42:0/3892169844 >> 172.21.15.42:0/3892169844 conn(0x7fe32c05b720 msgr2=0x7fe32c0aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:25:00.940 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.931+0000 7fe332d4a700 1 -- 172.21.15.42:0/3892169844 shutdown_connections 2020-04-02T23:25:00.940 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.931+0000 7fe332d4a700 1 -- 172.21.15.42:0/3892169844 wait complete. 2020-04-02T23:25:00.940 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.932+0000 7fe332d4a700 1 Processor -- start 2020-04-02T23:25:00.940 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.932+0000 7fe332d4a700 1 -- start start 2020-04-02T23:25:00.941 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.932+0000 7fe332d4a700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe32c0a2130 0x7fe32c062850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:00.941 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.932+0000 7fe332d4a700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe32c0ab410 0x7fe32c065da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:00.941 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.932+0000 7fe332d4a700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32c064470 con 0x7fe32c0a6a90 2020-04-02T23:25:00.941 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.932+0000 7fe332d4a700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32c062d60 con 0x7fe32c0ab410 2020-04-02T23:25:00.941 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.932+0000 7fe332d4a700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c063000 con 0x7fe32c0a2130 2020-04-02T23:25:00.941 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.933+0000 7fe3312e7700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe32c0ab410 0x7fe32c065da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:00.941 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.933+0000 7fe3312e7700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe32c0ab410 0x7fe32c065da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40396/0 (socket says 172.21.15.42:40396) 2020-04-02T23:25:00.942 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.933+0000 7fe3312e7700 1 -- 172.21.15.42:0/4131172407 learned_addr learned my addr 172.21.15.42:0/4131172407 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:25:00.942 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.933+0000 7fe330ae6700 1 --2- 172.21.15.42:0/4131172407 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe32c0a2130 0x7fe32c062850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:00.942 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.933+0000 7fe3312e7700 1 -- 172.21.15.42:0/4131172407 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe32c0a2130 msgr2=0x7fe32c062850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:00.942 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.933+0000 7fe3312e7700 1 --2- 172.21.15.42:0/4131172407 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe32c0a2130 0x7fe32c062850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:00.942 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.933+0000 7fe3312e7700 1 -- 172.21.15.42:0/4131172407 >> v1:172.21.15.84:6789/0 conn(0x7fe32c0a6a90 legacy=0x7fe32c063d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:00.942 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.933+0000 7fe3312e7700 1 -- 172.21.15.42:0/4131172407 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c0a0ad0 con 0x7fe32c0ab410 2020-04-02T23:25:00.942 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.933+0000 7fe3312e7700 1 --2- 172.21.15.42:0/4131172407 >> v2:172.21.15.42:3300/0 conn(0x7fe32c0ab410 0x7fe32c065da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe324001210 tx=0x7fe324010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.943 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.933+0000 7fe3312e7700 1 --2- 172.21.15.42:0/4131172407 >> v2:172.21.15.42:3300/0 conn(0x7fe32c0ab410 0x7fe32c065da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe324001210 tx=0x7fe324010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.943 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.933+0000 7fe3312e7700 1 --2- 172.21.15.42:0/4131172407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe32c0ab410 0x7fe32c065da0 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7fe324001210 tx=0x7fe324010d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:00.943 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.933+0000 7fe3312e7700 1 --2- 172.21.15.42:0/4131172407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe32c0ab410 0x7fe32c065da0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7fe324001210 tx=0x7fe324010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.943 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.933+0000 7fe3312e7700 1 --2- 172.21.15.42:0/4131172407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe32c0ab410 0x7fe32c065da0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7fe324001210 tx=0x7fe324010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.943 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.933+0000 7fe329ffb700 1 -- 172.21.15.42:0/4131172407 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3240101c0 con 0x7fe32c0ab410 2020-04-02T23:25:00.943 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.933+0000 7fe3312e7700 1 --2- 172.21.15.42:0/4131172407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe32c0ab410 0x7fe32c065da0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7fe324001210 tx=0x7fe324010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.943 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.933+0000 7fe329ffb700 1 -- 172.21.15.42:0/4131172407 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe324010320 con 0x7fe32c0ab410 2020-04-02T23:25:00.943 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.933+0000 7fe329ffb700 1 -- 172.21.15.42:0/4131172407 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe324010740 con 0x7fe32c0ab410 2020-04-02T23:25:00.944 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.933+0000 7fe332d4a700 1 -- 172.21.15.42:0/4131172407 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32c0662a0 con 0x7fe32c0ab410 2020-04-02T23:25:00.944 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.933+0000 7fe332d4a700 1 -- 172.21.15.42:0/4131172407 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32c09dee0 con 0x7fe32c0ab410 2020-04-02T23:25:00.944 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.934+0000 7fe3312e7700 1 --2- 172.21.15.42:0/4131172407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe32c0ab410 0x7fe32c065da0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7fe324001210 tx=0x7fe324010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.944 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.934+0000 7fe332d4a700 1 -- 172.21.15.42:0/4131172407 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32c05d2e0 con 0x7fe32c0ab410 2020-04-02T23:25:00.944 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.934+0000 7fe329ffb700 1 -- 172.21.15.42:0/4131172407 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fe324006860 con 0x7fe32c0ab410 2020-04-02T23:25:00.944 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.934+0000 7fe3312e7700 1 --2- 172.21.15.42:0/4131172407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe32c0ab410 0x7fe32c065da0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7fe324001210 tx=0x7fe324010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.945 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.935+0000 7fe329ffb700 1 --2- 172.21.15.42:0/4131172407 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe30c04d590 0x7fe30c04fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:00.946 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.935+0000 7fe329ffb700 1 -- 172.21.15.42:0/4131172407 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe324061010 con 0x7fe32c0ab410 2020-04-02T23:25:00.946 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.935+0000 7fe330ae6700 1 --2- 172.21.15.42:0/4131172407 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe30c04d590 0x7fe30c04fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:00.946 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.935+0000 7fe330ae6700 1 --2- 172.21.15.42:0/4131172407 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe30c04d590 0x7fe30c04fa50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe31c002f30 tx=0x7fe31c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.946 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.935+0000 7fe330ae6700 1 --2- 172.21.15.42:0/4131172407 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe30c04d590 0x7fe30c04fa50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe31c002f30 tx=0x7fe31c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.946 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.935+0000 7fe330ae6700 1 --2- 172.21.15.42:0/4131172407 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe30c04d590 0x7fe30c04fa50 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7fe31c002f30 tx=0x7fe31c007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:00.946 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.938+0000 7fe3312e7700 1 --2- 172.21.15.42:0/4131172407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe32c0ab410 0x7fe32c065da0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7fe324001210 tx=0x7fe324010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:00.946 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:00.938+0000 7fe329ffb700 1 -- 172.21.15.42:0/4131172407 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fe32403c7d0 con 0x7fe32c0ab410 2020-04-02T23:25:01.141 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.132+0000 7fe332d4a700 1 -- 172.21.15.42:0/4131172407 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe32c063a70 con 0x7fe32c0ab410 2020-04-02T23:25:01.141 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.132+0000 7fe3312e7700 1 --2- 172.21.15.42:0/4131172407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe32c0ab410 0x7fe32c065da0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7fe324001210 tx=0x7fe324010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:01.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.132+0000 7fe329ffb700 1 -- 172.21.15.42:0/4131172407 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2128 (secure 0 0 0) 0x7fe32403fdf0 con 0x7fe32c0ab410 2020-04-02T23:25:01.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.134+0000 7fe332d4a700 1 -- 172.21.15.42:0/4131172407 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe30c04d590 msgr2=0x7fe30c04fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:01.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.134+0000 7fe332d4a700 1 --2- 172.21.15.42:0/4131172407 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe30c04d590 0x7fe30c04fa50 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7fe31c002f30 tx=0x7fe31c007a40).stop 2020-04-02T23:25:01.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.134+0000 7fe332d4a700 1 -- 172.21.15.42:0/4131172407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe32c0ab410 msgr2=0x7fe32c065da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:01.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.134+0000 7fe332d4a700 1 --2- 172.21.15.42:0/4131172407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe32c0ab410 0x7fe32c065da0 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7fe324001210 tx=0x7fe324010d90).stop 2020-04-02T23:25:01.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.134+0000 7fe332d4a700 1 -- 172.21.15.42:0/4131172407 shutdown_connections 2020-04-02T23:25:01.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.134+0000 7fe332d4a700 1 --2- 172.21.15.42:0/4131172407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe32c0ab410 0x7fe32c065da0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:01.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.134+0000 7fe332d4a700 1 --2- 172.21.15.42:0/4131172407 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fe30c04d590 0x7fe30c04fa50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:01.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.134+0000 7fe332d4a700 1 --2- 172.21.15.42:0/4131172407 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fe32c0a2130 0x7fe32c062850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:01.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.134+0000 7fe332d4a700 1 -- 172.21.15.42:0/4131172407 >> 172.21.15.42:0/4131172407 conn(0x7fe32c05b720 msgr2=0x7fe32c0aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:25:01.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.134+0000 7fe332d4a700 1 -- 172.21.15.42:0/4131172407 shutdown_connections 2020-04-02T23:25:01.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.134+0000 7fe332d4a700 1 -- 172.21.15.42:0/4131172407 wait complete. 2020-04-02T23:25:01.143 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 6 2020-04-02T23:25:01.143 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:25:01.144 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4350,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3351276327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3351276327},{"type":"v1","addr":"172.21.15.84:6835","nonce":3351276327}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-02T23:24:48.394016+0000","modified":"2020-04-02T23:24:52.010614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.42:6833/81442033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":81442033},{"type":"v1","addr":"172.21.15.42:6833","nonce":81442033}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:25:01.348 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4359}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 3, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [4], u'info': {u'gid_4359': {u'export_targets': [], u'name': u'a', u'incarnation': 5, u'state_seq': 2, u'state': u'up:active', u'gid': 4359, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 81442033, u'type': u'v2', u'addr': u'172.21.15.42:6832'}, {u'nonce': 81442033, u'type': u'v1', u'addr': u'172.21.15.42:6833'}]}, u'addr': u'172.21.15.42:6833/81442033'}}, u'fs_name': u'cephfs', u'created': u'2020-04-02T23:24:48.394016+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-02T23:24:52.010614+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-02T23:25:01.348 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-02T23:25:01.348 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:01.363 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-02T23:25:01.530 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2020-04-02T23:25:01.530 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "571c521c-9ca7-4052-ba5b-7a77e18ff12c", 2020-04-02T23:25:01.531 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2020-04-02T23:25:01.531 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4359, 2020-04-02T23:25:01.531 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2020-04-02T23:25:01.531 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2020-04-02T23:25:01.531 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 10.517702919, 2020-04-02T23:25:01.531 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 6, 2020-04-02T23:25:01.531 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 26, 2020-04-02T23:25:01.532 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 26, 2020-04-02T23:25:01.532 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 10.580160826 2020-04-02T23:25:01.532 INFO:teuthology.orchestra.run.smithi042.stdout:} 2020-04-02T23:25:01.539 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "571c521c-9ca7-4052-ba5b-7a77e18ff12c", "whoami": 0, "id": 4359, "want_state": "up:active", "state": "up:active", "rank_uptime": 10.517702919, "mdsmap_epoch": 6, "osdmap_epoch": 26, "osdmap_epoch_barrier": 26, "uptime": 10.580160826 } 2020-04-02T23:25:01.539 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-04-02T23:25:01.559 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-04-02T23:25:01.559 INFO:tasks.ceph_fuse:config is None 2020-04-02T23:25:01.559 INFO:tasks.ceph_fuse:new config is {'client.0': None} 2020-04-02T23:25:01.560 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-04-02T23:25:01.560 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:01.574 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:25:01.726 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.724+0000 7f22704fa700 1 Processor -- start 2020-04-02T23:25:01.726 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.724+0000 7f22704fa700 1 -- start start 2020-04-02T23:25:01.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.725+0000 7f22704fa700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f22680ab410 0x7f22680a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:25:01.733 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.725+0000 7f22704fa700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f22680a6a90 0x7f22680a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:25:01.733 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.725+0000 7f22704fa700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22680a31b0 con 0x7f22680a2130 2020-04-02T23:25:01.733 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.725+0000 7f22704fa700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22680a49f0 con 0x7f22680a6a90 2020-04-02T23:25:01.733 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.725+0000 7f22704fa700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226805ff40 con 0x7f22680ab410 2020-04-02T23:25:01.733 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.725+0000 7f226da95700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f22680a6a90 0x7f22680a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:01.733 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.725+0000 7f226ea97700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f22680a2130 0x7f22680a2580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59828/0 (socket says 172.21.15.42:59828) 2020-04-02T23:25:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.725+0000 7f226da95700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f22680a6a90 0x7f22680a1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40400/0 (socket says 172.21.15.42:40400) 2020-04-02T23:25:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.725+0000 7f226ea97700 1 -- 172.21.15.42:0/2054116825 learned_addr learned my addr 172.21.15.42:0/2054116825 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:25:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.725+0000 7f226e296700 1 --2- 172.21.15.42:0/2054116825 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f22680ab410 0x7f22680a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.725+0000 7f226da95700 1 -- 172.21.15.42:0/2054116825 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f22680ab410 msgr2=0x7f22680a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:25:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.725+0000 7f226da95700 1 --2- 172.21.15.42:0/2054116825 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f22680ab410 0x7f22680a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:25:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.725+0000 7f226da95700 1 -- 172.21.15.42:0/2054116825 >> v1:172.21.15.42:6789/0 conn(0x7f22680a2130 legacy=0x7f22680a2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:01.734 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.725+0000 7f226d294700 1 -- 172.21.15.42:0/2054116825 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640761010 0 0) 0x7f22680a31b0 con 0x7f22680a2130 2020-04-02T23:25:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.725+0000 7f226da95700 1 -- 172.21.15.42:0/2054116825 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22680a3420 con 0x7f22680a6a90 2020-04-02T23:25:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.726+0000 7f226da95700 1 --2- 172.21.15.42:0/2054116825 >> v2:172.21.15.42:3300/0 conn(0x7f22680a6a90 0x7f22680a1cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f225c002f30 tx=0x7f225c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.726+0000 7f226da95700 1 --2- 172.21.15.42:0/2054116825 >> v2:172.21.15.42:3300/0 conn(0x7f22680a6a90 0x7f22680a1cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f225c002f30 tx=0x7f225c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.726+0000 7f226da95700 1 --2- 172.21.15.42:0/2054116825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22680a6a90 0x7f22680a1cd0 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f225c002f30 tx=0x7f225c007a40).ready entity=mon.0 client_cookie=147ae59fcf0796e9 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.726+0000 7f226da95700 1 --2- 172.21.15.42:0/2054116825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22680a6a90 0x7f22680a1cd0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f225c002f30 tx=0x7f225c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.726+0000 7f226da95700 1 --2- 172.21.15.42:0/2054116825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22680a6a90 0x7f22680a1cd0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f225c002f30 tx=0x7f225c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.726+0000 7f226d294700 1 -- 172.21.15.42:0/2054116825 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f225c011470 con 0x7f22680a6a90 2020-04-02T23:25:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.726+0000 7f226da95700 1 --2- 172.21.15.42:0/2054116825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22680a6a90 0x7f22680a1cd0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f225c002f30 tx=0x7f225c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.726+0000 7f226d294700 1 -- 172.21.15.42:0/2054116825 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c0115d0 con 0x7f22680a6a90 2020-04-02T23:25:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.726+0000 7f226d294700 1 -- 172.21.15.42:0/2054116825 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f225c0119b0 con 0x7f22680a6a90 2020-04-02T23:25:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.726+0000 7f22704fa700 1 -- 172.21.15.42:0/2054116825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22680a6a90 msgr2=0x7f22680a1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.726+0000 7f22704fa700 1 --2- 172.21.15.42:0/2054116825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22680a6a90 0x7f22680a1cd0 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f225c002f30 tx=0x7f225c007a40).stop 2020-04-02T23:25:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.726+0000 7f22704fa700 1 -- 172.21.15.42:0/2054116825 shutdown_connections 2020-04-02T23:25:01.736 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.726+0000 7f22704fa700 1 --2- 172.21.15.42:0/2054116825 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f22680ab410 0x7f22680a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:25:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.726+0000 7f22704fa700 1 --2- 172.21.15.42:0/2054116825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22680a6a90 0x7f22680a1cd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.726+0000 7f22704fa700 1 -- 172.21.15.42:0/2054116825 >> 172.21.15.42:0/2054116825 conn(0x7f226805b720 msgr2=0x7f22680aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:25:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.726+0000 7f22704fa700 1 -- 172.21.15.42:0/2054116825 shutdown_connections 2020-04-02T23:25:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.726+0000 7f22704fa700 1 -- 172.21.15.42:0/2054116825 wait complete. 2020-04-02T23:25:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.727+0000 7f22704fa700 1 Processor -- start 2020-04-02T23:25:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.727+0000 7f22704fa700 1 -- start start 2020-04-02T23:25:01.737 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.728+0000 7f22704fa700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f22680a2130 0x7f22680652e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:01.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.728+0000 7f22704fa700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f22680a6a90 0x7f2268143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:01.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.728+0000 7f22704fa700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f22680ab410 0x7f2268139750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:01.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.728+0000 7f22704fa700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2268063e10 con 0x7f22680ab410 2020-04-02T23:25:01.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.728+0000 7f22704fa700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22680640b0 con 0x7f22680a2130 2020-04-02T23:25:01.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.728+0000 7f22704fa700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2268065740 con 0x7f22680a6a90 2020-04-02T23:25:01.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.728+0000 7f226ea97700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f22680ab410 0x7f2268139750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:01.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.728+0000 7f226ea97700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f22680ab410 0x7f2268139750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40410/0 (socket says 172.21.15.42:40410) 2020-04-02T23:25:01.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.728+0000 7f226ea97700 1 -- 172.21.15.42:0/2246877465 learned_addr learned my addr 172.21.15.42:0/2246877465 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:25:01.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.728+0000 7f226e296700 1 --2- 172.21.15.42:0/2246877465 >> v2:172.21.15.84:3300/0 conn(0x7f22680a2130 0x7f22680652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:01.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.728+0000 7f226da95700 1 --2- 172.21.15.42:0/2246877465 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f22680a6a90 0x7f2268143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:01.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.728+0000 7f226ea97700 1 -- 172.21.15.42:0/2246877465 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f22680a6a90 msgr2=0x7f2268143dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:01.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.728+0000 7f226ea97700 1 --2- 172.21.15.42:0/2246877465 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f22680a6a90 0x7f2268143dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:01.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.728+0000 7f226ea97700 1 -- 172.21.15.42:0/2246877465 >> v2:172.21.15.84:3300/0 conn(0x7f22680a2130 msgr2=0x7f22680652e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:01.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.728+0000 7f226ea97700 1 --2- 172.21.15.42:0/2246877465 >> v2:172.21.15.84:3300/0 conn(0x7f22680a2130 0x7f22680652e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:01.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.728+0000 7f226ea97700 1 -- 172.21.15.42:0/2246877465 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22680658b0 con 0x7f22680ab410 2020-04-02T23:25:01.740 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.728+0000 7f226ea97700 1 --2- 172.21.15.42:0/2246877465 >> v2:172.21.15.42:3300/0 conn(0x7f22680ab410 0x7f2268139750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2260001210 tx=0x7f2260010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:01.740 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.728+0000 7f226ea97700 1 --2- 172.21.15.42:0/2246877465 >> v2:172.21.15.42:3300/0 conn(0x7f22680ab410 0x7f2268139750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2260001210 tx=0x7f2260010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:01.740 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.728+0000 7f226ea97700 1 --2- 172.21.15.42:0/2246877465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22680ab410 0x7f2268139750 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f2260001210 tx=0x7f2260010d50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:01.740 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.729+0000 7f226ea97700 1 --2- 172.21.15.42:0/2246877465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22680ab410 0x7f2268139750 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2260001210 tx=0x7f2260010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:01.740 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.729+0000 7f225b7fe700 1 -- 172.21.15.42:0/2246877465 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2260005e30 con 0x7f22680ab410 2020-04-02T23:25:01.740 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.729+0000 7f226ea97700 1 --2- 172.21.15.42:0/2246877465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22680ab410 0x7f2268139750 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2260001210 tx=0x7f2260010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:01.747 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.729+0000 7f226ea97700 1 --2- 172.21.15.42:0/2246877465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22680ab410 0x7f2268139750 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2260001210 tx=0x7f2260010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:01.747 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.729+0000 7f225b7fe700 1 -- 172.21.15.42:0/2246877465 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22600125e0 con 0x7f22680ab410 2020-04-02T23:25:01.747 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.729+0000 7f22704fa700 1 -- 172.21.15.42:0/2246877465 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2268144230 con 0x7f22680ab410 2020-04-02T23:25:01.748 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.729+0000 7f225b7fe700 1 -- 172.21.15.42:0/2246877465 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22600129c0 con 0x7f22680ab410 2020-04-02T23:25:01.748 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.729+0000 7f22704fa700 1 -- 172.21.15.42:0/2246877465 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2268066f40 con 0x7f22680ab410 2020-04-02T23:25:01.748 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.729+0000 7f226ea97700 1 --2- 172.21.15.42:0/2246877465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22680ab410 0x7f2268139750 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2260001210 tx=0x7f2260010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:01.748 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.730+0000 7f225b7fe700 1 -- 172.21.15.42:0/2246877465 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f2260012c30 con 0x7f22680ab410 2020-04-02T23:25:01.748 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.730+0000 7f226ea97700 1 --2- 172.21.15.42:0/2246877465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22680ab410 0x7f2268139750 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2260001210 tx=0x7f2260010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:01.748 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.730+0000 7f22704fa700 1 -- 172.21.15.42:0/2246877465 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226805d2e0 con 0x7f22680ab410 2020-04-02T23:25:01.748 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.730+0000 7f225b7fe700 1 --2- 172.21.15.42:0/2246877465 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f224804d540 0x7f224804fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:01.749 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.730+0000 7f225b7fe700 1 -- 172.21.15.42:0/2246877465 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f2260061050 con 0x7f22680ab410 2020-04-02T23:25:01.749 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.730+0000 7f226e296700 1 --2- 172.21.15.42:0/2246877465 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f224804d540 0x7f224804fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:01.749 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.730+0000 7f226e296700 1 --2- 172.21.15.42:0/2246877465 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f224804d540 0x7f224804fa00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2264002f30 tx=0x7f226400a7e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:01.749 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.731+0000 7f226e296700 1 --2- 172.21.15.42:0/2246877465 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f224804d540 0x7f224804fa00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2264002f30 tx=0x7f226400a7e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:01.749 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.731+0000 7f226e296700 1 --2- 172.21.15.42:0/2246877465 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f224804d540 0x7f224804fa00 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f2264002f30 tx=0x7f226400a7e0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:01.750 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.733+0000 7f226ea97700 1 --2- 172.21.15.42:0/2246877465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22680ab410 0x7f2268139750 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2260001210 tx=0x7f2260010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:01.750 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.733+0000 7f225b7fe700 1 -- 172.21.15.42:0/2246877465 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f226003c7b0 con 0x7f22680ab410 2020-04-02T23:25:01.884 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.882+0000 7f22704fa700 1 -- 172.21.15.42:0/2246877465 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22680658b0 con 0x7f22680ab410 2020-04-02T23:25:01.885 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.883+0000 7f226ea97700 1 --2- 172.21.15.42:0/2246877465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22680ab410 0x7f2268139750 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f2260001210 tx=0x7f2260010d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:01.885 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.883+0000 7f225b7fe700 1 -- 172.21.15.42:0/2246877465 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f22680658b0 con 0x7f22680ab410 2020-04-02T23:25:01.886 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:25:01.886 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":26,"fsid":"571c521c-9ca7-4052-ba5b-7a77e18ff12c","created":"2020-04-02T23:24:23.980442+0000","modified":"2020-04-02T23:24:48.393847+0000","last_up_change":"2020-04-02T23:24:36.096260+0000","last_in_change":"2020-04-02T23:24:36.096260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:24:27.091980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:24:40.298468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:24:43.688260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:24:45.991301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"976aac36-1cf8-408b-bf56-9f0eefe43b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":24836},{"type":"v1","addr":"172.21.15.42:6801","nonce":24836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":24836},{"type":"v1","addr":"172.21.15.42:6803","nonce":24836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":24836},{"type":"v1","addr":"172.21.15.42:6807","nonce":24836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":24836},{"type":"v1","addr":"172.21.15.42:6805","nonce":24836}]},"public_addr":"172.21.15.42:6801/24836","cluster_addr":"172.21.15.42:6803/24836","heartbeat_back_addr":"172.21.15.42:6807/24836","heartbeat_front_addr":"172.21.15.42:6805/24836","state":["exists","up"]},{"osd":1,"uuid":"22c1e489-ab99-4205-ba9d-fbfc144d2a8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":24881},{"type":"v1","addr":"172.21.15.42:6809","nonce":24881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":24881},{"type":"v1","addr":"172.21.15.42:6811","nonce":24881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":24881},{"type":"v1","addr":"172.21.15.42:6815","nonce":24881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":24881},{"type":"v1","addr":"172.21.15.42:6813","nonce":24881}]},"public_addr":"172.21.15.42:6809/24881","cluster_addr":"172.21.15.42:6811/24881","heartbeat_back_addr":"172.21.15.42:6815/24881","heartbeat_front_addr":"172.21.15.42:6813/24881","state":["exists","up"]},{"osd":2,"uuid":"f0b18b09-93c0-4286-8d15-746611ba53cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":24917},{"type":"v1","addr":"172.21.15.42:6817","nonce":24917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":24917},{"type":"v1","addr":"172.21.15.42:6819","nonce":24917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":24917},{"type":"v1","addr":"172.21.15.42:6823","nonce":24917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":24917},{"type":"v1","addr":"172.21.15.42:6821","nonce":24917}]},"public_addr":"172.21.15.42:6817/24917","cluster_addr":"172.21.15.42:6819/24917","heartbeat_back_addr":"172.21.15.42:6823/24917","heartbeat_front_addr":"172.21.15.42:6821/24917","state":["exists","up"]},{"osd":3,"uuid":"989d4a69-9abe-44de-95f2-6c7cbbe07471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":24940},{"type":"v1","addr":"172.21.15.42:6825","nonce":24940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":24940},{"type":"v1","addr":"172.21.15.42:6827","nonce":24940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":24940},{"type":"v1","addr":"172.21.15.42:6831","nonce":24940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":24940},{"type":"v1","addr":"172.21.15.42:6829","nonce":24940}]},"public_addr":"172.21.15.42:6825/24940","cluster_addr":"172.21.15.42:6827/24940","heartbeat_back_addr":"172.21.15.42:6831/24940","heartbeat_front_addr":"172.21.15.42:6829/24940","state":["exists","up"]},{"osd":4,"uuid":"b1a2ce60-ae80-4f8a-97a3-4fbb1399fdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":24239},{"type":"v1","addr":"172.21.15.84:6803","nonce":24239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":24239},{"type":"v1","addr":"172.21.15.84:6805","nonce":24239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":24239},{"type":"v1","addr":"172.21.15.84:6809","nonce":24239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":24239},{"type":"v1","addr":"172.21.15.84:6807","nonce":24239}]},"public_addr":"172.21.15.84:6803/24239","cluster_addr":"172.21.15.84:6805/24239","heartbeat_back_addr":"172.21.15.84:6809/24239","heartbeat_front_addr":"172.21.15.84:6807/24239","state":["exists","up"]},{"osd":5,"uuid":"396b36e5-7226-4e8e-aa8a-749cb5cec101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":24276},{"type":"v1","addr":"172.21.15.84:6811","nonce":24276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":24276},{"type":"v1","addr":"172.21.15.84:6813","nonce":24276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":24276},{"type":"v1","addr":"172.21.15.84:6817","nonce":24276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":24276},{"type":"v1","addr":"172.21.15.84:6815","nonce":24276}]},"public_addr":"172.21.15.84:6811/24276","cluster_addr":"172.21.15.84:6813/24276","heartbeat_back_addr":"172.21.15.84:6817/24276","heartbeat_front_addr":"172.21.15.84:6815/24276","state":["exists","up"]},{"osd":6,"uuid":"884bb915-28c3-463d-8046-e2908f6e8e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":24319},{"type":"v1","addr":"172.21.15.84:6819","nonce":24319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":24319},{"type":"v1","addr":"172.21.15.84:6821","nonce":24319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":24319},{"type":"v1","addr":"172.21.15.84:6825","nonce":24319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":24319},{"type":"v1","addr":"172.21.15.84:6823","nonce":24319}]},"public_addr":"172.21.15.84:6819/24319","cluster_addr":"172.21.15.84:6821/24319","heartbeat_back_addr":"172.21.15.84:6825/24319","heartbeat_front_addr":"172.21.15.84:6823/24319","state":["exists","up"]},{"osd":7,"uuid":"70e90d1d-f081-4de5-af4b-e987c159e597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":24349},{"type":"v1","addr":"172.21.15.84:6827","nonce":24349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":24349},{"type":"v1","addr":"172.21.15.84:6829","nonce":24349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":24349},{"type":"v1","addr":"172.21.15.84:6833","nonce":24349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":24349},{"type":"v1","addr":"172.21.15.84:6831","nonce":24349}]},"public_addr":"172.21.15.84:6827/24349","cluster_addr":"172.21.15.84:6829/24349","heartbeat_back_addr":"172.21.15.84:6833/24349","heartbeat_front_addr":"172.21.15.84:6831/24349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.195657+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.241354+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.257764+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.368827+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.967296+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.991068+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.077047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.095727+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:25:01.887 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.884+0000 7f22704fa700 1 -- 172.21.15.42:0/2246877465 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f224804d540 msgr2=0x7f224804fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:01.887 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.884+0000 7f22704fa700 1 --2- 172.21.15.42:0/2246877465 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f224804d540 0x7f224804fa00 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f2264002f30 tx=0x7f226400a7e0).stop 2020-04-02T23:25:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.884+0000 7f22704fa700 1 -- 172.21.15.42:0/2246877465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22680ab410 msgr2=0x7f2268139750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.884+0000 7f22704fa700 1 --2- 172.21.15.42:0/2246877465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22680ab410 0x7f2268139750 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f2260001210 tx=0x7f2260010d50).stop 2020-04-02T23:25:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.885+0000 7f22704fa700 1 -- 172.21.15.42:0/2246877465 shutdown_connections 2020-04-02T23:25:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.885+0000 7f22704fa700 1 --2- 172.21.15.42:0/2246877465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22680ab410 0x7f2268139750 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.885+0000 7f22704fa700 1 --2- 172.21.15.42:0/2246877465 >> v2:172.21.15.84:3300/0 conn(0x7f22680a2130 0x7f22680652e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.885+0000 7f22704fa700 1 --2- 172.21.15.42:0/2246877465 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f224804d540 0x7f224804fa00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:01.888 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.885+0000 7f22704fa700 1 --2- 172.21.15.42:0/2246877465 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f22680a6a90 0x7f2268143dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:01.889 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.885+0000 7f22704fa700 1 -- 172.21.15.42:0/2246877465 >> 172.21.15.42:0/2246877465 conn(0x7f226805b720 msgr2=0x7f22680aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:25:01.889 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.885+0000 7f22704fa700 1 -- 172.21.15.42:0/2246877465 shutdown_connections 2020-04-02T23:25:01.889 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:01.885+0000 7f22704fa700 1 -- 172.21.15.42:0/2246877465 wait complete. 2020-04-02T23:25:01.897 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:24:27.091980+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:24:40.298468+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:24:43.688260+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'26', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-02T23:24:45.991301+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'26', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-02T23:25:01.898 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:01.912 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-02T23:25:02.068 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.066+0000 7f6709df4700 1 Processor -- start 2020-04-02T23:25:02.068 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.066+0000 7f6709df4700 1 -- start start 2020-04-02T23:25:02.074 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f6709df4700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f67040ab410 0x7f67040a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:25:02.074 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f6709df4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6704067380 0x7f67040a6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:25:02.074 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f6709df4700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f67040a5250 0x7f67040a56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:25:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f6709df4700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67040a45f0 con 0x7f67040ab410 2020-04-02T23:25:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f6709df4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670409f460 con 0x7f6704067380 2020-04-02T23:25:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f6709df4700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670405ff40 con 0x7f67040a5250 2020-04-02T23:25:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f67037fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f67040ab410 0x7f67040a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f67037fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f67040ab410 0x7f67040a6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40414/0 (socket says 172.21.15.42:40414) 2020-04-02T23:25:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f67037fe700 1 -- 172.21.15.42:0/3481526928 learned_addr learned my addr 172.21.15.42:0/3481526928 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:25:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f6702ffd700 1 --2- 172.21.15.42:0/3481526928 >> v2:172.21.15.84:3300/0 conn(0x7f6704067380 0x7f67040a6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:02.076 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f6703fff700 1 --2- 172.21.15.42:0/3481526928 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f67040a5250 0x7f67040a56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:02.076 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f67037fe700 1 -- 172.21.15.42:0/3481526928 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f67040a5250 msgr2=0x7f67040a56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:25:02.076 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f67037fe700 1 --2- 172.21.15.42:0/3481526928 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f67040a5250 0x7f67040a56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:25:02.081 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f67037fe700 1 -- 172.21.15.42:0/3481526928 >> v2:172.21.15.84:3300/0 conn(0x7f6704067380 msgr2=0x7f67040a6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:25:02.081 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f67037fe700 1 --2- 172.21.15.42:0/3481526928 >> v2:172.21.15.84:3300/0 conn(0x7f6704067380 0x7f67040a6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:25:02.081 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f67037fe700 1 -- 172.21.15.42:0/3481526928 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67040a4850 con 0x7f67040ab410 2020-04-02T23:25:02.081 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f67037fe700 1 --2- 172.21.15.42:0/3481526928 >> v2:172.21.15.42:3300/0 conn(0x7f67040ab410 0x7f67040a6630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f66f4002f30 tx=0x7f66f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.081 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f67037fe700 1 --2- 172.21.15.42:0/3481526928 >> v2:172.21.15.42:3300/0 conn(0x7f67040ab410 0x7f67040a6630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f66f4002f30 tx=0x7f66f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.081 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f67037fe700 1 --2- 172.21.15.42:0/3481526928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67040ab410 0x7f67040a6630 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f66f4002f30 tx=0x7f66f4007a40).ready entity=mon.0 client_cookie=fbc7d50609c97a22 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:02.082 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f67037fe700 1 --2- 172.21.15.42:0/3481526928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67040ab410 0x7f67040a6630 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f66f4002f30 tx=0x7f66f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.082 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f67027fc700 1 -- 172.21.15.42:0/3481526928 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66f4011720 con 0x7f67040ab410 2020-04-02T23:25:02.082 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f67037fe700 1 --2- 172.21.15.42:0/3481526928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67040ab410 0x7f67040a6630 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f66f4002f30 tx=0x7f66f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.082 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f67027fc700 1 -- 172.21.15.42:0/3481526928 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f4011880 con 0x7f67040ab410 2020-04-02T23:25:02.082 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f67037fe700 1 --2- 172.21.15.42:0/3481526928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67040ab410 0x7f67040a6630 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f66f4002f30 tx=0x7f66f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.082 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f67027fc700 1 -- 172.21.15.42:0/3481526928 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66f4011c60 con 0x7f67040ab410 2020-04-02T23:25:02.082 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.067+0000 7f6709df4700 1 -- 172.21.15.42:0/3481526928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67040ab410 msgr2=0x7f67040a6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:02.083 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.068+0000 7f6709df4700 1 --2- 172.21.15.42:0/3481526928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67040ab410 0x7f67040a6630 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f66f4002f30 tx=0x7f66f4007a40).stop 2020-04-02T23:25:02.083 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.068+0000 7f6709df4700 1 -- 172.21.15.42:0/3481526928 shutdown_connections 2020-04-02T23:25:02.083 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.068+0000 7f6709df4700 1 --2- 172.21.15.42:0/3481526928 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f67040a5250 0x7f67040a56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:25:02.083 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.068+0000 7f6709df4700 1 --2- 172.21.15.42:0/3481526928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67040ab410 0x7f67040a6630 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:02.083 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.068+0000 7f6709df4700 1 --2- 172.21.15.42:0/3481526928 >> v2:172.21.15.84:3300/0 conn(0x7f6704067380 0x7f67040a6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:25:02.083 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.068+0000 7f6709df4700 1 -- 172.21.15.42:0/3481526928 >> 172.21.15.42:0/3481526928 conn(0x7f670405b720 msgr2=0x7f67040aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:25:02.083 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.068+0000 7f6709df4700 1 -- 172.21.15.42:0/3481526928 shutdown_connections 2020-04-02T23:25:02.083 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.068+0000 7f6709df4700 1 -- 172.21.15.42:0/3481526928 wait complete. 2020-04-02T23:25:02.084 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.069+0000 7f6709df4700 1 Processor -- start 2020-04-02T23:25:02.084 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.069+0000 7f6709df4700 1 -- start start 2020-04-02T23:25:02.084 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6709df4700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6704067380 0x7f67040a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:02.084 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6709df4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f67040a5250 0x7f67040a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:02.084 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6709df4700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f67040ab410 0x7f67040a2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:02.084 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6709df4700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670408ff60 con 0x7f67040ab410 2020-04-02T23:25:02.084 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6709df4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67040a2680 con 0x7f67040a5250 2020-04-02T23:25:02.085 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6709df4700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67040a3a50 con 0x7f6704067380 2020-04-02T23:25:02.085 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6703fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f67040ab410 0x7f67040a2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:02.085 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6703fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f67040ab410 0x7f67040a2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40424/0 (socket says 172.21.15.42:40424) 2020-04-02T23:25:02.085 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6703fff700 1 -- 172.21.15.42:0/2351194769 learned_addr learned my addr 172.21.15.42:0/2351194769 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:25:02.085 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6702ffd700 1 --2- 172.21.15.42:0/2351194769 >> v2:172.21.15.84:3300/0 conn(0x7f67040a5250 0x7f67040a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:02.085 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f67037fe700 1 --2- 172.21.15.42:0/2351194769 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6704067380 0x7f67040a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:02.086 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6703fff700 1 -- 172.21.15.42:0/2351194769 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6704067380 msgr2=0x7f67040a3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:02.086 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6703fff700 1 --2- 172.21.15.42:0/2351194769 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6704067380 0x7f67040a3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:02.086 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6703fff700 1 -- 172.21.15.42:0/2351194769 >> v2:172.21.15.84:3300/0 conn(0x7f67040a5250 msgr2=0x7f67040a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:02.086 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6703fff700 1 --2- 172.21.15.42:0/2351194769 >> v2:172.21.15.84:3300/0 conn(0x7f67040a5250 0x7f67040a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:02.086 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6703fff700 1 -- 172.21.15.42:0/2351194769 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6704090150 con 0x7f67040ab410 2020-04-02T23:25:02.086 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6703fff700 1 --2- 172.21.15.42:0/2351194769 >> v2:172.21.15.42:3300/0 conn(0x7f67040ab410 0x7f67040a2220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f66fc0032b0 tx=0x7f66fc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.086 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6703fff700 1 --2- 172.21.15.42:0/2351194769 >> v2:172.21.15.42:3300/0 conn(0x7f67040ab410 0x7f67040a2220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f66fc0032b0 tx=0x7f66fc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.087 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6703fff700 1 --2- 172.21.15.42:0/2351194769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67040ab410 0x7f67040a2220 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7f66fc0032b0 tx=0x7f66fc010e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:02.087 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6703fff700 1 --2- 172.21.15.42:0/2351194769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67040ab410 0x7f67040a2220 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f66fc0032b0 tx=0x7f66fc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.087 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6700ff9700 1 -- 172.21.15.42:0/2351194769 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66fc0103f0 con 0x7f67040ab410 2020-04-02T23:25:02.087 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6703fff700 1 --2- 172.21.15.42:0/2351194769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67040ab410 0x7f67040a2220 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f66fc0032b0 tx=0x7f66fc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.087 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6703fff700 1 --2- 172.21.15.42:0/2351194769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67040ab410 0x7f67040a2220 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f66fc0032b0 tx=0x7f66fc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.087 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6700ff9700 1 -- 172.21.15.42:0/2351194769 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66fc00ea30 con 0x7f67040ab410 2020-04-02T23:25:02.087 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6709df4700 1 -- 172.21.15.42:0/2351194769 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67040903f0 con 0x7f67040ab410 2020-04-02T23:25:02.087 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6700ff9700 1 -- 172.21.15.42:0/2351194769 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66fc00ee70 con 0x7f67040ab410 2020-04-02T23:25:02.088 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.070+0000 7f6709df4700 1 -- 172.21.15.42:0/2351194769 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f670409a330 con 0x7f67040ab410 2020-04-02T23:25:02.088 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.071+0000 7f6703fff700 1 --2- 172.21.15.42:0/2351194769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67040ab410 0x7f67040a2220 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f66fc0032b0 tx=0x7f66fc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.088 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.071+0000 7f6709df4700 1 -- 172.21.15.42:0/2351194769 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f670405d2e0 con 0x7f67040ab410 2020-04-02T23:25:02.088 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.071+0000 7f6700ff9700 1 -- 172.21.15.42:0/2351194769 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f66fc005a40 con 0x7f67040ab410 2020-04-02T23:25:02.088 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.071+0000 7f6703fff700 1 --2- 172.21.15.42:0/2351194769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67040ab410 0x7f67040a2220 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f66fc0032b0 tx=0x7f66fc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.088 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.072+0000 7f6700ff9700 1 --2- 172.21.15.42:0/2351194769 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f66e404d600 0x7f66e404fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:02.088 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.072+0000 7f6700ff9700 1 -- 172.21.15.42:0/2351194769 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f66fc061620 con 0x7f67040ab410 2020-04-02T23:25:02.089 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.072+0000 7f67037fe700 1 --2- 172.21.15.42:0/2351194769 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f66e404d600 0x7f66e404fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:02.089 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.072+0000 7f67037fe700 1 --2- 172.21.15.42:0/2351194769 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f66e404d600 0x7f66e404fac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f66f4002f30 tx=0x7f66f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.089 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.072+0000 7f67037fe700 1 --2- 172.21.15.42:0/2351194769 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f66e404d600 0x7f66e404fac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f66f4002f30 tx=0x7f66f4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.089 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.072+0000 7f67037fe700 1 --2- 172.21.15.42:0/2351194769 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f66e404d600 0x7f66e404fac0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f66f4002f30 tx=0x7f66f4007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:02.089 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.075+0000 7f6703fff700 1 --2- 172.21.15.42:0/2351194769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67040ab410 0x7f67040a2220 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f66fc0032b0 tx=0x7f66fc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.090 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.075+0000 7f6700ff9700 1 -- 172.21.15.42:0/2351194769 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f66fc03cca0 con 0x7f67040ab410 2020-04-02T23:25:02.222 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.220+0000 7f6709df4700 1 -- 172.21.15.42:0/2351194769 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6704056c50 con 0x7f67040ab410 2020-04-02T23:25:02.222 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.220+0000 7f6703fff700 1 --2- 172.21.15.42:0/2351194769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67040ab410 0x7f67040a2220 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f66fc0032b0 tx=0x7f66fc010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.222 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.220+0000 7f6700ff9700 1 -- 172.21.15.42:0/2351194769 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7f66fc0402c0 con 0x7f67040ab410 2020-04-02T23:25:02.222 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2020-04-02T23:25:02.224 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.221+0000 7f6709df4700 1 -- 172.21.15.42:0/2351194769 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f66e404d600 msgr2=0x7f66e404fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:02.224 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.221+0000 7f6709df4700 1 --2- 172.21.15.42:0/2351194769 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f66e404d600 0x7f66e404fac0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f66f4002f30 tx=0x7f66f4007a40).stop 2020-04-02T23:25:02.224 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.221+0000 7f6709df4700 1 -- 172.21.15.42:0/2351194769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67040ab410 msgr2=0x7f67040a2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:02.224 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.221+0000 7f6709df4700 1 --2- 172.21.15.42:0/2351194769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67040ab410 0x7f67040a2220 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7f66fc0032b0 tx=0x7f66fc010e10).stop 2020-04-02T23:25:02.224 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.221+0000 7f6709df4700 1 -- 172.21.15.42:0/2351194769 shutdown_connections 2020-04-02T23:25:02.224 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.221+0000 7f6709df4700 1 --2- 172.21.15.42:0/2351194769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67040ab410 0x7f67040a2220 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:02.225 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.221+0000 7f6709df4700 1 --2- 172.21.15.42:0/2351194769 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f66e404d600 0x7f66e404fac0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:02.225 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.221+0000 7f6709df4700 1 --2- 172.21.15.42:0/2351194769 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f6704067380 0x7f67040a3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:02.225 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.221+0000 7f6709df4700 1 --2- 172.21.15.42:0/2351194769 >> v2:172.21.15.84:3300/0 conn(0x7f67040a5250 0x7f67040a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:02.225 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.221+0000 7f6709df4700 1 -- 172.21.15.42:0/2351194769 >> 172.21.15.42:0/2351194769 conn(0x7f670405b720 msgr2=0x7f6704069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:25:02.225 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.221+0000 7f6709df4700 1 -- 172.21.15.42:0/2351194769 shutdown_connections 2020-04-02T23:25:02.225 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.221+0000 7f6709df4700 1 -- 172.21.15.42:0/2351194769 wait complete. 2020-04-02T23:25:02.233 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:02.247 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-02T23:25:02.402 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.400+0000 7f7ac3eec700 1 Processor -- start 2020-04-02T23:25:02.402 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.400+0000 7f7ac3eec700 1 -- start start 2020-04-02T23:25:02.405 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.401+0000 7f7ac3eec700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7abc13e3f0 0x7f7abc1407e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:25:02.405 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.401+0000 7f7ac3eec700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7abc140c40 0x7f7abc143030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:25:02.405 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.401+0000 7f7ac3eec700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7abc0a4060 con 0x7f7abc0ad460 2020-04-02T23:25:02.405 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.401+0000 7f7ac3eec700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7abc0626b0 con 0x7f7abc13e3f0 2020-04-02T23:25:02.406 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.401+0000 7f7ac3eec700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc060f70 con 0x7f7abc140c40 2020-04-02T23:25:02.406 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.401+0000 7f7ac1487700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7abc13e3f0 0x7f7abc1407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:02.406 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.401+0000 7f7ac1c88700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f7abc0ad460 0x7f7abc0a83e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59852/0 (socket says 172.21.15.42:59852) 2020-04-02T23:25:02.406 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.401+0000 7f7ac1c88700 1 -- 172.21.15.42:0/1042124899 learned_addr learned my addr 172.21.15.42:0/1042124899 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:25:02.406 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.401+0000 7f7ac2489700 1 --2- 172.21.15.42:0/1042124899 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7abc140c40 0x7f7abc143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:02.406 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.401+0000 7f7ac1487700 1 -- 172.21.15.42:0/1042124899 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7abc140c40 msgr2=0x7f7abc143030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:25:02.406 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.401+0000 7f7ac1487700 1 --2- 172.21.15.42:0/1042124899 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7abc140c40 0x7f7abc143030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:25:02.407 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.401+0000 7f7ac1487700 1 -- 172.21.15.42:0/1042124899 >> v1:172.21.15.42:6789/0 conn(0x7f7abc0ad460 legacy=0x7f7abc0a83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:02.407 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.401+0000 7f7ac1487700 1 -- 172.21.15.42:0/1042124899 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc060400 con 0x7f7abc13e3f0 2020-04-02T23:25:02.407 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.401+0000 7f7ac2489700 1 --2- 172.21.15.42:0/1042124899 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7abc140c40 0x7f7abc143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:25:02.407 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.401+0000 7f7ac1487700 1 --2- 172.21.15.42:0/1042124899 >> v2:172.21.15.42:3300/0 conn(0x7f7abc13e3f0 0x7f7abc1407e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7ab8002f30 tx=0x7f7ab8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.407 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.402+0000 7f7ac1487700 1 --2- 172.21.15.42:0/1042124899 >> v2:172.21.15.42:3300/0 conn(0x7f7abc13e3f0 0x7f7abc1407e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7ab8002f30 tx=0x7f7ab8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.407 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.402+0000 7f7ac1487700 1 --2- 172.21.15.42:0/1042124899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc13e3f0 0x7f7abc1407e0 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f7ab8002f30 tx=0x7f7ab8007a40).ready entity=mon.0 client_cookie=bde0f890023c5995 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:02.407 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.402+0000 7f7ac1487700 1 --2- 172.21.15.42:0/1042124899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc13e3f0 0x7f7abc1407e0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f7ab8002f30 tx=0x7f7ab8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.407 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.402+0000 7f7ac0c86700 1 -- 172.21.15.42:0/1042124899 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ab8011470 con 0x7f7abc13e3f0 2020-04-02T23:25:02.408 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.402+0000 7f7ac1487700 1 --2- 172.21.15.42:0/1042124899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc13e3f0 0x7f7abc1407e0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f7ab8002f30 tx=0x7f7ab8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.408 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.402+0000 7f7ac0c86700 1 -- 172.21.15.42:0/1042124899 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab80115d0 con 0x7f7abc13e3f0 2020-04-02T23:25:02.408 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.402+0000 7f7ac1487700 1 --2- 172.21.15.42:0/1042124899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc13e3f0 0x7f7abc1407e0 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f7ab8002f30 tx=0x7f7ab8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.408 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.402+0000 7f7ac0c86700 1 -- 172.21.15.42:0/1042124899 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ab80119b0 con 0x7f7abc13e3f0 2020-04-02T23:25:02.408 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.402+0000 7f7ac3eec700 1 -- 172.21.15.42:0/1042124899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc13e3f0 msgr2=0x7f7abc1407e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:02.408 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.402+0000 7f7ac3eec700 1 --2- 172.21.15.42:0/1042124899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc13e3f0 0x7f7abc1407e0 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f7ab8002f30 tx=0x7f7ab8007a40).stop 2020-04-02T23:25:02.408 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.402+0000 7f7ac3eec700 1 -- 172.21.15.42:0/1042124899 shutdown_connections 2020-04-02T23:25:02.409 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.402+0000 7f7ac3eec700 1 --2- 172.21.15.42:0/1042124899 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f7abc140c40 0x7f7abc143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:25:02.409 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.402+0000 7f7ac3eec700 1 --2- 172.21.15.42:0/1042124899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc13e3f0 0x7f7abc1407e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:02.409 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.402+0000 7f7ac3eec700 1 -- 172.21.15.42:0/1042124899 >> 172.21.15.42:0/1042124899 conn(0x7f7abc062930 msgr2=0x7f7abc0acb90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:25:02.409 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.402+0000 7f7ac3eec700 1 -- 172.21.15.42:0/1042124899 shutdown_connections 2020-04-02T23:25:02.409 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.402+0000 7f7ac3eec700 1 -- 172.21.15.42:0/1042124899 wait complete. 2020-04-02T23:25:02.409 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.403+0000 7f7ac3eec700 1 Processor -- start 2020-04-02T23:25:02.409 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.403+0000 7f7ac3eec700 1 -- start start 2020-04-02T23:25:02.412 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.404+0000 7f7ac3eec700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7abc0ad460 0x7f7abc13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:02.413 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.404+0000 7f7ac3eec700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7abc140c40 0x7f7abc13df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:02.413 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.404+0000 7f7ac3eec700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7abc13bfd0 con 0x7f7abc13e3f0 2020-04-02T23:25:02.413 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.404+0000 7f7ac3eec700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7abc13c200 con 0x7f7abc140c40 2020-04-02T23:25:02.413 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.404+0000 7f7ac3eec700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7abc0a91a0 con 0x7f7abc0ad460 2020-04-02T23:25:02.413 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.404+0000 7f7ac2489700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7abc140c40 0x7f7abc13df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:02.413 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.404+0000 7f7ac2489700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7abc140c40 0x7f7abc13df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40438/0 (socket says 172.21.15.42:40438) 2020-04-02T23:25:02.414 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.404+0000 7f7ac2489700 1 -- 172.21.15.42:0/3216687732 learned_addr learned my addr 172.21.15.42:0/3216687732 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:25:02.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.404+0000 7f7ac1c88700 1 --2- 172.21.15.42:0/3216687732 >> v2:172.21.15.84:3300/0 conn(0x7f7abc0ad460 0x7f7abc13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:02.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.404+0000 7f7ac2489700 1 -- 172.21.15.42:0/3216687732 >> v2:172.21.15.84:3300/0 conn(0x7f7abc0ad460 msgr2=0x7f7abc13eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:02.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.404+0000 7f7ac2489700 1 --2- 172.21.15.42:0/3216687732 >> v2:172.21.15.84:3300/0 conn(0x7f7abc0ad460 0x7f7abc13eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:02.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.404+0000 7f7ac2489700 1 -- 172.21.15.42:0/3216687732 >> v1:172.21.15.84:6789/0 conn(0x7f7abc13e3f0 legacy=0x7f7abc13d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:02.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.404+0000 7f7ac2489700 1 -- 172.21.15.42:0/3216687732 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc0a9440 con 0x7f7abc140c40 2020-04-02T23:25:02.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.404+0000 7f7ac2489700 1 --2- 172.21.15.42:0/3216687732 >> v2:172.21.15.42:3300/0 conn(0x7f7abc140c40 0x7f7abc13df90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7abc1402d0 tx=0x7f7ab4010e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.404+0000 7f7ac2489700 1 --2- 172.21.15.42:0/3216687732 >> v2:172.21.15.42:3300/0 conn(0x7f7abc140c40 0x7f7abc13df90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7abc1402d0 tx=0x7f7ab4010e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.404+0000 7f7ac2489700 1 --2- 172.21.15.42:0/3216687732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc140c40 0x7f7abc13df90 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f7abc1402d0 tx=0x7f7ab4010e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.404+0000 7f7ac2489700 1 --2- 172.21.15.42:0/3216687732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc140c40 0x7f7abc13df90 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f7abc1402d0 tx=0x7f7ab4010e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.404+0000 7f7ac2489700 1 --2- 172.21.15.42:0/3216687732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc140c40 0x7f7abc13df90 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f7abc1402d0 tx=0x7f7ab4010e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.404+0000 7f7aaaffd700 1 -- 172.21.15.42:0/3216687732 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ab4007350 con 0x7f7abc140c40 2020-04-02T23:25:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.404+0000 7f7ac2489700 1 --2- 172.21.15.42:0/3216687732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc140c40 0x7f7abc13df90 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f7abc1402d0 tx=0x7f7ab4010e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.405+0000 7f7aaaffd700 1 -- 172.21.15.42:0/3216687732 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab40074b0 con 0x7f7abc140c40 2020-04-02T23:25:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.405+0000 7f7ac3eec700 1 -- 172.21.15.42:0/3216687732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7abc13e7d0 con 0x7f7abc140c40 2020-04-02T23:25:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.405+0000 7f7aaaffd700 1 -- 172.21.15.42:0/3216687732 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ab4007890 con 0x7f7abc140c40 2020-04-02T23:25:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.405+0000 7f7ac3eec700 1 -- 172.21.15.42:0/3216687732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7abc13efc0 con 0x7f7abc140c40 2020-04-02T23:25:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.405+0000 7f7ac2489700 1 --2- 172.21.15.42:0/3216687732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc140c40 0x7f7abc13df90 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f7abc1402d0 tx=0x7f7ab4010e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.406+0000 7f7aaaffd700 1 -- 172.21.15.42:0/3216687732 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f7ab4012490 con 0x7f7abc140c40 2020-04-02T23:25:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.406+0000 7f7ac2489700 1 --2- 172.21.15.42:0/3216687732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc140c40 0x7f7abc13df90 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f7abc1402d0 tx=0x7f7ab4010e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.406+0000 7f7ac3eec700 1 -- 172.21.15.42:0/3216687732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7abc0aa020 con 0x7f7abc140c40 2020-04-02T23:25:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.406+0000 7f7aaaffd700 1 --2- 172.21.15.42:0/3216687732 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f7a9c04d4d0 0x7f7a9c04f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.406+0000 7f7aaaffd700 1 -- 172.21.15.42:0/3216687732 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7ab40612a0 con 0x7f7abc140c40 2020-04-02T23:25:02.418 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.406+0000 7f7ac1c88700 1 --2- 172.21.15.42:0/3216687732 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f7a9c04d4d0 0x7f7a9c04f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:02.418 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.406+0000 7f7ac1c88700 1 --2- 172.21.15.42:0/3216687732 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f7a9c04d4d0 0x7f7a9c04f990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7abc06aff0 tx=0x7f7aac001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.418 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.406+0000 7f7ac1c88700 1 --2- 172.21.15.42:0/3216687732 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f7a9c04d4d0 0x7f7a9c04f990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7abc06aff0 tx=0x7f7aac001700).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.418 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.406+0000 7f7ac1c88700 1 --2- 172.21.15.42:0/3216687732 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f7a9c04d4d0 0x7f7a9c04f990 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f7abc06aff0 tx=0x7f7aac001700).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:02.418 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.409+0000 7f7ac2489700 1 --2- 172.21.15.42:0/3216687732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc140c40 0x7f7abc13df90 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f7abc1402d0 tx=0x7f7ab4010e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.418 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.409+0000 7f7aaaffd700 1 -- 172.21.15.42:0/3216687732 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f7ab403c9a0 con 0x7f7abc140c40 2020-04-02T23:25:02.560 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.554+0000 7f7ac3eec700 1 -- 172.21.15.42:0/3216687732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7abc1496a0 con 0x7f7abc140c40 2020-04-02T23:25:02.561 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.554+0000 7f7ac2489700 1 --2- 172.21.15.42:0/3216687732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc140c40 0x7f7abc13df90 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f7abc1402d0 tx=0x7f7ab4010e70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.561 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.554+0000 7f7aaaffd700 1 -- 172.21.15.42:0/3216687732 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7ab403ffc0 con 0x7f7abc140c40 2020-04-02T23:25:02.561 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.556+0000 7f7ac3eec700 1 -- 172.21.15.42:0/3216687732 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f7a9c04d4d0 msgr2=0x7f7a9c04f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:02.561 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.556+0000 7f7ac3eec700 1 --2- 172.21.15.42:0/3216687732 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f7a9c04d4d0 0x7f7a9c04f990 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7f7abc06aff0 tx=0x7f7aac001700).stop 2020-04-02T23:25:02.561 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.556+0000 7f7ac3eec700 1 -- 172.21.15.42:0/3216687732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc140c40 msgr2=0x7f7abc13df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:02.562 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.556+0000 7f7ac3eec700 1 --2- 172.21.15.42:0/3216687732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc140c40 0x7f7abc13df90 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f7abc1402d0 tx=0x7f7ab4010e70).stop 2020-04-02T23:25:02.562 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.556+0000 7f7ac3eec700 1 -- 172.21.15.42:0/3216687732 shutdown_connections 2020-04-02T23:25:02.562 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.556+0000 7f7ac3eec700 1 --2- 172.21.15.42:0/3216687732 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f7a9c04d4d0 0x7f7a9c04f990 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:02.562 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.556+0000 7f7ac3eec700 1 --2- 172.21.15.42:0/3216687732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7abc140c40 0x7f7abc13df90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:02.562 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.556+0000 7f7ac3eec700 1 --2- 172.21.15.42:0/3216687732 >> v2:172.21.15.84:3300/0 conn(0x7f7abc0ad460 0x7f7abc13eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:02.563 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.556+0000 7f7ac3eec700 1 -- 172.21.15.42:0/3216687732 >> 172.21.15.42:0/3216687732 conn(0x7f7abc062930 msgr2=0x7f7abc0a7230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:25:02.563 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.556+0000 7f7ac3eec700 1 -- 172.21.15.42:0/3216687732 shutdown_connections 2020-04-02T23:25:02.563 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.556+0000 7f7ac3eec700 1 -- 172.21.15.42:0/3216687732 wait complete. 2020-04-02T23:25:02.563 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 8 2020-04-02T23:25:02.568 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:02.581 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-04-02T23:25:02.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.736+0000 7ff0232ea700 1 Processor -- start 2020-04-02T23:25:02.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.736+0000 7ff0232ea700 1 -- start start 2020-04-02T23:25:02.744 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.737+0000 7ff0232ea700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff01c0a1cd0 0x7ff01c0a6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:25:02.744 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.737+0000 7ff0232ea700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff01c0a67a0 0x7ff01c0a5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:25:02.744 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.737+0000 7ff0232ea700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01c09a8f0 con 0x7ff01c0a20b0 2020-04-02T23:25:02.744 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.737+0000 7ff0232ea700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01c0a2680 con 0x7ff01c0a67a0 2020-04-02T23:25:02.744 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.737+0000 7ff0232ea700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c09ab90 con 0x7ff01c0a1cd0 2020-04-02T23:25:02.744 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.737+0000 7ff020885700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff01c0a20b0 0x7ff01c0a5250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59868/0 (socket says 172.21.15.42:59868) 2020-04-02T23:25:02.745 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.737+0000 7ff020885700 1 -- 172.21.15.42:0/2712332412 learned_addr learned my addr 172.21.15.42:0/2712332412 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:25:02.745 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.737+0000 7ff021887700 1 --2- 172.21.15.42:0/2712332412 >> v2:172.21.15.84:3300/0 conn(0x7ff01c0a67a0 0x7ff01c0a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:02.745 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.737+0000 7ff021086700 1 --2- 172.21.15.42:0/2712332412 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff01c0a1cd0 0x7ff01c0a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:02.745 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.737+0000 7ff00bfff700 1 -- 172.21.15.42:0/2712332412 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253864250 0 0) 0x7ff01c09a8f0 con 0x7ff01c0a20b0 2020-04-02T23:25:02.745 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.737+0000 7ff00bfff700 1 -- 172.21.15.42:0/2712332412 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff004003230 con 0x7ff01c0a20b0 2020-04-02T23:25:02.747 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.737+0000 7ff00bfff700 1 -- 172.21.15.42:0/2712332412 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2985644196 0 0) 0x7ff004003230 con 0x7ff01c0a20b0 2020-04-02T23:25:02.747 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.737+0000 7ff021887700 1 -- 172.21.15.42:0/2712332412 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff01c0a1cd0 msgr2=0x7ff01c0a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:25:02.748 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.737+0000 7ff021887700 1 --2- 172.21.15.42:0/2712332412 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff01c0a1cd0 0x7ff01c0a6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:25:02.748 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.737+0000 7ff021887700 1 -- 172.21.15.42:0/2712332412 >> v1:172.21.15.42:6789/0 conn(0x7ff01c0a20b0 legacy=0x7ff01c0a5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:02.748 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.737+0000 7ff021887700 1 -- 172.21.15.42:0/2712332412 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c09ae30 con 0x7ff01c0a67a0 2020-04-02T23:25:02.748 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.737+0000 7ff021887700 1 --2- 172.21.15.42:0/2712332412 >> v2:172.21.15.84:3300/0 conn(0x7ff01c0a67a0 0x7ff01c0a5960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff00c001870 tx=0x7ff014007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.748 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.737+0000 7ff021887700 1 --2- 172.21.15.42:0/2712332412 >> v2:172.21.15.84:3300/0 conn(0x7ff01c0a67a0 0x7ff01c0a5960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff00c001870 tx=0x7ff014007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.748 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.737+0000 7ff021887700 1 --2- 172.21.15.42:0/2712332412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff01c0a67a0 0x7ff01c0a5960 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7ff00c001870 tx=0x7ff014007dc0).ready entity=mon.1 client_cookie=4ded084851c2d4fd server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:02.748 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.738+0000 7ff021887700 1 --2- 172.21.15.42:0/2712332412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff01c0a67a0 0x7ff01c0a5960 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7ff00c001870 tx=0x7ff014007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.749 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.738+0000 7ff00bfff700 1 -- 172.21.15.42:0/2712332412 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff00c0016d0 con 0x7ff01c0a67a0 2020-04-02T23:25:02.749 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.738+0000 7ff021887700 1 --2- 172.21.15.42:0/2712332412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff01c0a67a0 0x7ff01c0a5960 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7ff00c001870 tx=0x7ff014007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.749 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.738+0000 7ff021887700 1 --2- 172.21.15.42:0/2712332412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff01c0a67a0 0x7ff01c0a5960 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7ff00c001870 tx=0x7ff014007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.749 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.738+0000 7ff00bfff700 1 -- 172.21.15.42:0/2712332412 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff014010a10 con 0x7ff01c0a67a0 2020-04-02T23:25:02.749 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.738+0000 7ff00bfff700 1 -- 172.21.15.42:0/2712332412 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff014010d70 con 0x7ff01c0a67a0 2020-04-02T23:25:02.749 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.738+0000 7ff0232ea700 1 -- 172.21.15.42:0/2712332412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff01c0a67a0 msgr2=0x7ff01c0a5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:02.749 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.738+0000 7ff0232ea700 1 --2- 172.21.15.42:0/2712332412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff01c0a67a0 0x7ff01c0a5960 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7ff00c001870 tx=0x7ff014007dc0).stop 2020-04-02T23:25:02.750 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.738+0000 7ff0232ea700 1 -- 172.21.15.42:0/2712332412 shutdown_connections 2020-04-02T23:25:02.750 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.738+0000 7ff0232ea700 1 --2- 172.21.15.42:0/2712332412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff01c0a67a0 0x7ff01c0a5960 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:02.750 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.738+0000 7ff0232ea700 1 --2- 172.21.15.42:0/2712332412 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff01c0a1cd0 0x7ff01c0a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:25:02.750 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.738+0000 7ff0232ea700 1 -- 172.21.15.42:0/2712332412 >> 172.21.15.42:0/2712332412 conn(0x7ff01c05b720 msgr2=0x7ff01c0aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:25:02.750 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.738+0000 7ff0232ea700 1 -- 172.21.15.42:0/2712332412 shutdown_connections 2020-04-02T23:25:02.750 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.738+0000 7ff0232ea700 1 -- 172.21.15.42:0/2712332412 wait complete. 2020-04-02T23:25:02.750 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.739+0000 7ff0232ea700 1 Processor -- start 2020-04-02T23:25:02.751 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.739+0000 7ff0232ea700 1 -- start start 2020-04-02T23:25:02.751 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff0232ea700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff01c0a1cd0 0x7ff01c0652d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:02.751 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff0232ea700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff01c0a20b0 0x7ff01c066bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:02.751 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff0232ea700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01c0667c0 con 0x7ff01c0a67a0 2020-04-02T23:25:02.751 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff0232ea700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01c063550 con 0x7ff01c0a1cd0 2020-04-02T23:25:02.751 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff0232ea700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01c0637f0 con 0x7ff01c0a20b0 2020-04-02T23:25:02.752 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff021086700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff01c0a1cd0 0x7ff01c0652d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:02.752 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff021086700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff01c0a1cd0 0x7ff01c0652d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40448/0 (socket says 172.21.15.42:40448) 2020-04-02T23:25:02.752 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff021887700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff01c0a67a0 0x7ff01c147640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59876/0 (socket says 172.21.15.42:59876) 2020-04-02T23:25:02.752 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff021086700 1 -- 172.21.15.42:0/3201505347 learned_addr learned my addr 172.21.15.42:0/3201505347 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:25:02.752 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff020885700 1 --2- 172.21.15.42:0/3201505347 >> v2:172.21.15.84:3300/0 conn(0x7ff01c0a20b0 0x7ff01c066bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:02.752 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff021086700 1 -- 172.21.15.42:0/3201505347 >> v2:172.21.15.84:3300/0 conn(0x7ff01c0a20b0 msgr2=0x7ff01c066bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:02.752 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff021086700 1 --2- 172.21.15.42:0/3201505347 >> v2:172.21.15.84:3300/0 conn(0x7ff01c0a20b0 0x7ff01c066bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:02.753 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff021086700 1 -- 172.21.15.42:0/3201505347 >> v1:172.21.15.42:6789/0 conn(0x7ff01c0a67a0 legacy=0x7ff01c147640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:02.753 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff00a7fc700 1 -- 172.21.15.42:0/3201505347 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874645204 0 0) 0x7ff01c0667c0 con 0x7ff01c0a67a0 2020-04-02T23:25:02.753 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff021086700 1 -- 172.21.15.42:0/3201505347 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c09d5d0 con 0x7ff01c0a1cd0 2020-04-02T23:25:02.753 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff021086700 1 --2- 172.21.15.42:0/3201505347 >> v2:172.21.15.42:3300/0 conn(0x7ff01c0a1cd0 0x7ff01c0652d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff018003070 tx=0x7ff018010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.753 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff021086700 1 --2- 172.21.15.42:0/3201505347 >> v2:172.21.15.42:3300/0 conn(0x7ff01c0a1cd0 0x7ff01c0652d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff018003070 tx=0x7ff018010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.753 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff021086700 1 --2- 172.21.15.42:0/3201505347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff01c0a1cd0 0x7ff01c0652d0 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7ff018003070 tx=0x7ff018010d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:02.753 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff021086700 1 --2- 172.21.15.42:0/3201505347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff01c0a1cd0 0x7ff01c0652d0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff018003070 tx=0x7ff018010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.753 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff00a7fc700 1 -- 172.21.15.42:0/3201505347 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff018005e90 con 0x7ff01c0a1cd0 2020-04-02T23:25:02.754 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff021086700 1 --2- 172.21.15.42:0/3201505347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff01c0a1cd0 0x7ff01c0652d0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff018003070 tx=0x7ff018010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.754 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff00a7fc700 1 -- 172.21.15.42:0/3201505347 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff018007160 con 0x7ff01c0a1cd0 2020-04-02T23:25:02.754 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff0232ea700 1 -- 172.21.15.42:0/3201505347 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01c0610f0 con 0x7ff01c0a1cd0 2020-04-02T23:25:02.754 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff021086700 1 --2- 172.21.15.42:0/3201505347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff01c0a1cd0 0x7ff01c0652d0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff018003070 tx=0x7ff018010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.754 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.740+0000 7ff00a7fc700 1 -- 172.21.15.42:0/3201505347 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff018007540 con 0x7ff01c0a1cd0 2020-04-02T23:25:02.754 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.741+0000 7ff0232ea700 1 -- 172.21.15.42:0/3201505347 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01c0632f0 con 0x7ff01c0a1cd0 2020-04-02T23:25:02.754 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.741+0000 7ff021086700 1 --2- 172.21.15.42:0/3201505347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff01c0a1cd0 0x7ff01c0652d0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff018003070 tx=0x7ff018010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.755 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.742+0000 7ff0232ea700 1 -- 172.21.15.42:0/3201505347 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01c05d2e0 con 0x7ff01c0a1cd0 2020-04-02T23:25:02.755 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.742+0000 7ff00a7fc700 1 -- 172.21.15.42:0/3201505347 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff018012430 con 0x7ff01c0a1cd0 2020-04-02T23:25:02.755 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.742+0000 7ff021086700 1 --2- 172.21.15.42:0/3201505347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff01c0a1cd0 0x7ff01c0652d0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff018003070 tx=0x7ff018010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.755 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.742+0000 7ff00a7fc700 1 --2- 172.21.15.42:0/3201505347 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7feffc04d3e0 0x7feffc04f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:02.755 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.742+0000 7ff00a7fc700 1 -- 172.21.15.42:0/3201505347 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff018061560 con 0x7ff01c0a1cd0 2020-04-02T23:25:02.756 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.742+0000 7ff020885700 1 --2- 172.21.15.42:0/3201505347 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7feffc04d3e0 0x7feffc04f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:02.756 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.742+0000 7ff020885700 1 --2- 172.21.15.42:0/3201505347 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7feffc04d3e0 0x7feffc04f8a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff00c001930 tx=0x7ff00c001b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.756 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.742+0000 7ff020885700 1 --2- 172.21.15.42:0/3201505347 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7feffc04d3e0 0x7feffc04f8a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff00c001930 tx=0x7ff00c001b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.756 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.743+0000 7ff020885700 1 --2- 172.21.15.42:0/3201505347 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7feffc04d3e0 0x7feffc04f8a0 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7ff00c001930 tx=0x7ff00c001b00).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:02.757 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.745+0000 7ff021086700 1 --2- 172.21.15.42:0/3201505347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff01c0a1cd0 0x7ff01c0652d0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff018003070 tx=0x7ff018010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.757 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.745+0000 7ff00a7fc700 1 -- 172.21.15.42:0/3201505347 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7ff01803cd00 con 0x7ff01c0a1cd0 2020-04-02T23:25:02.895 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.893+0000 7ff0232ea700 1 -- 172.21.15.42:0/3201505347 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff01c056c50 con 0x7ff01c0a1cd0 2020-04-02T23:25:02.896 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.893+0000 7ff021086700 1 --2- 172.21.15.42:0/3201505347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff01c0a1cd0 0x7ff01c0652d0 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff018003070 tx=0x7ff018010d40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:02.896 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.893+0000 7ff00a7fc700 1 -- 172.21.15.42:0/3201505347 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff018040320 con 0x7ff01c0a1cd0 2020-04-02T23:25:02.896 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 8 2020-04-02T23:25:02.897 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.895+0000 7ff0232ea700 1 -- 172.21.15.42:0/3201505347 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7feffc04d3e0 msgr2=0x7feffc04f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:02.897 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.895+0000 7ff0232ea700 1 --2- 172.21.15.42:0/3201505347 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7feffc04d3e0 0x7feffc04f8a0 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7ff00c001930 tx=0x7ff00c001b00).stop 2020-04-02T23:25:02.897 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.895+0000 7ff0232ea700 1 -- 172.21.15.42:0/3201505347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff01c0a1cd0 msgr2=0x7ff01c0652d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:02.898 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.895+0000 7ff0232ea700 1 --2- 172.21.15.42:0/3201505347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff01c0a1cd0 0x7ff01c0652d0 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7ff018003070 tx=0x7ff018010d40).stop 2020-04-02T23:25:02.898 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.895+0000 7ff0232ea700 1 -- 172.21.15.42:0/3201505347 shutdown_connections 2020-04-02T23:25:02.898 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.895+0000 7ff0232ea700 1 --2- 172.21.15.42:0/3201505347 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7feffc04d3e0 0x7feffc04f8a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:02.898 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.895+0000 7ff0232ea700 1 --2- 172.21.15.42:0/3201505347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff01c0a1cd0 0x7ff01c0652d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:02.898 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.895+0000 7ff0232ea700 1 --2- 172.21.15.42:0/3201505347 >> v2:172.21.15.84:3300/0 conn(0x7ff01c0a20b0 0x7ff01c066bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:02.898 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.895+0000 7ff0232ea700 1 -- 172.21.15.42:0/3201505347 >> 172.21.15.42:0/3201505347 conn(0x7ff01c05b720 msgr2=0x7ff01c0a6000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:25:02.898 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.895+0000 7ff0232ea700 1 -- 172.21.15.42:0/3201505347 shutdown_connections 2020-04-02T23:25:02.899 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:02.895+0000 7ff0232ea700 1 -- 172.21.15.42:0/3201505347 wait complete. 2020-04-02T23:25:02.907 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:02.921 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-04-02T23:25:03.077 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.075+0000 7f31d2f18700 1 Processor -- start 2020-04-02T23:25:03.077 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.075+0000 7f31d2f18700 1 -- start start 2020-04-02T23:25:03.080 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31d2f18700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f31cc0a1cd0 0x7f31cc0a6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:25:03.080 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31d2f18700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f31cc0a67a0 0x7f31cc0a5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:25:03.080 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31d2f18700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31cc09a8f0 con 0x7f31cc0a20b0 2020-04-02T23:25:03.080 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31d2f18700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31cc0a2680 con 0x7f31cc0a1cd0 2020-04-02T23:25:03.080 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31d2f18700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31cc09ab90 con 0x7f31cc0a67a0 2020-04-02T23:25:03.081 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31d0cb4700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f31cc0a1cd0 0x7f31cc0a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:03.081 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31c3fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f31cc0a20b0 0x7f31cc0a5250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59882/0 (socket says 172.21.15.42:59882) 2020-04-02T23:25:03.081 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31d0cb4700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f31cc0a1cd0 0x7f31cc0a6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40456/0 (socket says 172.21.15.42:40456) 2020-04-02T23:25:03.081 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31c3fff700 1 -- 172.21.15.42:0/2905625736 learned_addr learned my addr 172.21.15.42:0/2905625736 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:25:03.081 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31d14b5700 1 --2- 172.21.15.42:0/2905625736 >> v2:172.21.15.84:3300/0 conn(0x7f31cc0a67a0 0x7f31cc0a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:03.081 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31d0cb4700 1 -- 172.21.15.42:0/2905625736 >> v2:172.21.15.84:3300/0 conn(0x7f31cc0a67a0 msgr2=0x7f31cc0a5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:25:03.081 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2905625736 >> v2:172.21.15.84:3300/0 conn(0x7f31cc0a67a0 0x7f31cc0a5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:25:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31d0cb4700 1 -- 172.21.15.42:0/2905625736 >> v1:172.21.15.42:6789/0 conn(0x7f31cc0a20b0 legacy=0x7f31cc0a5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31c37fe700 1 -- 172.21.15.42:0/2905625736 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 688077446 0 0) 0x7f31cc09a8f0 con 0x7f31cc0a20b0 2020-04-02T23:25:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31d0cb4700 1 -- 172.21.15.42:0/2905625736 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc09ae30 con 0x7f31cc0a1cd0 2020-04-02T23:25:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2905625736 >> v2:172.21.15.42:3300/0 conn(0x7f31cc0a1cd0 0x7f31cc0a6340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f31c8002f30 tx=0x7f31c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2905625736 >> v2:172.21.15.42:3300/0 conn(0x7f31cc0a1cd0 0x7f31cc0a6340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f31c8002f30 tx=0x7f31c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2905625736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31cc0a1cd0 0x7f31cc0a6340 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007a40).ready entity=mon.0 client_cookie=7f7a9e209860b27 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2905625736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31cc0a1cd0 0x7f31cc0a6340 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31c37fe700 1 -- 172.21.15.42:0/2905625736 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31c8011470 con 0x7f31cc0a1cd0 2020-04-02T23:25:03.083 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2905625736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31cc0a1cd0 0x7f31cc0a6340 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.083 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31c37fe700 1 -- 172.21.15.42:0/2905625736 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c80115d0 con 0x7f31cc0a1cd0 2020-04-02T23:25:03.083 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2905625736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31cc0a1cd0 0x7f31cc0a6340 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.083 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31c37fe700 1 -- 172.21.15.42:0/2905625736 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31c80119b0 con 0x7f31cc0a1cd0 2020-04-02T23:25:03.083 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31d2f18700 1 -- 172.21.15.42:0/2905625736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31cc0a1cd0 msgr2=0x7f31cc0a6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:03.083 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.076+0000 7f31d2f18700 1 --2- 172.21.15.42:0/2905625736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31cc0a1cd0 0x7f31cc0a6340 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007a40).stop 2020-04-02T23:25:03.083 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.077+0000 7f31d2f18700 1 -- 172.21.15.42:0/2905625736 shutdown_connections 2020-04-02T23:25:03.084 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.077+0000 7f31d2f18700 1 --2- 172.21.15.42:0/2905625736 >> v2:172.21.15.84:3300/0 conn(0x7f31cc0a67a0 0x7f31cc0a5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:25:03.084 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.077+0000 7f31d2f18700 1 --2- 172.21.15.42:0/2905625736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31cc0a1cd0 0x7f31cc0a6340 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:03.084 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.077+0000 7f31d2f18700 1 -- 172.21.15.42:0/2905625736 >> 172.21.15.42:0/2905625736 conn(0x7f31cc05b720 msgr2=0x7f31cc0aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:25:03.084 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.077+0000 7f31d2f18700 1 -- 172.21.15.42:0/2905625736 shutdown_connections 2020-04-02T23:25:03.084 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.077+0000 7f31d2f18700 1 -- 172.21.15.42:0/2905625736 wait complete. 2020-04-02T23:25:03.084 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.078+0000 7f31d2f18700 1 Processor -- start 2020-04-02T23:25:03.084 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.078+0000 7f31d2f18700 1 -- start start 2020-04-02T23:25:03.089 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31d2f18700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31cc0a1cd0 0x7f31cc1383b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:03.089 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31d2f18700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f31cc0a67a0 0x7f31cc062340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:03.089 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31d2f18700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31cc138810 con 0x7f31cc0a20b0 2020-04-02T23:25:03.090 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31d2f18700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31cc1379d0 con 0x7f31cc0a67a0 2020-04-02T23:25:03.090 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31d2f18700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc137c70 con 0x7f31cc0a1cd0 2020-04-02T23:25:03.090 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31c3fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f31cc0a20b0 0x7f31cc0637f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59888/0 (socket says 172.21.15.42:59888) 2020-04-02T23:25:03.090 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31c3fff700 1 -- 172.21.15.42:0/2398314060 learned_addr learned my addr 172.21.15.42:0/2398314060 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:25:03.090 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31cc0a1cd0 0x7f31cc1383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:03.090 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31c1ffb700 1 -- 172.21.15.42:0/2398314060 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192805783 0 0) 0x7f31cc138810 con 0x7f31cc0a20b0 2020-04-02T23:25:03.090 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31d14b5700 1 --2- 172.21.15.42:0/2398314060 >> v2:172.21.15.84:3300/0 conn(0x7f31cc0a67a0 0x7f31cc062340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:03.091 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31c1ffb700 1 -- 172.21.15.42:0/2398314060 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31ac002fe0 con 0x7f31cc0a20b0 2020-04-02T23:25:03.091 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31c1ffb700 1 -- 172.21.15.42:0/2398314060 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1660026513 0 0) 0x7f31ac002fe0 con 0x7f31cc0a20b0 2020-04-02T23:25:03.091 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31c1ffb700 1 -- 172.21.15.42:0/2398314060 --> v1:172.21.15.42:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f31cc138810 con 0x7f31cc0a20b0 2020-04-02T23:25:03.091 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31c1ffb700 1 -- 172.21.15.42:0/2398314060 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7f31bc001860 con 0x7f31cc0a20b0 2020-04-02T23:25:03.091 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31c1ffb700 1 -- 172.21.15.42:0/2398314060 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31cc0a1cd0 msgr2=0x7f31cc1383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:03.091 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31c1ffb700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31cc0a1cd0 0x7f31cc1383b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:03.091 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31c1ffb700 1 -- 172.21.15.42:0/2398314060 >> v2:172.21.15.84:3300/0 conn(0x7f31cc0a67a0 msgr2=0x7f31cc062340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:03.091 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31c1ffb700 1 --2- 172.21.15.42:0/2398314060 >> v2:172.21.15.84:3300/0 conn(0x7f31cc0a67a0 0x7f31cc062340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:03.092 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31c1ffb700 1 -- 172.21.15.42:0/2398314060 >> v1:172.21.15.42:6789/0 conn(0x7f31cc0a20b0 legacy=0x7f31cc0637f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:03.092 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31c1ffb700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ac0049b0 0x7f31ac004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:03.092 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31c1ffb700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31ac003920 0x7f31ac003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:03.092 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31c1ffb700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31ac0041c0 0x7f31ac00b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:03.092 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31c1ffb700 1 -- 172.21.15.42:0/2398314060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc1379d0 con 0x7f31ac0049b0 2020-04-02T23:25:03.092 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31c1ffb700 1 -- 172.21.15.42:0/2398314060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc137c70 con 0x7f31ac0041c0 2020-04-02T23:25:03.092 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31c1ffb700 1 -- 172.21.15.42:0/2398314060 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac0046c0 con 0x7f31ac003920 2020-04-02T23:25:03.093 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31cc0a1cd0 0x7f31cc1383b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:25:03.093 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31d14b5700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31ac0041c0 0x7f31ac00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:03.093 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ac0049b0 0x7f31ac004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:03.093 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.079+0000 7f31c3fff700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31ac003920 0x7f31ac003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:03.093 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.080+0000 7f31d0cb4700 1 -- 172.21.15.42:0/2398314060 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31ac003920 msgr2=0x7f31ac003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:03.093 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.080+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f31ac003920 0x7f31ac003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:03.093 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.080+0000 7f31d0cb4700 1 -- 172.21.15.42:0/2398314060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31ac0041c0 msgr2=0x7f31ac00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:03.093 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.080+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31ac0041c0 0x7f31ac00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:03.094 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.080+0000 7f31d0cb4700 1 -- 172.21.15.42:0/2398314060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc137f10 con 0x7f31ac0049b0 2020-04-02T23:25:03.094 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.080+0000 7f31d2f18700 1 -- 172.21.15.42:0/2398314060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31cc09dc80 con 0x7f31ac0049b0 2020-04-02T23:25:03.094 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.080+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ac0049b0 0x7f31ac004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.094 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.080+0000 7f31d2f18700 1 -- 172.21.15.42:0/2398314060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31cc09d680 con 0x7f31ac0049b0 2020-04-02T23:25:03.094 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.080+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ac0049b0 0x7f31ac004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.094 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.080+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ac0049b0 0x7f31ac004dd0 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:03.094 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.080+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ac0049b0 0x7f31ac004dd0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.095 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.080+0000 7f31c1ffb700 1 -- 172.21.15.42:0/2398314060 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31c8007150 con 0x7f31ac0049b0 2020-04-02T23:25:03.095 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.080+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ac0049b0 0x7f31ac004dd0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.095 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.080+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ac0049b0 0x7f31ac004dd0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.095 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.080+0000 7f31c1ffb700 1 -- 172.21.15.42:0/2398314060 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c80072b0 con 0x7f31ac0049b0 2020-04-02T23:25:03.095 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.080+0000 7f31c1ffb700 1 -- 172.21.15.42:0/2398314060 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31c80056c0 con 0x7f31ac0049b0 2020-04-02T23:25:03.095 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.081+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ac0049b0 0x7f31ac004dd0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.095 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.081+0000 7f31d2f18700 1 -- 172.21.15.42:0/2398314060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a8003340 con 0x7f31ac0049b0 2020-04-02T23:25:03.095 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.081+0000 7f31c1ffb700 1 -- 172.21.15.42:0/2398314060 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f31c8005820 con 0x7f31ac0049b0 2020-04-02T23:25:03.096 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.081+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ac0049b0 0x7f31ac004dd0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.096 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.081+0000 7f31c1ffb700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f31ac055c80 0x7f31ac058140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:03.096 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.081+0000 7f31c1ffb700 1 -- 172.21.15.42:0/2398314060 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f31c8061450 con 0x7f31ac0049b0 2020-04-02T23:25:03.096 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.082+0000 7f31c3fff700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f31ac055c80 0x7f31ac058140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:03.096 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.082+0000 7f31c3fff700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f31ac055c80 0x7f31ac058140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f31bc005540 tx=0x7f31bc008d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.096 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.082+0000 7f31c3fff700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f31ac055c80 0x7f31ac058140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f31bc005540 tx=0x7f31bc008d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.097 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.082+0000 7f31c3fff700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f31ac055c80 0x7f31ac058140 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f31bc005540 tx=0x7f31bc008d30).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:03.097 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.085+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ac0049b0 0x7f31ac004dd0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.097 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.085+0000 7f31c1ffb700 1 -- 172.21.15.42:0/2398314060 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f31c803cc50 con 0x7f31ac0049b0 2020-04-02T23:25:03.235 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.233+0000 7f31d2f18700 1 -- 172.21.15.42:0/2398314060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f31a8002200 con 0x7f31ac0049b0 2020-04-02T23:25:03.235 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.233+0000 7f31d0cb4700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ac0049b0 0x7f31ac004dd0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.236 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.233+0000 7f31c1ffb700 1 -- 172.21.15.42:0/2398314060 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+10 (secure 0 0 0) 0x7f31c8040270 con 0x7f31ac0049b0 2020-04-02T23:25:03.236 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 8 2020-04-02T23:25:03.237 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.234+0000 7f31d2f18700 1 -- 172.21.15.42:0/2398314060 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f31ac055c80 msgr2=0x7f31ac058140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:03.237 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.234+0000 7f31d2f18700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f31ac055c80 0x7f31ac058140 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7f31bc005540 tx=0x7f31bc008d30).stop 2020-04-02T23:25:03.237 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.234+0000 7f31d2f18700 1 -- 172.21.15.42:0/2398314060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ac0049b0 msgr2=0x7f31ac004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:03.237 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.234+0000 7f31d2f18700 1 --2- 172.21.15.42:0/2398314060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31ac0049b0 0x7f31ac004dd0 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7f31c8002f30 tx=0x7f31c8007a40).stop 2020-04-02T23:25:03.238 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.234+0000 7f31d14b5700 1 -- 172.21.15.42:0/2398314060 reap_dead start 2020-04-02T23:25:03.238 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.235+0000 7f31d2f18700 1 -- 172.21.15.42:0/2398314060 shutdown_connections 2020-04-02T23:25:03.238 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.235+0000 7f31d2f18700 1 -- 172.21.15.42:0/2398314060 >> 172.21.15.42:0/2398314060 conn(0x7f31cc05b720 msgr2=0x7f31cc069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:25:03.238 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.235+0000 7f31d2f18700 1 -- 172.21.15.42:0/2398314060 shutdown_connections 2020-04-02T23:25:03.238 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.235+0000 7f31d2f18700 1 -- 172.21.15.42:0/2398314060 wait complete. 2020-04-02T23:25:03.247 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-04-02T23:25:03.247 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:03.261 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-04-02T23:25:03.417 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.412+0000 7f49fb937700 1 Processor -- start 2020-04-02T23:25:03.418 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.412+0000 7f49fb937700 1 -- start start 2020-04-02T23:25:03.418 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.413+0000 7f49fb937700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f49f40a1cd0 0x7f49f40a6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:25:03.418 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.413+0000 7f49fb937700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f40a6070 con 0x7f49f40a67a0 2020-04-02T23:25:03.418 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.413+0000 7f49fb937700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f40a25f0 con 0x7f49f40a20b0 2020-04-02T23:25:03.418 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.413+0000 7f49fb937700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f409a8f0 con 0x7f49f40a1cd0 2020-04-02T23:25:03.418 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.413+0000 7f49f96d3700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f49f40a1cd0 0x7f49f40a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:03.418 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.413+0000 7f49f9ed4700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f49f40a67a0 0x7f49f40a5960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59904/0 (socket says 172.21.15.42:59904) 2020-04-02T23:25:03.419 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.413+0000 7f49f9ed4700 1 -- 172.21.15.42:0/4291477136 learned_addr learned my addr 172.21.15.42:0/4291477136 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:25:03.419 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.413+0000 7f49f96d3700 1 -- 172.21.15.42:0/4291477136 >> v1:172.21.15.84:6789/0 conn(0x7f49f40a20b0 legacy=0x7f49f40a5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:03.419 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.413+0000 7f49f96d3700 1 -- 172.21.15.42:0/4291477136 >> v1:172.21.15.42:6789/0 conn(0x7f49f40a67a0 legacy=0x7f49f40a5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:03.419 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.413+0000 7f49e3fff700 1 -- 172.21.15.42:0/4291477136 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573603305 0 0) 0x7f49f40a6070 con 0x7f49f40a67a0 2020-04-02T23:25:03.419 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.413+0000 7f49f96d3700 1 -- 172.21.15.42:0/4291477136 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f409ab90 con 0x7f49f40a1cd0 2020-04-02T23:25:03.419 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.413+0000 7f49f96d3700 1 --2- 172.21.15.42:0/4291477136 >> v2:172.21.15.42:3300/0 conn(0x7f49f40a1cd0 0x7f49f40a6340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f49e4002f30 tx=0x7f49e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.419 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.413+0000 7f49f96d3700 1 --2- 172.21.15.42:0/4291477136 >> v2:172.21.15.42:3300/0 conn(0x7f49f40a1cd0 0x7f49f40a6340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f49e4002f30 tx=0x7f49e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.420 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.413+0000 7f49f96d3700 1 --2- 172.21.15.42:0/4291477136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f40a1cd0 0x7f49f40a6340 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e4007a40).ready entity=mon.0 client_cookie=f8b5befb6547b873 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:03.420 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.414+0000 7f49f96d3700 1 --2- 172.21.15.42:0/4291477136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f40a1cd0 0x7f49f40a6340 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.420 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.414+0000 7f49e3fff700 1 -- 172.21.15.42:0/4291477136 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49e4011470 con 0x7f49f40a1cd0 2020-04-02T23:25:03.420 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.414+0000 7f49f96d3700 1 --2- 172.21.15.42:0/4291477136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f40a1cd0 0x7f49f40a6340 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.420 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.414+0000 7f49e3fff700 1 -- 172.21.15.42:0/4291477136 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e40115d0 con 0x7f49f40a1cd0 2020-04-02T23:25:03.420 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.414+0000 7f49f96d3700 1 --2- 172.21.15.42:0/4291477136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f40a1cd0 0x7f49f40a6340 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.420 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.414+0000 7f49e3fff700 1 -- 172.21.15.42:0/4291477136 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49e40119b0 con 0x7f49f40a1cd0 2020-04-02T23:25:03.420 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.414+0000 7f49fb937700 1 -- 172.21.15.42:0/4291477136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f40a1cd0 msgr2=0x7f49f40a6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:03.421 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.414+0000 7f49fb937700 1 --2- 172.21.15.42:0/4291477136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f40a1cd0 0x7f49f40a6340 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e4007a40).stop 2020-04-02T23:25:03.421 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.414+0000 7f49fb937700 1 -- 172.21.15.42:0/4291477136 shutdown_connections 2020-04-02T23:25:03.421 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.414+0000 7f49fb937700 1 --2- 172.21.15.42:0/4291477136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f40a1cd0 0x7f49f40a6340 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:03.421 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.414+0000 7f49fb937700 1 -- 172.21.15.42:0/4291477136 >> 172.21.15.42:0/4291477136 conn(0x7f49f405b720 msgr2=0x7f49f40aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:25:03.421 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.414+0000 7f49fb937700 1 -- 172.21.15.42:0/4291477136 shutdown_connections 2020-04-02T23:25:03.421 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.414+0000 7f49fb937700 1 -- 172.21.15.42:0/4291477136 wait complete. 2020-04-02T23:25:03.421 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.415+0000 7f49fb937700 1 Processor -- start 2020-04-02T23:25:03.422 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.415+0000 7f49fb937700 1 -- start start 2020-04-02T23:25:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49fb937700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49f40a1cd0 0x7f49f4064420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49fb937700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f49f40a67a0 0x7f49f4062680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49fb937700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f4062ae0 con 0x7f49f40a20b0 2020-04-02T23:25:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49fb937700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f4061590 con 0x7f49f40a67a0 2020-04-02T23:25:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49fb937700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f4061830 con 0x7f49f40a1cd0 2020-04-02T23:25:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49f8ed2700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f49f40a20b0 0x7f49f409d000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59908/0 (socket says 172.21.15.42:59908) 2020-04-02T23:25:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49f8ed2700 1 -- 172.21.15.42:0/1215274552 learned_addr learned my addr 172.21.15.42:0/1215274552 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:25:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49f9ed4700 1 --2- 172.21.15.42:0/1215274552 >> v2:172.21.15.42:3300/0 conn(0x7f49f40a67a0 0x7f49f4062680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49f96d3700 1 --2- 172.21.15.42:0/1215274552 >> v2:172.21.15.84:3300/0 conn(0x7f49f40a1cd0 0x7f49f4064420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49e27fc700 1 -- 172.21.15.42:0/1215274552 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423935698 0 0) 0x7f49f40a25f0 con 0x7f49f40a20b0 2020-04-02T23:25:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49e27fc700 1 -- 172.21.15.42:0/1215274552 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49d4002fe0 con 0x7f49f40a20b0 2020-04-02T23:25:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49f9ed4700 1 -- 172.21.15.42:0/1215274552 >> v2:172.21.15.84:3300/0 conn(0x7f49f40a1cd0 msgr2=0x7f49f4064420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49f9ed4700 1 --2- 172.21.15.42:0/1215274552 >> v2:172.21.15.84:3300/0 conn(0x7f49f40a1cd0 0x7f49f4064420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49f9ed4700 1 -- 172.21.15.42:0/1215274552 >> v1:172.21.15.42:6789/0 conn(0x7f49f40a20b0 legacy=0x7f49f409d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49f9ed4700 1 -- 172.21.15.42:0/1215274552 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f409d710 con 0x7f49f40a67a0 2020-04-02T23:25:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49f9ed4700 1 --2- 172.21.15.42:0/1215274552 >> v2:172.21.15.42:3300/0 conn(0x7f49f40a67a0 0x7f49f4062680 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49ec001210 tx=0x7f49ec010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49f9ed4700 1 --2- 172.21.15.42:0/1215274552 >> v2:172.21.15.42:3300/0 conn(0x7f49f40a67a0 0x7f49f4062680 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49ec001210 tx=0x7f49ec010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49f9ed4700 1 --2- 172.21.15.42:0/1215274552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f40a67a0 0x7f49f4062680 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7f49ec001210 tx=0x7f49ec010be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49f9ed4700 1 --2- 172.21.15.42:0/1215274552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f40a67a0 0x7f49f4062680 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f49ec001210 tx=0x7f49ec010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49e27fc700 1 -- 172.21.15.42:0/1215274552 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49ec005e30 con 0x7f49f40a67a0 2020-04-02T23:25:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49f9ed4700 1 --2- 172.21.15.42:0/1215274552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f40a67a0 0x7f49f4062680 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f49ec001210 tx=0x7f49ec010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49f9ed4700 1 --2- 172.21.15.42:0/1215274552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f40a67a0 0x7f49f4062680 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f49ec001210 tx=0x7f49ec010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49e27fc700 1 -- 172.21.15.42:0/1215274552 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ec0123c0 con 0x7f49f40a67a0 2020-04-02T23:25:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49e27fc700 1 -- 172.21.15.42:0/1215274552 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49ec0127e0 con 0x7f49f40a67a0 2020-04-02T23:25:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.416+0000 7f49fb937700 1 -- 172.21.15.42:0/1215274552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f4062110 con 0x7f49f40a67a0 2020-04-02T23:25:03.429 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.417+0000 7f49fb937700 1 -- 172.21.15.42:0/1215274552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f40612b0 con 0x7f49f40a67a0 2020-04-02T23:25:03.429 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.417+0000 7f49f9ed4700 1 --2- 172.21.15.42:0/1215274552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f40a67a0 0x7f49f4062680 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f49ec001210 tx=0x7f49ec010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.429 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.418+0000 7f49e27fc700 1 -- 172.21.15.42:0/1215274552 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f49ec012aa0 con 0x7f49f40a67a0 2020-04-02T23:25:03.429 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.418+0000 7f49f9ed4700 1 --2- 172.21.15.42:0/1215274552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f40a67a0 0x7f49f4062680 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f49ec001210 tx=0x7f49ec010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.429 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.418+0000 7f49fb937700 1 -- 172.21.15.42:0/1215274552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f405d2e0 con 0x7f49f40a67a0 2020-04-02T23:25:03.429 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.418+0000 7f49e27fc700 1 --2- 172.21.15.42:0/1215274552 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f49d404d880 0x7f49d404fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:25:03.429 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.418+0000 7f49e27fc700 1 -- 172.21.15.42:0/1215274552 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f49ec061380 con 0x7f49f40a67a0 2020-04-02T23:25:03.429 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.418+0000 7f49f96d3700 1 --2- 172.21.15.42:0/1215274552 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f49d404d880 0x7f49d404fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:25:03.430 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.418+0000 7f49f96d3700 1 --2- 172.21.15.42:0/1215274552 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f49d404d880 0x7f49d404fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.430 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.418+0000 7f49f96d3700 1 --2- 172.21.15.42:0/1215274552 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f49d404d880 0x7f49d404fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.430 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.418+0000 7f49f96d3700 1 --2- 172.21.15.42:0/1215274552 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f49d404d880 0x7f49d404fd40 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e4007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:25:03.430 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.421+0000 7f49f9ed4700 1 --2- 172.21.15.42:0/1215274552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f40a67a0 0x7f49f4062680 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f49ec001210 tx=0x7f49ec010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.430 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.421+0000 7f49e27fc700 1 -- 172.21.15.42:0/1215274552 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f49ec03ca00 con 0x7f49f40a67a0 2020-04-02T23:25:03.617 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.614+0000 7f49fb937700 1 -- 172.21.15.42:0/1215274552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49f4056c50 con 0x7f49f40a67a0 2020-04-02T23:25:03.617 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.615+0000 7f49f9ed4700 1 --2- 172.21.15.42:0/1215274552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f40a67a0 0x7f49f4062680 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f49ec001210 tx=0x7f49ec010be0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:25:03.617 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.615+0000 7f49e27fc700 1 -- 172.21.15.42:0/1215274552 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2128 (secure 0 0 0) 0x7f49ec040020 con 0x7f49f40a67a0 2020-04-02T23:25:03.617 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:25:03.617 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4350,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3351276327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3351276327},{"type":"v1","addr":"172.21.15.84:6835","nonce":3351276327}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-04-02T23:24:48.394016+0000","modified":"2020-04-02T23:24:52.010614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4359":{"gid":4359,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.42:6833/81442033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":81442033},{"type":"v1","addr":"172.21.15.42:6833","nonce":81442033}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-04-02T23:25:03.618 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.616+0000 7f49fb937700 1 -- 172.21.15.42:0/1215274552 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f49d404d880 msgr2=0x7f49d404fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:03.619 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.616+0000 7f49fb937700 1 --2- 172.21.15.42:0/1215274552 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f49d404d880 0x7f49d404fd40 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f49e4002f30 tx=0x7f49e4007a40).stop 2020-04-02T23:25:03.619 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.616+0000 7f49fb937700 1 -- 172.21.15.42:0/1215274552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f40a67a0 msgr2=0x7f49f4062680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:25:03.619 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.616+0000 7f49fb937700 1 --2- 172.21.15.42:0/1215274552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f40a67a0 0x7f49f4062680 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7f49ec001210 tx=0x7f49ec010be0).stop 2020-04-02T23:25:03.619 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.616+0000 7f49fb937700 1 -- 172.21.15.42:0/1215274552 shutdown_connections 2020-04-02T23:25:03.619 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.616+0000 7f49fb937700 1 --2- 172.21.15.42:0/1215274552 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f49d404d880 0x7f49d404fd40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:03.619 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.616+0000 7f49fb937700 1 --2- 172.21.15.42:0/1215274552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f49f40a67a0 0x7f49f4062680 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:03.620 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.616+0000 7f49fb937700 1 --2- 172.21.15.42:0/1215274552 >> v2:172.21.15.84:3300/0 conn(0x7f49f40a1cd0 0x7f49f4064420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:25:03.620 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.616+0000 7f49fb937700 1 -- 172.21.15.42:0/1215274552 >> 172.21.15.42:0/1215274552 conn(0x7f49f405b720 msgr2=0x7f49f40a71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:25:03.620 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.616+0000 7f49fb937700 1 -- 172.21.15.42:0/1215274552 shutdown_connections 2020-04-02T23:25:03.620 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:25:03.616+0000 7f49fb937700 1 -- 172.21.15.42:0/1215274552 wait complete. 2020-04-02T23:25:03.620 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 6 2020-04-02T23:25:03.830 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4359}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 3, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [4], u'info': {u'gid_4359': {u'export_targets': [], u'name': u'a', u'incarnation': 5, u'state_seq': 2, u'state': u'up:active', u'gid': 4359, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 81442033, u'type': u'v2', u'addr': u'172.21.15.42:6832'}, {u'nonce': 81442033, u'type': u'v1', u'addr': u'172.21.15.42:6833'}]}, u'addr': u'172.21.15.42:6833/81442033'}}, u'fs_name': u'cephfs', u'created': u'2020-04-02T23:24:48.394016+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-04-02T23:24:52.010614+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-04-02T23:25:03.830 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-04-02T23:25:03.830 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:03.844 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2020-04-02T23:25:04.013 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2020-04-02T23:25:04.014 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "571c521c-9ca7-4052-ba5b-7a77e18ff12c", 2020-04-02T23:25:04.014 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2020-04-02T23:25:04.014 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4359, 2020-04-02T23:25:04.014 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2020-04-02T23:25:04.014 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2020-04-02T23:25:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 13.000816302, 2020-04-02T23:25:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 6, 2020-04-02T23:25:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 26, 2020-04-02T23:25:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 26, 2020-04-02T23:25:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 13.063272005 2020-04-02T23:25:04.015 INFO:teuthology.orchestra.run.smithi042.stdout:} 2020-04-02T23:25:04.022 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "571c521c-9ca7-4052-ba5b-7a77e18ff12c", "whoami": 0, "id": 4359, "want_state": "up:active", "state": "up:active", "rank_uptime": 13.000816302, "mdsmap_epoch": 6, "osdmap_epoch": 26, "osdmap_epoch_barrier": 26, "uptime": 13.063272005 } 2020-04-02T23:25:04.022 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-04-02T23:25:04.023 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-04-02T23:25:04.023 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi042.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-04-02T23:25:04.023 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:04.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:25:04.037 INFO:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec mkdir -p /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:25:04.095 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:04.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:25:04.145 INFO:teuthology.orchestra.run.smithi042:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-02T23:25:04.217 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-02T23:25:04.222 INFO:teuthology.orchestra.run.smithi042.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-04-02T23:25:04.222 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:04.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:25:04.272 INFO:teuthology.orchestra.run.smithi042:> ls /sys/fs/fuse/connections 2020-04-02T23:25:04.326 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-04-02T23:25:04.330 INFO:teuthology.orchestra.run.smithi042.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-04-02T23:25:04.330 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-04-02T23:25:04.330 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:04.384 INFO:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:25:04.427 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:04.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:25:04.441 INFO:teuthology.orchestra.run.smithi042:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-02T23:25:04.506 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi042.stderr:2020-04-02T23:25:04.504+0000 7fd652a731c0 -1 init, newargv = 0x5641c201fb20 newargc=7 2020-04-02T23:25:04.506 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi042.stderr:ceph-fuse[29107]: starting ceph client 2020-04-02T23:25:04.514 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-04-02T23:25:04.517 INFO:teuthology.orchestra.run.smithi042.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-04-02T23:25:04.517 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:04.545 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi042.stderr:ceph-fuse[29107]: starting fuse 2020-04-02T23:25:04.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:25:04.560 INFO:teuthology.orchestra.run.smithi042:> ls /sys/fs/fuse/connections 2020-04-02T23:25:05.720 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:05.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:25:05.738 INFO:teuthology.orchestra.run.smithi042:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-04-02T23:25:05.844 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:05.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:25:05.871 INFO:teuthology.orchestra.run.smithi042:> ls /sys/fs/fuse/connections 2020-04-02T23:25:05.929 INFO:teuthology.orchestra.run.smithi042.stdout:45 2020-04-02T23:25:05.929 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2020-04-02T23:25:05.930 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:05.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:25:05.984 INFO:teuthology.orchestra.run.smithi042:> sudo python3 -c ' 2020-04-02T23:25:05.984 INFO:teuthology.orchestra.run.smithi042:> import glob 2020-04-02T23:25:05.984 INFO:teuthology.orchestra.run.smithi042:> import re 2020-04-02T23:25:05.984 INFO:teuthology.orchestra.run.smithi042:> import os 2020-04-02T23:25:05.984 INFO:teuthology.orchestra.run.smithi042:> import subprocess 2020-04-02T23:25:05.985 INFO:teuthology.orchestra.run.smithi042:> 2020-04-02T23:25:05.985 INFO:teuthology.orchestra.run.smithi042:> def find_socket(client_name): 2020-04-02T23:25:05.985 INFO:teuthology.orchestra.run.smithi042:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-04-02T23:25:05.985 INFO:teuthology.orchestra.run.smithi042:> files = glob.glob(asok_path) 2020-04-02T23:25:05.985 INFO:teuthology.orchestra.run.smithi042:> 2020-04-02T23:25:05.985 INFO:teuthology.orchestra.run.smithi042:> # Given a non-glob path, it better be there 2020-04-02T23:25:05.985 INFO:teuthology.orchestra.run.smithi042:> if "*" not in asok_path: 2020-04-02T23:25:05.985 INFO:teuthology.orchestra.run.smithi042:> assert(len(files) == 1) 2020-04-02T23:25:05.986 INFO:teuthology.orchestra.run.smithi042:> return files[0] 2020-04-02T23:25:05.986 INFO:teuthology.orchestra.run.smithi042:> 2020-04-02T23:25:05.986 INFO:teuthology.orchestra.run.smithi042:> for f in files: 2020-04-02T23:25:05.986 INFO:teuthology.orchestra.run.smithi042:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-04-02T23:25:05.986 INFO:teuthology.orchestra.run.smithi042:> if os.path.exists("/proc/{0}".format(pid)): 2020-04-02T23:25:05.986 INFO:teuthology.orchestra.run.smithi042:> return f 2020-04-02T23:25:05.986 INFO:teuthology.orchestra.run.smithi042:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-04-02T23:25:05.986 INFO:teuthology.orchestra.run.smithi042:> 2020-04-02T23:25:05.987 INFO:teuthology.orchestra.run.smithi042:> print(find_socket("client.0")) 2020-04-02T23:25:05.987 INFO:teuthology.orchestra.run.smithi042:> ' 2020-04-02T23:25:06.092 INFO:teuthology.orchestra.run.smithi042.stdout:/var/run/ceph/ceph-client.0.29107.asok 2020-04-02T23:25:06.093 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.29107.asok 2020-04-02T23:25:06.093 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:06.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:25:06.108 INFO:teuthology.orchestra.run.smithi042:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.29107.asok status 2020-04-02T23:25:06.269 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2020-04-02T23:25:06.269 INFO:teuthology.orchestra.run.smithi042.stdout: "metadata": { 2020-04-02T23:25:06.269 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_sha1": "cbb84f71d70460f911296715ab61ac09c6962b17", 2020-04-02T23:25:06.269 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_version": "ceph version 16.0.0-316-gcbb84f7 (cbb84f71d70460f911296715ab61ac09c6962b17) octopus (rc)", 2020-04-02T23:25:06.269 INFO:teuthology.orchestra.run.smithi042.stdout: "entity_id": "0", 2020-04-02T23:25:06.269 INFO:teuthology.orchestra.run.smithi042.stdout: "hostname": "smithi042", 2020-04-02T23:25:06.270 INFO:teuthology.orchestra.run.smithi042.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-04-02T23:25:06.270 INFO:teuthology.orchestra.run.smithi042.stdout: "pid": "29107", 2020-04-02T23:25:06.270 INFO:teuthology.orchestra.run.smithi042.stdout: "root": "/" 2020-04-02T23:25:06.270 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:25:06.270 INFO:teuthology.orchestra.run.smithi042.stdout: "dentry_count": 0, 2020-04-02T23:25:06.270 INFO:teuthology.orchestra.run.smithi042.stdout: "dentry_pinned_count": 0, 2020-04-02T23:25:06.270 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4645, 2020-04-02T23:25:06.271 INFO:teuthology.orchestra.run.smithi042.stdout: "inst": { 2020-04-02T23:25:06.271 INFO:teuthology.orchestra.run.smithi042.stdout: "name": { 2020-04-02T23:25:06.271 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "client", 2020-04-02T23:25:06.271 INFO:teuthology.orchestra.run.smithi042.stdout: "num": 4645 2020-04-02T23:25:06.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:25:06.271 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": { 2020-04-02T23:25:06.271 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2020-04-02T23:25:06.272 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:0", 2020-04-02T23:25:06.272 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 668521785 2020-04-02T23:25:06.272 INFO:teuthology.orchestra.run.smithi042.stdout: } 2020-04-02T23:25:06.272 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:25:06.272 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": { 2020-04-02T23:25:06.272 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2020-04-02T23:25:06.272 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:0", 2020-04-02T23:25:06.272 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 668521785 2020-04-02T23:25:06.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:25:06.273 INFO:teuthology.orchestra.run.smithi042.stdout: "inst_str": "client.4645 172.21.15.42:0/668521785", 2020-04-02T23:25:06.273 INFO:teuthology.orchestra.run.smithi042.stdout: "addr_str": "172.21.15.42:0/668521785", 2020-04-02T23:25:06.273 INFO:teuthology.orchestra.run.smithi042.stdout: "inode_count": 1, 2020-04-02T23:25:06.273 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_epoch": 6, 2020-04-02T23:25:06.273 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_epoch": 26, 2020-04-02T23:25:06.273 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_epoch_barrier": 0, 2020-04-02T23:25:06.274 INFO:teuthology.orchestra.run.smithi042.stdout: "blacklisted": false 2020-04-02T23:25:06.274 INFO:teuthology.orchestra.run.smithi042.stdout:} 2020-04-02T23:25:06.319 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:06.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:25:06.334 INFO:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-02T23:25:06.334 INFO:teuthology.orchestra.run.smithi042:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:25:06.393 INFO:teuthology.orchestra.run.smithi042.stdout:fuseblk 2020-04-02T23:25:06.393 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-02T23:25:06.394 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:06.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:25:06.442 INFO:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:25:06.518 INFO:teuthology.run_tasks:Running task check-counter... 2020-04-02T23:25:06.537 INFO:teuthology.run_tasks:Running task workunit... 2020-04-02T23:25:06.558 INFO:tasks.workunit:Pulling workunits from ref cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:25:06.559 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-04-02T23:25:06.559 INFO:tasks.workunit:timeout=3h 2020-04-02T23:25:06.559 INFO:tasks.workunit:cleanup=True 2020-04-02T23:25:06.559 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:06.578 INFO:teuthology.orchestra.run.smithi042:> stat -- /home/ubuntu/cephtest/mnt.0 2020-04-02T23:25:06.633 INFO:teuthology.orchestra.run.smithi042.stdout: File: /home/ubuntu/cephtest/mnt.0 2020-04-02T23:25:06.634 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2020-04-02T23:25:06.634 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 2dh/45d Inode: 1 Links: 2 2020-04-02T23:25:06.634 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-02T23:25:06.634 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:fusefs_t:s0 2020-04-02T23:25:06.634 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2020-04-02T23:25:06.634 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2020-04-02 23:24:51.011995467 +0000 2020-04-02T23:25:06.634 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2020-04-02 23:25:06.511854671 +0000 2020-04-02T23:25:06.635 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: - 2020-04-02T23:25:06.635 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2020-04-02T23:25:06.635 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:06.688 INFO:teuthology.orchestra.run.smithi042:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2020-04-02T23:25:06.765 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:06.818 INFO:teuthology.orchestra.run.smithi042:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout cbb84f71d70460f911296715ab61ac09c6962b17 2020-04-02T23:25:06.926 INFO:tasks.workunit.client.0.smithi042.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-04-02T23:25:09.016 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:09.033 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:25:09.076 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:25:09.093 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:25:39.186 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:39.203 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:25:39.246 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:25:39.262 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:25:42.442 INFO:tasks.workunit.client.0.smithi042.stderr:Note: checking out 'cbb84f71d70460f911296715ab61ac09c6962b17'. 2020-04-02T23:25:42.442 INFO:tasks.workunit.client.0.smithi042.stderr: 2020-04-02T23:25:42.443 INFO:tasks.workunit.client.0.smithi042.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-04-02T23:25:42.443 INFO:tasks.workunit.client.0.smithi042.stderr:changes and commit them, and you can discard any commits you make in this 2020-04-02T23:25:42.443 INFO:tasks.workunit.client.0.smithi042.stderr:state without impacting any branches by performing another checkout. 2020-04-02T23:25:42.443 INFO:tasks.workunit.client.0.smithi042.stderr: 2020-04-02T23:25:42.443 INFO:tasks.workunit.client.0.smithi042.stderr:If you want to create a new branch to retain commits you create, you may 2020-04-02T23:25:42.443 INFO:tasks.workunit.client.0.smithi042.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-04-02T23:25:42.443 INFO:tasks.workunit.client.0.smithi042.stderr: 2020-04-02T23:25:42.443 INFO:tasks.workunit.client.0.smithi042.stderr: git checkout -b 2020-04-02T23:25:42.444 INFO:tasks.workunit.client.0.smithi042.stderr: 2020-04-02T23:25:42.444 INFO:tasks.workunit.client.0.smithi042.stderr:HEAD is now at cbb84f71d7 Merge branch 'fs-qa-vstart_runner.LocalRemote.sh' of https://github.com/rishabh-d-dave/ceph into wip-greg-testing-42 2020-04-02T23:25:42.447 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:42.461 INFO:teuthology.orchestra.run.smithi042:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-04-02T23:25:42.524 INFO:tasks.workunit.client.0.smithi042.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-04-02T23:25:42.526 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-04-02T23:25:42.526 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-04-02T23:25:43.221 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-04-02T23:25:43.274 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-04-02T23:25:43.313 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-04-02T23:25:43.315 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-04-02T23:25:43.315 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-04-02T23:25:43.353 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-04-02T23:25:43.414 DEBUG:teuthology.orchestra.remote:smithi042:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2020-04-02T23:25:43.461 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2020-04-02T23:25:43.461 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2020-04-02T23:25:43.462 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:25:43.475 INFO:teuthology.orchestra.run.smithi042:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cbb84f71d70460f911296715ab61ac09c6962b17 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2020-04-02T23:25:43.569 INFO:tasks.workunit.client.0.smithi042.stderr:--2020-04-02 23:25:43-- http://download.ceph.com/qa/ffsb.tar.bz2 2020-04-02T23:25:43.593 INFO:tasks.workunit.client.0.smithi042.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2020-04-02T23:25:43.630 INFO:tasks.workunit.client.0.smithi042.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2020-04-02T23:25:43.667 INFO:tasks.workunit.client.0.smithi042.stderr:HTTP request sent, awaiting response... 200 OK 2020-04-02T23:25:43.667 INFO:tasks.workunit.client.0.smithi042.stderr:Length: 128931 (126K) [application/octet-stream] 2020-04-02T23:25:43.668 INFO:tasks.workunit.client.0.smithi042.stderr:Saving to: ‘ffsb.tar.bz2’ 2020-04-02T23:25:43.670 INFO:tasks.workunit.client.0.smithi042.stderr: 2020-04-02T23:25:43.747 INFO:tasks.workunit.client.0.smithi042.stderr: 0K .......... .......... .......... .......... .......... 39% 637K 0s 2020-04-02T23:25:43.783 INFO:tasks.workunit.client.0.smithi042.stderr: 50K .......... .......... .......... .......... .......... 79% 1.36M 0s 2020-04-02T23:25:43.784 INFO:tasks.workunit.client.0.smithi042.stderr: 100K .......... .......... ..... 100% 35.9M=0.1s 2020-04-02T23:25:43.784 INFO:tasks.workunit.client.0.smithi042.stderr: 2020-04-02T23:25:43.784 INFO:tasks.workunit.client.0.smithi042.stderr:2020-04-02 23:25:43 (1.07 MB/s) - ‘ffsb.tar.bz2’ saved [128931/128931] 2020-04-02T23:25:43.784 INFO:tasks.workunit.client.0.smithi042.stderr: 2020-04-02T23:25:43.817 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/ 2020-04-02T23:25:43.818 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/ffsb_fs.c 2020-04-02T23:25:43.820 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/INSTALL 2020-04-02T23:25:43.823 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/fileops.c 2020-04-02T23:25:43.825 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/missing 2020-04-02T23:25:43.827 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/config.h.in 2020-04-02T23:25:43.829 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/config.guess 2020-04-02T23:25:43.832 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/fh.h 2020-04-02T23:25:43.833 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/COPYING 2020-04-02T23:25:43.836 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/util.h 2020-04-02T23:25:43.837 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/main.c 2020-04-02T23:25:43.840 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/ChangeLog 2020-04-02T23:25:43.842 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/rand.c 2020-04-02T23:25:43.843 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/ffsb_fs.h 2020-04-02T23:25:43.845 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/install-sh 2020-04-02T23:25:43.847 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/rwlock.h 2020-04-02T23:25:43.850 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/parser.h 2020-04-02T23:25:43.852 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/filelist.h 2020-04-02T23:25:43.854 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/LICENSE 2020-04-02T23:25:43.855 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/Makefile.in 2020-04-02T23:25:43.858 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/filelist.c 2020-04-02T23:25:43.859 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/configure 2020-04-02T23:25:43.866 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/README 2020-04-02T23:25:43.868 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/cirlist.c 2020-04-02T23:25:43.870 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/metaops.c 2020-04-02T23:25:43.872 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/registration-description 2020-04-02T23:25:43.874 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/list.c 2020-04-02T23:25:43.876 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/list.h 2020-04-02T23:25:43.878 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/rand.h 2020-04-02T23:25:43.879 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/parser.c 2020-04-02T23:25:43.882 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/ffsb_tg.c 2020-04-02T23:25:43.884 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/cirlist.h 2020-04-02T23:25:43.885 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/AUTHORS 2020-04-02T23:25:43.887 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/aclocal.m4 2020-04-02T23:25:43.890 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/configure.in 2020-04-02T23:25:43.892 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/examples/ 2020-04-02T23:25:43.894 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/examples/profile_everything 2020-04-02T23:25:43.896 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/depcomp 2020-04-02T23:25:43.899 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/ffsb_stats.c 2020-04-02T23:25:43.900 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/util.c 2020-04-02T23:25:43.902 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/Makefile.am 2020-04-02T23:25:43.904 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/ffsb_thread.c 2020-04-02T23:25:43.905 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/rbt.c 2020-04-02T23:25:43.908 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/rbt.h 2020-04-02T23:25:43.910 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/ffsb_tg.h 2020-04-02T23:25:43.912 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/stamp-h.in 2020-04-02T23:25:43.913 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/config.sub 2020-04-02T23:25:43.916 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/ffsb_thread.h 2020-04-02T23:25:43.918 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/fileops.h 2020-04-02T23:25:43.919 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/ffsb_op.h 2020-04-02T23:25:43.921 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/public-description 2020-04-02T23:25:43.923 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/mkinstalldirs 2020-04-02T23:25:43.924 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/ffsb.h 2020-04-02T23:25:43.926 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/metaops.h 2020-04-02T23:25:43.927 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/ffsb_op.c 2020-04-02T23:25:43.930 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/fh.c 2020-04-02T23:25:43.932 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/NEWS 2020-04-02T23:25:43.933 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/rwlock.c 2020-04-02T23:25:43.935 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/ffsb_stats.h 2020-04-02T23:25:43.937 INFO:tasks.workunit.client.0.smithi042.stdout:ffsb-6.0-rc2/ffsb_fc.c 2020-04-02T23:25:43.950 INFO:tasks.workunit.client.0.smithi042.stdout:patching file parser.c 2020-04-02T23:25:44.098 INFO:tasks.workunit.client.0.smithi042.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2020-04-02T23:25:45.108 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether build environment is sane... yes 2020-04-02T23:25:45.126 INFO:tasks.workunit.client.0.smithi042.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2020-04-02T23:25:45.126 INFO:tasks.workunit.client.0.smithi042.stdout:checking for gawk... gawk 2020-04-02T23:25:45.152 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether make sets $(MAKE)... yes 2020-04-02T23:25:45.202 INFO:tasks.workunit.client.0.smithi042.stdout:checking build system type... x86_64-unknown-linux-gnu 2020-04-02T23:25:45.202 INFO:tasks.workunit.client.0.smithi042.stdout:checking host system type... x86_64-unknown-linux-gnu 2020-04-02T23:25:45.221 INFO:tasks.workunit.client.0.smithi042.stdout:checking for style of include used by make... GNU 2020-04-02T23:25:45.226 INFO:tasks.workunit.client.0.smithi042.stdout:checking for gcc... gcc 2020-04-02T23:25:45.304 INFO:tasks.workunit.client.0.smithi042.stdout:checking for C compiler default output file name... a.out 2020-04-02T23:25:45.307 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether the C compiler works... yes 2020-04-02T23:25:45.310 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether we are cross compiling... no 2020-04-02T23:25:45.361 INFO:tasks.workunit.client.0.smithi042.stdout:checking for suffix of executables... 2020-04-02T23:25:45.408 INFO:tasks.workunit.client.0.smithi042.stdout:checking for suffix of object files... o 2020-04-02T23:25:45.449 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether we are using the GNU C compiler... yes 2020-04-02T23:25:45.490 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether gcc accepts -g... yes 2020-04-02T23:25:45.569 INFO:tasks.workunit.client.0.smithi042.stdout:checking for gcc option to accept ISO C89... none needed 2020-04-02T23:25:45.721 INFO:tasks.workunit.client.0.smithi042.stdout:checking dependency style of gcc... gcc3 2020-04-02T23:25:45.803 INFO:tasks.workunit.client.0.smithi042.stdout:checking how to run the C preprocessor... gcc -E 2020-04-02T23:25:45.856 INFO:tasks.workunit.client.0.smithi042.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2020-04-02T23:25:45.857 INFO:tasks.workunit.client.0.smithi042.stdout:checking for egrep... /usr/bin/grep -E 2020-04-02T23:25:45.869 INFO:tasks.workunit.client.0.smithi042.stdout:checking for AIX... no 2020-04-02T23:25:45.894 INFO:tasks.workunit.client.0.smithi042.stdout:checking for gcc... (cached) gcc 2020-04-02T23:25:45.905 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether we are using the GNU C compiler... (cached) yes 2020-04-02T23:25:45.907 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether gcc accepts -g... (cached) yes 2020-04-02T23:25:45.908 INFO:tasks.workunit.client.0.smithi042.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2020-04-02T23:25:45.908 INFO:tasks.workunit.client.0.smithi042.stdout:checking dependency style of gcc... (cached) gcc3 2020-04-02T23:25:45.990 INFO:tasks.workunit.client.0.smithi042.stdout:checking for main in -lm... yes 2020-04-02T23:25:46.067 INFO:tasks.workunit.client.0.smithi042.stdout:checking for main in -lpthread... yes 2020-04-02T23:25:46.261 INFO:tasks.workunit.client.0.smithi042.stdout:checking for ANSI C header files... yes 2020-04-02T23:25:46.345 INFO:tasks.workunit.client.0.smithi042.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2020-04-02T23:25:46.404 INFO:tasks.workunit.client.0.smithi042.stdout:checking for sys/types.h... yes 2020-04-02T23:25:46.464 INFO:tasks.workunit.client.0.smithi042.stdout:checking for sys/stat.h... yes 2020-04-02T23:25:46.522 INFO:tasks.workunit.client.0.smithi042.stdout:checking for stdlib.h... yes 2020-04-02T23:25:46.585 INFO:tasks.workunit.client.0.smithi042.stdout:checking for string.h... yes 2020-04-02T23:25:46.653 INFO:tasks.workunit.client.0.smithi042.stdout:checking for memory.h... yes 2020-04-02T23:25:46.713 INFO:tasks.workunit.client.0.smithi042.stdout:checking for strings.h... yes 2020-04-02T23:25:46.781 INFO:tasks.workunit.client.0.smithi042.stdout:checking for inttypes.h... yes 2020-04-02T23:25:46.841 INFO:tasks.workunit.client.0.smithi042.stdout:checking for stdint.h... yes 2020-04-02T23:25:46.905 INFO:tasks.workunit.client.0.smithi042.stdout:checking for unistd.h... yes 2020-04-02T23:25:46.972 INFO:tasks.workunit.client.0.smithi042.stdout:checking pthread.h usability... yes 2020-04-02T23:25:46.999 INFO:tasks.workunit.client.0.smithi042.stdout:checking pthread.h presence... yes 2020-04-02T23:25:46.999 INFO:tasks.workunit.client.0.smithi042.stdout:checking for pthread.h... yes 2020-04-02T23:25:47.080 INFO:tasks.workunit.client.0.smithi042.stdout:checking fcntl.h usability... yes 2020-04-02T23:25:47.111 INFO:tasks.workunit.client.0.smithi042.stdout:checking fcntl.h presence... yes 2020-04-02T23:25:47.112 INFO:tasks.workunit.client.0.smithi042.stdout:checking for fcntl.h... yes 2020-04-02T23:25:47.177 INFO:tasks.workunit.client.0.smithi042.stdout:checking limits.h usability... yes 2020-04-02T23:25:47.201 INFO:tasks.workunit.client.0.smithi042.stdout:checking limits.h presence... yes 2020-04-02T23:25:47.201 INFO:tasks.workunit.client.0.smithi042.stdout:checking for limits.h... yes 2020-04-02T23:25:47.221 INFO:tasks.workunit.client.0.smithi042.stdout:checking for stdint.h... (cached) yes 2020-04-02T23:25:47.284 INFO:tasks.workunit.client.0.smithi042.stdout:checking sys/time.h usability... yes 2020-04-02T23:25:47.307 INFO:tasks.workunit.client.0.smithi042.stdout:checking sys/time.h presence... yes 2020-04-02T23:25:47.308 INFO:tasks.workunit.client.0.smithi042.stdout:checking for sys/time.h... yes 2020-04-02T23:25:47.328 INFO:tasks.workunit.client.0.smithi042.stdout:checking for unistd.h... (cached) yes 2020-04-02T23:25:47.381 INFO:tasks.workunit.client.0.smithi042.stdout:checking sys/vfs.h usability... yes 2020-04-02T23:25:47.405 INFO:tasks.workunit.client.0.smithi042.stdout:checking sys/vfs.h presence... yes 2020-04-02T23:25:47.406 INFO:tasks.workunit.client.0.smithi042.stdout:checking for sys/vfs.h... yes 2020-04-02T23:25:47.469 INFO:tasks.workunit.client.0.smithi042.stdout:checking sys/limits.h usability... no 2020-04-02T23:25:47.498 INFO:tasks.workunit.client.0.smithi042.stdout:checking sys/limits.h presence... no 2020-04-02T23:25:47.499 INFO:tasks.workunit.client.0.smithi042.stdout:checking for sys/limits.h... no 2020-04-02T23:25:47.545 INFO:tasks.workunit.client.0.smithi042.stdout:checking for an ANSI C-conforming const... yes 2020-04-02T23:25:47.588 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether time.h and sys/time.h may both be included... yes 2020-04-02T23:25:47.591 INFO:tasks.workunit.client.0.smithi042.stdout:checking for function prototypes... yes 2020-04-02T23:25:47.649 INFO:tasks.workunit.client.0.smithi042.stdout:checking whether setvbuf arguments are reversed... no 2020-04-02T23:25:47.733 INFO:tasks.workunit.client.0.smithi042.stdout:checking for system... yes 2020-04-02T23:25:47.822 INFO:tasks.workunit.client.0.smithi042.stdout:checking for gettimeofday... yes 2020-04-02T23:25:47.907 INFO:tasks.workunit.client.0.smithi042.stdout:checking for mkdir... yes 2020-04-02T23:25:47.993 INFO:tasks.workunit.client.0.smithi042.stdout:checking for strerror... yes 2020-04-02T23:25:48.088 INFO:tasks.workunit.client.0.smithi042.stdout:checking for open64... yes 2020-04-02T23:25:48.179 INFO:tasks.workunit.client.0.smithi042.stdout:checking for stat64... yes 2020-04-02T23:25:48.268 INFO:tasks.workunit.client.0.smithi042.stdout:checking for fseeko64... yes 2020-04-02T23:25:48.353 INFO:tasks.workunit.client.0.smithi042.stdout:checking for lrand48_r... yes 2020-04-02T23:25:48.436 INFO:tasks.workunit.client.0.smithi042.stdout:checking for srand48_r... yes 2020-04-02T23:25:48.469 INFO:tasks.workunit.client.0.smithi042.stdout:configure: creating ./config.status 2020-04-02T23:25:48.624 INFO:tasks.workunit.client.0.smithi042.stdout:config.status: creating Makefile 2020-04-02T23:25:48.642 INFO:tasks.workunit.client.0.smithi042.stdout:config.status: creating config.h 2020-04-02T23:25:48.668 INFO:tasks.workunit.client.0.smithi042.stdout:config.status: executing depfiles commands 2020-04-02T23:25:48.740 INFO:tasks.workunit.client.0.smithi042.stdout:config.status: executing default commands 2020-04-02T23:25:48.836 INFO:tasks.workunit.client.0.smithi042.stdout:make all-am 2020-04-02T23:25:48.859 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb-6.0-rc2' 2020-04-02T23:25:48.859 INFO:tasks.workunit.client.0.smithi042.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2020-04-02T23:25:48.914 INFO:tasks.workunit.client.0.smithi042.stderr:fileops.c: In function ‘ffsb_stat’: 2020-04-02T23:25:48.915 INFO:tasks.workunit.client.0.smithi042.stderr:fileops.c:542:2: warning: implicit declaration of function ‘fhstat’; did you mean ‘fstat’? [-Wimplicit-function-declaration] 2020-04-02T23:25:48.915 INFO:tasks.workunit.client.0.smithi042.stderr: fhstat(curfile->name, ft, fs); 2020-04-02T23:25:48.915 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~ 2020-04-02T23:25:48.915 INFO:tasks.workunit.client.0.smithi042.stderr: fstat 2020-04-02T23:25:49.054 INFO:tasks.workunit.client.0.smithi042.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2020-04-02T23:25:49.062 INFO:tasks.workunit.client.0.smithi042.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2020-04-02T23:25:49.142 INFO:tasks.workunit.client.0.smithi042.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2020-04-02T23:25:49.148 INFO:tasks.workunit.client.0.smithi042.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2020-04-02T23:25:49.283 INFO:tasks.workunit.client.0.smithi042.stdout:mv -f .deps/main.Tpo .deps/main.Po 2020-04-02T23:25:49.288 INFO:tasks.workunit.client.0.smithi042.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2020-04-02T23:25:49.401 INFO:tasks.workunit.client.0.smithi042.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2020-04-02T23:25:49.407 INFO:tasks.workunit.client.0.smithi042.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2020-04-02T23:25:49.542 INFO:tasks.workunit.client.0.smithi042.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2020-04-02T23:25:49.547 INFO:tasks.workunit.client.0.smithi042.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2020-04-02T23:25:49.616 INFO:tasks.workunit.client.0.smithi042.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2020-04-02T23:25:49.621 INFO:tasks.workunit.client.0.smithi042.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2020-04-02T23:25:49.673 INFO:tasks.workunit.client.0.smithi042.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2020-04-02T23:25:49.679 INFO:tasks.workunit.client.0.smithi042.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2020-04-02T23:25:49.739 INFO:tasks.workunit.client.0.smithi042.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2020-04-02T23:25:49.744 INFO:tasks.workunit.client.0.smithi042.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2020-04-02T23:25:49.916 INFO:tasks.workunit.client.0.smithi042.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2020-04-02T23:25:49.921 INFO:tasks.workunit.client.0.smithi042.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2020-04-02T23:25:50.063 INFO:tasks.workunit.client.0.smithi042.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2020-04-02T23:25:50.069 INFO:tasks.workunit.client.0.smithi042.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2020-04-02T23:25:50.113 INFO:tasks.workunit.client.0.smithi042.stderr:ffsb_fs.c: In function ‘fs_needs_stats’: 2020-04-02T23:25:50.113 INFO:tasks.workunit.client.0.smithi042.stderr:ffsb_fs.c:627:24: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2020-04-02T23:25:50.113 INFO:tasks.workunit.client.0.smithi042.stderr: return (fs != NULL) ? (int)fs->fsd.config : 0; 2020-04-02T23:25:50.114 INFO:tasks.workunit.client.0.smithi042.stderr: ^ 2020-04-02T23:25:50.231 INFO:tasks.workunit.client.0.smithi042.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2020-04-02T23:25:50.238 INFO:tasks.workunit.client.0.smithi042.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2020-04-02T23:25:50.321 INFO:tasks.workunit.client.0.smithi042.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2020-04-02T23:25:50.328 INFO:tasks.workunit.client.0.smithi042.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2020-04-02T23:25:50.416 INFO:tasks.workunit.client.0.smithi042.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2020-04-02T23:25:50.423 INFO:tasks.workunit.client.0.smithi042.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2020-04-02T23:25:50.538 INFO:tasks.workunit.client.0.smithi042.stdout:mv -f .deps/util.Tpo .deps/util.Po 2020-04-02T23:25:50.543 INFO:tasks.workunit.client.0.smithi042.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2020-04-02T23:25:50.583 INFO:tasks.workunit.client.0.smithi042.stderr:In file included from parser.h:22, 2020-04-02T23:25:50.583 INFO:tasks.workunit.client.0.smithi042.stderr: from parser.c:25: 2020-04-02T23:25:50.584 INFO:tasks.workunit.client.0.smithi042.stderr:parser.c: In function ‘init_filesys’: 2020-04-02T23:25:50.585 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2020-04-02T23:25:50.585 INFO:tasks.workunit.client.0.smithi042.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2020-04-02T23:25:50.586 INFO:tasks.workunit.client.0.smithi042.stderr: ^ 2020-04-02T23:25:50.586 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2020-04-02T23:25:50.586 INFO:tasks.workunit.client.0.smithi042.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2020-04-02T23:25:50.586 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~ 2020-04-02T23:25:50.586 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2020-04-02T23:25:50.586 INFO:tasks.workunit.client.0.smithi042.stderr: container_of(ptr, type, member) 2020-04-02T23:25:50.586 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~~~ 2020-04-02T23:25:50.587 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:39:13: note: in expansion of macro ‘list_entry’ 2020-04-02T23:25:50.587 INFO:tasks.workunit.client.0.smithi042.stderr: for (pos = list_entry((head)->next, typeof(*pos), member); \ 2020-04-02T23:25:50.587 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~ 2020-04-02T23:25:50.587 INFO:tasks.workunit.client.0.smithi042.stderr:parser.c:934:3: note: in expansion of macro ‘list_for_each_entry’ 2020-04-02T23:25:50.587 INFO:tasks.workunit.client.0.smithi042.stderr: list_for_each_entry(tmp_list, &list_head->list, list) 2020-04-02T23:25:50.587 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~~~~~~~~~~ 2020-04-02T23:25:50.587 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2020-04-02T23:25:50.588 INFO:tasks.workunit.client.0.smithi042.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2020-04-02T23:25:50.588 INFO:tasks.workunit.client.0.smithi042.stderr: ^ 2020-04-02T23:25:50.588 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2020-04-02T23:25:50.588 INFO:tasks.workunit.client.0.smithi042.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2020-04-02T23:25:50.588 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~ 2020-04-02T23:25:50.588 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2020-04-02T23:25:50.588 INFO:tasks.workunit.client.0.smithi042.stderr: container_of(ptr, type, member) 2020-04-02T23:25:50.589 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~~~ 2020-04-02T23:25:50.589 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:41:13: note: in expansion of macro ‘list_entry’ 2020-04-02T23:25:50.589 INFO:tasks.workunit.client.0.smithi042.stderr: pos = list_entry(pos->member.next, typeof(*pos), member)) 2020-04-02T23:25:50.589 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~ 2020-04-02T23:25:50.589 INFO:tasks.workunit.client.0.smithi042.stderr:parser.c:934:3: note: in expansion of macro ‘list_for_each_entry’ 2020-04-02T23:25:50.589 INFO:tasks.workunit.client.0.smithi042.stderr: list_for_each_entry(tmp_list, &list_head->list, list) 2020-04-02T23:25:50.589 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~~~~~~~~~~ 2020-04-02T23:25:50.590 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2020-04-02T23:25:50.590 INFO:tasks.workunit.client.0.smithi042.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2020-04-02T23:25:50.590 INFO:tasks.workunit.client.0.smithi042.stderr: ^ 2020-04-02T23:25:50.590 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2020-04-02T23:25:50.590 INFO:tasks.workunit.client.0.smithi042.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2020-04-02T23:25:50.590 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~ 2020-04-02T23:25:50.591 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2020-04-02T23:25:50.591 INFO:tasks.workunit.client.0.smithi042.stderr: container_of(ptr, type, member) 2020-04-02T23:25:50.591 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~~~ 2020-04-02T23:25:50.591 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:39:13: note: in expansion of macro ‘list_entry’ 2020-04-02T23:25:50.592 INFO:tasks.workunit.client.0.smithi042.stderr: for (pos = list_entry((head)->next, typeof(*pos), member); \ 2020-04-02T23:25:50.592 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~ 2020-04-02T23:25:50.592 INFO:tasks.workunit.client.0.smithi042.stderr:parser.c:941:3: note: in expansion of macro ‘list_for_each_entry’ 2020-04-02T23:25:50.592 INFO:tasks.workunit.client.0.smithi042.stderr: list_for_each_entry(tmp_list, &list_head->list, list) { 2020-04-02T23:25:50.592 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~~~~~~~~~~ 2020-04-02T23:25:50.592 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2020-04-02T23:25:50.593 INFO:tasks.workunit.client.0.smithi042.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2020-04-02T23:25:50.593 INFO:tasks.workunit.client.0.smithi042.stderr: ^ 2020-04-02T23:25:50.593 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2020-04-02T23:25:50.593 INFO:tasks.workunit.client.0.smithi042.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2020-04-02T23:25:50.593 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~ 2020-04-02T23:25:50.593 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2020-04-02T23:25:50.594 INFO:tasks.workunit.client.0.smithi042.stderr: container_of(ptr, type, member) 2020-04-02T23:25:50.594 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~~~ 2020-04-02T23:25:50.594 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:41:13: note: in expansion of macro ‘list_entry’ 2020-04-02T23:25:50.594 INFO:tasks.workunit.client.0.smithi042.stderr: pos = list_entry(pos->member.next, typeof(*pos), member)) 2020-04-02T23:25:50.594 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~ 2020-04-02T23:25:50.594 INFO:tasks.workunit.client.0.smithi042.stderr:parser.c:941:3: note: in expansion of macro ‘list_for_each_entry’ 2020-04-02T23:25:50.598 INFO:tasks.workunit.client.0.smithi042.stderr: list_for_each_entry(tmp_list, &list_head->list, list) { 2020-04-02T23:25:50.598 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~~~~~~~~~~ 2020-04-02T23:25:50.598 INFO:tasks.workunit.client.0.smithi042.stderr:parser.c: In function ‘init_tg_stats’: 2020-04-02T23:25:50.599 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2020-04-02T23:25:50.599 INFO:tasks.workunit.client.0.smithi042.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2020-04-02T23:25:50.599 INFO:tasks.workunit.client.0.smithi042.stderr: ^ 2020-04-02T23:25:50.599 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2020-04-02T23:25:50.600 INFO:tasks.workunit.client.0.smithi042.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2020-04-02T23:25:50.600 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~ 2020-04-02T23:25:50.600 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2020-04-02T23:25:50.600 INFO:tasks.workunit.client.0.smithi042.stderr: container_of(ptr, type, member) 2020-04-02T23:25:50.601 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~~~ 2020-04-02T23:25:50.601 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:39:13: note: in expansion of macro ‘list_entry’ 2020-04-02T23:25:50.601 INFO:tasks.workunit.client.0.smithi042.stderr: for (pos = list_entry((head)->next, typeof(*pos), member); \ 2020-04-02T23:25:50.601 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~ 2020-04-02T23:25:50.602 INFO:tasks.workunit.client.0.smithi042.stderr:parser.c:971:6: note: in expansion of macro ‘list_for_each_entry’ 2020-04-02T23:25:50.602 INFO:tasks.workunit.client.0.smithi042.stderr: list_for_each_entry(tmp_list, 2020-04-02T23:25:50.602 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~~~~~~~~~~ 2020-04-02T23:25:50.602 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2020-04-02T23:25:50.602 INFO:tasks.workunit.client.0.smithi042.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2020-04-02T23:25:50.602 INFO:tasks.workunit.client.0.smithi042.stderr: ^ 2020-04-02T23:25:50.603 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2020-04-02T23:25:50.603 INFO:tasks.workunit.client.0.smithi042.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2020-04-02T23:25:50.603 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~ 2020-04-02T23:25:50.603 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2020-04-02T23:25:50.603 INFO:tasks.workunit.client.0.smithi042.stderr: container_of(ptr, type, member) 2020-04-02T23:25:50.603 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~~~ 2020-04-02T23:25:50.603 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:41:13: note: in expansion of macro ‘list_entry’ 2020-04-02T23:25:50.604 INFO:tasks.workunit.client.0.smithi042.stderr: pos = list_entry(pos->member.next, typeof(*pos), member)) 2020-04-02T23:25:50.604 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~ 2020-04-02T23:25:50.604 INFO:tasks.workunit.client.0.smithi042.stderr:parser.c:971:6: note: in expansion of macro ‘list_for_each_entry’ 2020-04-02T23:25:50.604 INFO:tasks.workunit.client.0.smithi042.stderr: list_for_each_entry(tmp_list, 2020-04-02T23:25:50.604 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~~~~~~~~~~ 2020-04-02T23:25:50.604 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2020-04-02T23:25:50.605 INFO:tasks.workunit.client.0.smithi042.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2020-04-02T23:25:50.605 INFO:tasks.workunit.client.0.smithi042.stderr: ^ 2020-04-02T23:25:50.605 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2020-04-02T23:25:50.605 INFO:tasks.workunit.client.0.smithi042.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2020-04-02T23:25:50.605 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~ 2020-04-02T23:25:50.607 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2020-04-02T23:25:50.607 INFO:tasks.workunit.client.0.smithi042.stderr: container_of(ptr, type, member) 2020-04-02T23:25:50.607 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~~~ 2020-04-02T23:25:50.607 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:39:13: note: in expansion of macro ‘list_entry’ 2020-04-02T23:25:50.607 INFO:tasks.workunit.client.0.smithi042.stderr: for (pos = list_entry((head)->next, typeof(*pos), member); \ 2020-04-02T23:25:50.607 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~ 2020-04-02T23:25:50.608 INFO:tasks.workunit.client.0.smithi042.stderr:parser.c:980:6: note: in expansion of macro ‘list_for_each_entry’ 2020-04-02T23:25:50.608 INFO:tasks.workunit.client.0.smithi042.stderr: list_for_each_entry(tmp_list, 2020-04-02T23:25:50.608 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~~~~~~~~~~ 2020-04-02T23:25:50.608 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2020-04-02T23:25:50.608 INFO:tasks.workunit.client.0.smithi042.stderr: #define offsetof(type, member) ((int) &((type *)0)->member) 2020-04-02T23:25:50.608 INFO:tasks.workunit.client.0.smithi042.stderr: ^ 2020-04-02T23:25:50.608 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:33:28: note: in expansion of macro ‘offsetof’ 2020-04-02T23:25:50.609 INFO:tasks.workunit.client.0.smithi042.stderr: (type *)((char *)__mptr - offsetof(type, member)); }) 2020-04-02T23:25:50.609 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~ 2020-04-02T23:25:50.609 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:36:2: note: in expansion of macro ‘container_of’ 2020-04-02T23:25:50.609 INFO:tasks.workunit.client.0.smithi042.stderr: container_of(ptr, type, member) 2020-04-02T23:25:50.609 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~~~ 2020-04-02T23:25:50.609 INFO:tasks.workunit.client.0.smithi042.stderr:list.h:41:13: note: in expansion of macro ‘list_entry’ 2020-04-02T23:25:50.610 INFO:tasks.workunit.client.0.smithi042.stderr: pos = list_entry(pos->member.next, typeof(*pos), member)) 2020-04-02T23:25:50.610 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~ 2020-04-02T23:25:50.610 INFO:tasks.workunit.client.0.smithi042.stderr:parser.c:980:6: note: in expansion of macro ‘list_for_each_entry’ 2020-04-02T23:25:50.610 INFO:tasks.workunit.client.0.smithi042.stderr: list_for_each_entry(tmp_list, 2020-04-02T23:25:50.610 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~~~~~~~~~~ 2020-04-02T23:25:50.695 INFO:tasks.workunit.client.0.smithi042.stderr:parser.c: In function ‘set_weight’: 2020-04-02T23:25:50.695 INFO:tasks.workunit.client.0.smithi042.stderr:parser.c:623:4: warning: ‘strncpy’ specified bound depends on the length of the source argument [-Wstringop-overflow=] 2020-04-02T23:25:50.695 INFO:tasks.workunit.client.0.smithi042.stderr: strncpy (op, tmp_config->name, len - 7); 2020-04-02T23:25:50.696 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2020-04-02T23:25:50.696 INFO:tasks.workunit.client.0.smithi042.stderr:parser.c:620:10: note: length computed here 2020-04-02T23:25:50.696 INFO:tasks.workunit.client.0.smithi042.stderr: len = strlen(tmp_config->name); 2020-04-02T23:25:50.696 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~ 2020-04-02T23:25:50.699 INFO:tasks.workunit.client.0.smithi042.stderr:parser.c: In function ‘get_weight_total’: 2020-04-02T23:25:50.699 INFO:tasks.workunit.client.0.smithi042.stderr:parser.c:645:4: warning: ‘strncpy’ specified bound depends on the length of the source argument [-Wstringop-overflow=] 2020-04-02T23:25:50.700 INFO:tasks.workunit.client.0.smithi042.stderr: strncpy (op, tmp_config->name, len - 7); 2020-04-02T23:25:50.700 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2020-04-02T23:25:50.700 INFO:tasks.workunit.client.0.smithi042.stderr:parser.c:642:10: note: length computed here 2020-04-02T23:25:50.700 INFO:tasks.workunit.client.0.smithi042.stderr: len = strlen(tmp_config->name); 2020-04-02T23:25:50.700 INFO:tasks.workunit.client.0.smithi042.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~ 2020-04-02T23:25:50.830 INFO:tasks.workunit.client.0.smithi042.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2020-04-02T23:25:50.835 INFO:tasks.workunit.client.0.smithi042.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2020-04-02T23:25:50.909 INFO:tasks.workunit.client.0.smithi042.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2020-04-02T23:25:50.914 INFO:tasks.workunit.client.0.smithi042.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2020-04-02T23:25:51.023 INFO:tasks.workunit.client.0.smithi042.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2020-04-02T23:25:51.028 INFO:tasks.workunit.client.0.smithi042.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2020-04-02T23:25:51.072 INFO:tasks.workunit.client.0.smithi042.stdout:mv -f .deps/list.Tpo .deps/list.Po 2020-04-02T23:25:51.079 INFO:tasks.workunit.client.0.smithi042.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2020-04-02T23:25:51.182 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb-6.0-rc2' 2020-04-02T23:25:51.198 INFO:tasks.workunit.client.0.smithi042.stdout:FFSB version 6.0-RC2 started 2020-04-02T23:25:51.198 INFO:tasks.workunit.client.0.smithi042.stdout: 2020-04-02T23:25:51.201 INFO:tasks.workunit.client.0.smithi042.stdout:benchmark time = 300 2020-04-02T23:25:51.201 INFO:tasks.workunit.client.0.smithi042.stdout:ThreadGroup 0 2020-04-02T23:25:51.201 INFO:tasks.workunit.client.0.smithi042.stdout:================ 2020-04-02T23:25:51.201 INFO:tasks.workunit.client.0.smithi042.stdout: num_threads = 32 2020-04-02T23:25:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: 2020-04-02T23:25:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: read_random = off 2020-04-02T23:25:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: read_size = 0 (0B) 2020-04-02T23:25:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: read_blocksize = 0 (0B) 2020-04-02T23:25:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: read_skip = off 2020-04-02T23:25:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: read_skipsize = 0 (0B) 2020-04-02T23:25:51.202 INFO:tasks.workunit.client.0.smithi042.stdout: 2020-04-02T23:25:51.203 INFO:tasks.workunit.client.0.smithi042.stdout: write_random = on 2020-04-02T23:25:51.203 INFO:tasks.workunit.client.0.smithi042.stdout: write_size = 5242880 (5MB) 2020-04-02T23:25:51.203 INFO:tasks.workunit.client.0.smithi042.stdout: fsync_file = 0 2020-04-02T23:25:51.203 INFO:tasks.workunit.client.0.smithi042.stdout: write_blocksize = 4096 (4KB) 2020-04-02T23:25:51.203 INFO:tasks.workunit.client.0.smithi042.stdout: wait time = 0 2020-04-02T23:25:51.203 INFO:tasks.workunit.client.0.smithi042.stdout: 2020-04-02T23:25:51.203 INFO:tasks.workunit.client.0.smithi042.stdout: op weights 2020-04-02T23:25:51.204 INFO:tasks.workunit.client.0.smithi042.stdout: read = 0 (0.00%) 2020-04-02T23:25:51.204 INFO:tasks.workunit.client.0.smithi042.stdout: readall = 0 (0.00%) 2020-04-02T23:25:51.204 INFO:tasks.workunit.client.0.smithi042.stdout: write = 1 (100.00%) 2020-04-02T23:25:51.204 INFO:tasks.workunit.client.0.smithi042.stdout: create = 0 (0.00%) 2020-04-02T23:25:51.204 INFO:tasks.workunit.client.0.smithi042.stdout: append = 0 (0.00%) 2020-04-02T23:25:51.204 INFO:tasks.workunit.client.0.smithi042.stdout: delete = 0 (0.00%) 2020-04-02T23:25:51.204 INFO:tasks.workunit.client.0.smithi042.stdout: metaop = 0 (0.00%) 2020-04-02T23:25:51.205 INFO:tasks.workunit.client.0.smithi042.stdout: createdir = 0 (0.00%) 2020-04-02T23:25:51.205 INFO:tasks.workunit.client.0.smithi042.stdout: stat = 0 (0.00%) 2020-04-02T23:25:51.205 INFO:tasks.workunit.client.0.smithi042.stdout: writeall = 0 (0.00%) 2020-04-02T23:25:51.205 INFO:tasks.workunit.client.0.smithi042.stdout: writeall_fsync = 0 (0.00%) 2020-04-02T23:25:51.205 INFO:tasks.workunit.client.0.smithi042.stdout: open_close = 0 (0.00%) 2020-04-02T23:25:51.205 INFO:tasks.workunit.client.0.smithi042.stdout: write_fsync = 0 (0.00%) 2020-04-02T23:25:51.205 INFO:tasks.workunit.client.0.smithi042.stdout: create_fsync = 0 (0.00%) 2020-04-02T23:25:51.205 INFO:tasks.workunit.client.0.smithi042.stdout: append_fsync = 0 (0.00%) 2020-04-02T23:25:51.206 INFO:tasks.workunit.client.0.smithi042.stdout: 2020-04-02T23:25:51.206 INFO:tasks.workunit.client.0.smithi042.stdout:FileSystem . 2020-04-02T23:25:51.206 INFO:tasks.workunit.client.0.smithi042.stdout:========== 2020-04-02T23:25:51.206 INFO:tasks.workunit.client.0.smithi042.stdout: num_dirs = 0 2020-04-02T23:25:51.206 INFO:tasks.workunit.client.0.smithi042.stdout: starting files = 128 2020-04-02T23:25:51.206 INFO:tasks.workunit.client.0.smithi042.stdout: 2020-04-02T23:25:51.206 INFO:tasks.workunit.client.0.smithi042.stdout: min file size = 104857600 (100MB) 2020-04-02T23:25:51.207 INFO:tasks.workunit.client.0.smithi042.stdout: max file size = 104857600 (100MB) 2020-04-02T23:25:51.207 INFO:tasks.workunit.client.0.smithi042.stdout: directio = off 2020-04-02T23:25:51.207 INFO:tasks.workunit.client.0.smithi042.stdout: alignedio = on 2020-04-02T23:25:51.207 INFO:tasks.workunit.client.0.smithi042.stdout: bufferedio = off 2020-04-02T23:25:51.207 INFO:tasks.workunit.client.0.smithi042.stdout: 2020-04-02T23:25:51.207 INFO:tasks.workunit.client.0.smithi042.stdout: aging is off 2020-04-02T23:25:51.208 INFO:tasks.workunit.client.0.smithi042.stdout: current utilization = 0.00% 2020-04-02T23:25:51.208 INFO:tasks.workunit.client.0.smithi042.stdout: 2020-04-02T23:25:51.208 INFO:tasks.workunit.client.0.smithi042.stdout:checking existing fs: . 2020-04-02T23:25:51.209 INFO:tasks.workunit.client.0.smithi042.stdout:recreating new fileset 2020-04-02T23:25:51.209 INFO:tasks.workunit.client.0.smithi042.stderr:opendir: No such file or directory 2020-04-02T23:26:09.653 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:26:09.676 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:26:09.719 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:26:09.733 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:26:39.825 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:26:39.840 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:26:39.882 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:26:39.900 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:27:09.995 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:27:10.010 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:27:10.052 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:27:10.071 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:27:40.156 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:27:40.174 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:27:40.217 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:27:40.232 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:28:10.342 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:28:10.357 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:28:10.401 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:28:10.415 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:28:40.724 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:28:40.740 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:28:40.782 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:28:40.798 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:29:10.931 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:29:10.946 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:29:10.989 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:29:11.003 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:29:41.101 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:29:41.117 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:29:41.159 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:29:41.175 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:30:11.280 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:30:11.295 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:30:11.337 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:30:11.351 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:30:44.700 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:30:44.715 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:30:44.758 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:30:44.773 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:31:14.877 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:31:14.893 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:31:14.935 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:31:14.950 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:31:45.233 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:31:45.247 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:31:45.290 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:31:45.304 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:32:13.693 INFO:tasks.workunit.client.0.smithi042.stdout:fs setup took 382 secs 2020-04-02T23:32:15.408 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:32:15.425 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:32:15.468 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:32:15.484 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:32:15.746 INFO:tasks.workunit.client.0.smithi042.stdout:Syncing()...2 sec 2020-04-02T23:32:15.747 INFO:tasks.workunit.client.0.smithi042.stdout:Starting Actual Benchmark At: Thu Apr 2 23:32:15 2020 2020-04-02T23:32:15.747 INFO:tasks.workunit.client.0.smithi042.stdout: 2020-04-02T23:32:45.731 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:32:45.941 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:32:45.945 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:32:45.986 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:33:16.350 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:33:16.483 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:33:16.485 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:33:16.515 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:33:47.779 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:33:47.957 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:33:47.965 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:33:47.987 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:33:48.451 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-02T23:33:48.449+0000 7fe96bc43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 26282) UID: 0 2020-04-02T23:33:48.451 INFO:tasks.ceph.osd.4.smithi084.stderr:2020-04-02T23:33:48.447+0000 7f2bb0c4d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 26282) UID: 0 2020-04-02T23:33:48.452 INFO:tasks.ceph.osd.6.smithi084.stderr:2020-04-02T23:33:48.447+0000 7fd2d641d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 26282) UID: 0 2020-04-02T23:33:48.452 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-02T23:33:48.448+0000 7f5cd0ce1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 26282) UID: 0 2020-04-02T23:37:43.844 INFO:tasks.workunit.client.0.smithi042.stdout:Syncing()...3 sec 2020-04-02T23:37:43.870 INFO:tasks.workunit.client.0.smithi042.stdout:FFSB benchmark finished at: Thu Apr 2 23:37:43 2020 2020-04-02T23:37:43.870 INFO:tasks.workunit.client.0.smithi042.stdout: 2020-04-02T23:37:43.871 INFO:tasks.workunit.client.0.smithi042.stdout:Results: 2020-04-02T23:37:43.871 INFO:tasks.workunit.client.0.smithi042.stdout:Benchmark took 328.10 sec 2020-04-02T23:37:43.871 INFO:tasks.workunit.client.0.smithi042.stdout: 2020-04-02T23:37:43.871 INFO:tasks.workunit.client.0.smithi042.stdout:Total Results 2020-04-02T23:37:43.871 INFO:tasks.workunit.client.0.smithi042.stdout:=============== 2020-04-02T23:37:43.871 INFO:tasks.workunit.client.0.smithi042.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2020-04-02T23:37:43.871 INFO:tasks.workunit.client.0.smithi042.stdout: ======= ============ ========= ======= =========== ========== 2020-04-02T23:37:43.872 INFO:tasks.workunit.client.0.smithi042.stdout: write : 442880 1349.85 100.000% 100.000% 105MB/sec 2020-04-02T23:37:43.872 INFO:tasks.workunit.client.0.smithi042.stdout:- 2020-04-02T23:37:43.872 INFO:tasks.workunit.client.0.smithi042.stdout:1349.85 Transactions per Second 2020-04-02T23:37:43.872 INFO:tasks.workunit.client.0.smithi042.stdout: 2020-04-02T23:37:43.872 INFO:tasks.workunit.client.0.smithi042.stdout:Throughput Results 2020-04-02T23:37:43.872 INFO:tasks.workunit.client.0.smithi042.stdout:=================== 2020-04-02T23:37:43.872 INFO:tasks.workunit.client.0.smithi042.stdout:Write Throughput: 105MB/sec 2020-04-02T23:37:43.873 INFO:tasks.workunit.client.0.smithi042.stdout: 2020-04-02T23:37:43.873 INFO:tasks.workunit.client.0.smithi042.stdout:System Call Latency statistics in millisecs 2020-04-02T23:37:43.873 INFO:tasks.workunit.client.0.smithi042.stdout:===== 2020-04-02T23:37:43.873 INFO:tasks.workunit.client.0.smithi042.stdout: Min Avg Max Total Calls 2020-04-02T23:37:43.873 INFO:tasks.workunit.client.0.smithi042.stdout: ======== ======== ======== ============ 2020-04-02T23:37:43.873 INFO:tasks.workunit.client.0.smithi042.stdout:[ open] 0.731000 9.743867 73.019997 346 2020-04-02T23:37:43.873 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2020-04-02T23:37:43.873 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2020-04-02T23:37:43.874 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2020-04-02T23:37:43.874 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2020-04-02T23:37:43.874 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2020-04-02T23:37:43.874 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2020-04-02T23:37:43.874 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[6] 50.000000 - 100.000000 : 13 2020-04-02T23:37:43.874 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[7] 20.000000 - 50.000000 : 21 2020-04-02T23:37:43.874 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[8] 10.000000 - 20.000000 : 52 2020-04-02T23:37:43.875 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[9] 5.000000 - 10.000000 : 90 2020-04-02T23:37:43.875 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[10] 2.000000 - 5.000000 : 135 2020-04-02T23:37:43.875 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[11] 1.000000 - 2.000000 : 29 2020-04-02T23:37:43.875 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[12] 0.500000 - 1.000000 : 6 2020-04-02T23:37:43.875 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[13] 0.200000 - 0.500000 : 0 2020-04-02T23:37:43.875 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2020-04-02T23:37:43.876 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2020-04-02T23:37:43.876 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2020-04-02T23:37:43.876 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2020-04-02T23:37:43.876 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2020-04-02T23:37:43.876 INFO:tasks.workunit.client.0.smithi042.stdout: 2020-04-02T23:37:43.877 INFO:tasks.workunit.client.0.smithi042.stdout:[ write] 0.082000 22.965128 1452.385010 442880 2020-04-02T23:37:43.877 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2020-04-02T23:37:43.877 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2020-04-02T23:37:43.877 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[2] 1000.000000 - 2000.000000 : 8 2020-04-02T23:37:43.877 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[3] 500.000000 - 1000.000000 : 197 2020-04-02T23:37:43.877 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[4] 200.000000 - 500.000000 : 2770 2020-04-02T23:37:43.877 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[5] 100.000000 - 200.000000 : 10136 2020-04-02T23:37:43.878 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[6] 50.000000 - 100.000000 : 37765 2020-04-02T23:37:43.878 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[7] 20.000000 - 50.000000 : 106866 2020-04-02T23:37:43.878 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[8] 10.000000 - 20.000000 : 85940 2020-04-02T23:37:43.878 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[9] 5.000000 - 10.000000 : 67446 2020-04-02T23:37:43.878 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[10] 2.000000 - 5.000000 : 50299 2020-04-02T23:37:43.878 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[11] 1.000000 - 2.000000 : 16816 2020-04-02T23:37:43.878 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[12] 0.500000 - 1.000000 : 11531 2020-04-02T23:37:43.878 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[13] 0.200000 - 0.500000 : 37179 2020-04-02T23:37:43.879 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[14] 0.100000 - 0.200000 : 15873 2020-04-02T23:37:43.879 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[15] 0.050000 - 0.100000 : 54 2020-04-02T23:37:43.879 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2020-04-02T23:37:43.879 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2020-04-02T23:37:43.879 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2020-04-02T23:37:43.879 INFO:tasks.workunit.client.0.smithi042.stdout: 2020-04-02T23:37:43.879 INFO:tasks.workunit.client.0.smithi042.stdout:[ lseek] 0.000000 0.001312 0.178000 442880 2020-04-02T23:37:43.880 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2020-04-02T23:37:43.880 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2020-04-02T23:37:43.880 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2020-04-02T23:37:43.880 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2020-04-02T23:37:43.880 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2020-04-02T23:37:43.880 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2020-04-02T23:37:43.880 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2020-04-02T23:37:43.881 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2020-04-02T23:37:43.881 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2020-04-02T23:37:43.881 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[9] 5.000000 - 10.000000 : 0 2020-04-02T23:37:43.881 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[10] 2.000000 - 5.000000 : 0 2020-04-02T23:37:43.881 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[11] 1.000000 - 2.000000 : 0 2020-04-02T23:37:43.881 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[12] 0.500000 - 1.000000 : 0 2020-04-02T23:37:43.881 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[13] 0.200000 - 0.500000 : 0 2020-04-02T23:37:43.881 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[14] 0.100000 - 0.200000 : 3 2020-04-02T23:37:43.882 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2020-04-02T23:37:43.882 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[16] 0.020000 - 0.050000 : 6 2020-04-02T23:37:43.882 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[17] 0.010000 - 0.020000 : 178 2020-04-02T23:37:43.882 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[18] 0.000000 - 0.010000 : 442693 2020-04-02T23:37:43.882 INFO:tasks.workunit.client.0.smithi042.stdout: 2020-04-02T23:37:43.882 INFO:tasks.workunit.client.0.smithi042.stdout:[ close] 0.027000 4.352454 227.054993 346 2020-04-02T23:37:43.882 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2020-04-02T23:37:43.882 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2020-04-02T23:37:43.883 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2020-04-02T23:37:43.883 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2020-04-02T23:37:43.883 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[4] 200.000000 - 500.000000 : 1 2020-04-02T23:37:43.883 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[5] 100.000000 - 200.000000 : 5 2020-04-02T23:37:43.883 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[6] 50.000000 - 100.000000 : 4 2020-04-02T23:37:43.883 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[7] 20.000000 - 50.000000 : 4 2020-04-02T23:37:43.883 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[8] 10.000000 - 20.000000 : 4 2020-04-02T23:37:43.883 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[9] 5.000000 - 10.000000 : 8 2020-04-02T23:37:43.884 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[10] 2.000000 - 5.000000 : 21 2020-04-02T23:37:43.884 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[11] 1.000000 - 2.000000 : 24 2020-04-02T23:37:43.884 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[12] 0.500000 - 1.000000 : 40 2020-04-02T23:37:43.884 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[13] 0.200000 - 0.500000 : 63 2020-04-02T23:37:43.884 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[14] 0.100000 - 0.200000 : 46 2020-04-02T23:37:43.884 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[15] 0.050000 - 0.100000 : 59 2020-04-02T23:37:43.884 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[16] 0.020000 - 0.050000 : 67 2020-04-02T23:37:43.884 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2020-04-02T23:37:43.885 INFO:tasks.workunit.client.0.smithi042.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2020-04-02T23:37:43.885 INFO:tasks.workunit.client.0.smithi042.stdout: 2020-04-02T23:37:43.885 INFO:tasks.workunit.client.0.smithi042.stdout: 2020-04-02T23:37:43.885 INFO:tasks.workunit.client.0.smithi042.stdout: 2020-04-02T23:37:43.885 INFO:tasks.workunit.client.0.smithi042.stdout: 2020-04-02T23:37:43.886 INFO:tasks.workunit.client.0.smithi042.stdout:0.4% User Time 2020-04-02T23:37:43.886 INFO:tasks.workunit.client.0.smithi042.stdout:2.2% System Time 2020-04-02T23:37:43.886 INFO:tasks.workunit.client.0.smithi042.stdout:2.5% CPU Utilization 2020-04-02T23:37:44.761 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:37:44.799 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-02T23:37:44.799 INFO:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-02T23:37:45.110 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2020-04-02T23:37:45.111 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:37:45.125 INFO:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2020-04-02T23:37:45.520 DEBUG:teuthology.parallel:result is None 2020-04-02T23:37:45.521 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:37:45.535 INFO:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2020-04-02T23:37:45.617 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2020-04-02T23:37:45.617 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2020-04-02T23:37:45.629 DEBUG:tasks.check_counter:Getting stats from a 2020-04-02T23:37:45.629 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:37:45.699 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2020-04-02T23:37:46.334 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2020-04-02T23:37:46.334 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2020-04-02T23:37:46.334 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 325, 2020-04-02T23:37:46.334 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 321, 2020-04-02T23:37:46.334 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 134532, 2020-04-02T23:37:46.334 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 148937, 2020-04-02T23:37:46.335 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 6, 2020-04-02T23:37:46.335 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 1, 2020-04-02T23:37:46.335 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.032347112, 2020-04-02T23:37:46.335 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.010739581, 2020-04-02T23:37:46.335 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.015372996, 2020-04-02T23:37:46.335 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.004745551, 2020-04-02T23:37:46.335 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2020-04-02T23:37:46.336 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 321, 2020-04-02T23:37:46.336 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.015604017, 2020-04-02T23:37:46.336 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000048610 2020-04-02T23:37:46.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.336 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2020-04-02T23:37:46.336 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.336 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.337 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.337 INFO:teuthology.orchestra.run.smithi042.stdout: } 2020-04-02T23:37:46.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.337 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2020-04-02T23:37:46.337 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 1153, 2020-04-02T23:37:46.337 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 1309, 2020-04-02T23:37:46.337 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 274599, 2020-04-02T23:37:46.338 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 5180094, 2020-04-02T23:37:46.338 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 5, 2020-04-02T23:37:46.338 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 2, 2020-04-02T23:37:46.338 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.099594263, 2020-04-02T23:37:46.338 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.039488932, 2020-04-02T23:37:46.338 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.021155618, 2020-04-02T23:37:46.338 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.031369022, 2020-04-02T23:37:46.338 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2020-04-02T23:37:46.339 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1308, 2020-04-02T23:37:46.339 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.067130157, 2020-04-02T23:37:46.339 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000051322 2020-04-02T23:37:46.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.339 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2020-04-02T23:37:46.339 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.339 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.340 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.340 INFO:teuthology.orchestra.run.smithi042.stdout: } 2020-04-02T23:37:46.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.340 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2020-04-02T23:37:46.340 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 4981, 2020-04-02T23:37:46.340 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 8005, 2020-04-02T23:37:46.340 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 1531585, 2020-04-02T23:37:46.341 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 8046256, 2020-04-02T23:37:46.341 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 5, 2020-04-02T23:37:46.341 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 2, 2020-04-02T23:37:46.341 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.391335024, 2020-04-02T23:37:46.341 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.167973910, 2020-04-02T23:37:46.341 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.248960015, 2020-04-02T23:37:46.341 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.018910338, 2020-04-02T23:37:46.342 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2020-04-02T23:37:46.342 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 8005, 2020-04-02T23:37:46.342 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.593554838, 2020-04-02T23:37:46.342 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000074148 2020-04-02T23:37:46.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.342 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2020-04-02T23:37:46.342 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 10564, 2020-04-02T23:37:46.342 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.001806864, 2020-04-02T23:37:46.343 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000171 2020-04-02T23:37:46.343 INFO:teuthology.orchestra.run.smithi042.stdout: } 2020-04-02T23:37:46.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.343 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2020-04-02T23:37:46.343 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 1, 2020-04-02T23:37:46.343 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2020-04-02T23:37:46.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.344 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-MDSRank": { 2020-04-02T23:37:46.344 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2020-04-02T23:37:46.344 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2020-04-02T23:37:46.344 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 3144, 2020-04-02T23:37:46.344 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 1.884923718, 2020-04-02T23:37:46.344 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000599530 2020-04-02T23:37:46.345 INFO:teuthology.orchestra.run.smithi042.stdout: } 2020-04-02T23:37:46.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.345 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-PurgeQueue": { 2020-04-02T23:37:46.345 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2020-04-02T23:37:46.346 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2020-04-02T23:37:46.346 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 364, 2020-04-02T23:37:46.346 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.045870775, 2020-04-02T23:37:46.346 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000126018 2020-04-02T23:37:46.346 INFO:teuthology.orchestra.run.smithi042.stdout: } 2020-04-02T23:37:46.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.346 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": { 2020-04-02T23:37:46.346 INFO:teuthology.orchestra.run.smithi042.stdout: "request": 1369, 2020-04-02T23:37:46.347 INFO:teuthology.orchestra.run.smithi042.stdout: "reply": 1369, 2020-04-02T23:37:46.347 INFO:teuthology.orchestra.run.smithi042.stdout: "reply_latency": { 2020-04-02T23:37:46.347 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1369, 2020-04-02T23:37:46.347 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 1.923498319, 2020-04-02T23:37:46.347 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.001405038 2020-04-02T23:37:46.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.347 INFO:teuthology.orchestra.run.smithi042.stdout: "forward": 0, 2020-04-02T23:37:46.347 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch": 0, 2020-04-02T23:37:46.348 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_commit": 21, 2020-04-02T23:37:46.348 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_split": 1, 2020-04-02T23:37:46.348 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_merge": 0, 2020-04-02T23:37:46.348 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes": 248, 2020-04-02T23:37:46.348 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_top": 0, 2020-04-02T23:37:46.348 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_bottom": 248, 2020-04-02T23:37:46.348 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pin_tail": 0, 2020-04-02T23:37:46.349 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pinned": 248, 2020-04-02T23:37:46.349 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_expired": 0, 2020-04-02T23:37:46.349 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_with_caps": 82, 2020-04-02T23:37:46.349 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": 82, 2020-04-02T23:37:46.349 INFO:teuthology.orchestra.run.smithi042.stdout: "subtrees": 2, 2020-04-02T23:37:46.349 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse": 1403, 2020-04-02T23:37:46.349 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_hit": 1391, 2020-04-02T23:37:46.350 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_forward": 0, 2020-04-02T23:37:46.350 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_discover": 0, 2020-04-02T23:37:46.350 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_dir_fetch": 0, 2020-04-02T23:37:46.350 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_remote_ino": 0, 2020-04-02T23:37:46.350 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_lock": 0, 2020-04-02T23:37:46.350 INFO:teuthology.orchestra.run.smithi042.stdout: "load_cent": 511, 2020-04-02T23:37:46.350 INFO:teuthology.orchestra.run.smithi042.stdout: "q": 0, 2020-04-02T23:37:46.350 INFO:teuthology.orchestra.run.smithi042.stdout: "exported": 0, 2020-04-02T23:37:46.351 INFO:teuthology.orchestra.run.smithi042.stdout: "exported_inodes": 0, 2020-04-02T23:37:46.351 INFO:teuthology.orchestra.run.smithi042.stdout: "imported": 0, 2020-04-02T23:37:46.351 INFO:teuthology.orchestra.run.smithi042.stdout: "imported_inodes": 0, 2020-04-02T23:37:46.351 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_dir_fetch": 0, 2020-04-02T23:37:46.351 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_backtrace_fetch": 0, 2020-04-02T23:37:46.351 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_peer_discover": 0, 2020-04-02T23:37:46.351 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rfiles": 230, 2020-04-02T23:37:46.351 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rbytes": 13423980163, 2020-04-02T23:37:46.352 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rsnaps": 0 2020-04-02T23:37:46.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.352 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache": { 2020-04-02T23:37:46.352 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays": 84, 2020-04-02T23:37:46.352 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_delayed": 3, 2020-04-02T23:37:46.352 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_enqueuing": 0, 2020-04-02T23:37:46.352 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_created": 470, 2020-04-02T23:37:46.352 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_enqueued": 386, 2020-04-02T23:37:46.353 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_reintegrated": 0, 2020-04-02T23:37:46.353 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_migrated": 0, 2020-04-02T23:37:46.353 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_processing": 0, 2020-04-02T23:37:46.353 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_enqueued": 0, 2020-04-02T23:37:46.353 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_prioritized": 0, 2020-04-02T23:37:46.353 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_started": 0, 2020-04-02T23:37:46.353 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_completed": 0, 2020-04-02T23:37:46.354 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_enqueue_scrub": 0, 2020-04-02T23:37:46.354 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_exportdir": 0, 2020-04-02T23:37:46.354 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_flush": 0, 2020-04-02T23:37:46.354 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragmentdir": 1, 2020-04-02T23:37:46.354 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragstats": 0, 2020-04-02T23:37:46.354 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_inodestats": 0 2020-04-02T23:37:46.354 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.355 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log": { 2020-04-02T23:37:46.355 INFO:teuthology.orchestra.run.smithi042.stdout: "evadd": 3877, 2020-04-02T23:37:46.355 INFO:teuthology.orchestra.run.smithi042.stdout: "evex": 0, 2020-04-02T23:37:46.355 INFO:teuthology.orchestra.run.smithi042.stdout: "evtrm": 0, 2020-04-02T23:37:46.355 INFO:teuthology.orchestra.run.smithi042.stdout: "ev": 3877, 2020-04-02T23:37:46.356 INFO:teuthology.orchestra.run.smithi042.stdout: "evexg": 0, 2020-04-02T23:37:46.356 INFO:teuthology.orchestra.run.smithi042.stdout: "evexd": 0, 2020-04-02T23:37:46.356 INFO:teuthology.orchestra.run.smithi042.stdout: "segadd": 5, 2020-04-02T23:37:46.356 INFO:teuthology.orchestra.run.smithi042.stdout: "segex": 0, 2020-04-02T23:37:46.356 INFO:teuthology.orchestra.run.smithi042.stdout: "segtrm": 0, 2020-04-02T23:37:46.356 INFO:teuthology.orchestra.run.smithi042.stdout: "seg": 5, 2020-04-02T23:37:46.356 INFO:teuthology.orchestra.run.smithi042.stdout: "segexg": 0, 2020-04-02T23:37:46.357 INFO:teuthology.orchestra.run.smithi042.stdout: "segexd": 0, 2020-04-02T23:37:46.357 INFO:teuthology.orchestra.run.smithi042.stdout: "expos": 4194304, 2020-04-02T23:37:46.357 INFO:teuthology.orchestra.run.smithi042.stdout: "wrpos": 12808875, 2020-04-02T23:37:46.357 INFO:teuthology.orchestra.run.smithi042.stdout: "rdpos": 0, 2020-04-02T23:37:46.357 INFO:teuthology.orchestra.run.smithi042.stdout: "jlat": { 2020-04-02T23:37:46.358 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1530, 2020-04-02T23:37:46.358 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 4.399912262, 2020-04-02T23:37:46.358 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.002875759 2020-04-02T23:37:46.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.358 INFO:teuthology.orchestra.run.smithi042.stdout: "replayed": 0 2020-04-02T23:37:46.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.358 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_mem": { 2020-04-02T23:37:46.358 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 251, 2020-04-02T23:37:46.359 INFO:teuthology.orchestra.run.smithi042.stdout: "ino+": 483, 2020-04-02T23:37:46.359 INFO:teuthology.orchestra.run.smithi042.stdout: "ino-": 232, 2020-04-02T23:37:46.359 INFO:teuthology.orchestra.run.smithi042.stdout: "dir": 15, 2020-04-02T23:37:46.359 INFO:teuthology.orchestra.run.smithi042.stdout: "dir+": 34, 2020-04-02T23:37:46.359 INFO:teuthology.orchestra.run.smithi042.stdout: "dir-": 19, 2020-04-02T23:37:46.359 INFO:teuthology.orchestra.run.smithi042.stdout: "dn": 250, 2020-04-02T23:37:46.359 INFO:teuthology.orchestra.run.smithi042.stdout: "dn+": 785, 2020-04-02T23:37:46.360 INFO:teuthology.orchestra.run.smithi042.stdout: "dn-": 535, 2020-04-02T23:37:46.360 INFO:teuthology.orchestra.run.smithi042.stdout: "cap": 82, 2020-04-02T23:37:46.360 INFO:teuthology.orchestra.run.smithi042.stdout: "cap+": 471, 2020-04-02T23:37:46.360 INFO:teuthology.orchestra.run.smithi042.stdout: "cap-": 389, 2020-04-02T23:37:46.360 INFO:teuthology.orchestra.run.smithi042.stdout: "rss": 54072, 2020-04-02T23:37:46.360 INFO:teuthology.orchestra.run.smithi042.stdout: "heap": 315556 2020-04-02T23:37:46.360 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.360 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_server": { 2020-04-02T23:37:46.361 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_client_request": 1484, 2020-04-02T23:37:46.361 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_server_request": 0, 2020-04-02T23:37:46.361 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_request": 1369, 2020-04-02T23:37:46.361 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_session": 41, 2020-04-02T23:37:46.361 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_slave_request": 0, 2020-04-02T23:37:46.361 INFO:teuthology.orchestra.run.smithi042.stdout: "req_create_latency": { 2020-04-02T23:37:46.361 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 452, 2020-04-02T23:37:46.362 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.358091946, 2020-04-02T23:37:46.362 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000792238 2020-04-02T23:37:46.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.362 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getattr_latency": { 2020-04-02T23:37:46.362 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 7, 2020-04-02T23:37:46.362 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.001674518, 2020-04-02T23:37:46.362 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000239216 2020-04-02T23:37:46.363 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.363 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getfilelock_latency": { 2020-04-02T23:37:46.363 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.363 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.363 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.363 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.363 INFO:teuthology.orchestra.run.smithi042.stdout: "req_link_latency": { 2020-04-02T23:37:46.364 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.364 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.364 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.364 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.364 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookup_latency": { 2020-04-02T23:37:46.364 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2, 2020-04-02T23:37:46.364 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000805612, 2020-04-02T23:37:46.365 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000402806 2020-04-02T23:37:46.365 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.365 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookuphash_latency": { 2020-04-02T23:37:46.365 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.366 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.366 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.366 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupino_latency": { 2020-04-02T23:37:46.366 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.366 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.366 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.367 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupname_latency": { 2020-04-02T23:37:46.367 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.367 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.367 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.367 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupparent_latency": { 2020-04-02T23:37:46.368 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.368 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.368 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.368 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupsnap_latency": { 2020-04-02T23:37:46.368 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.368 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.368 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.369 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.369 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lssnap_latency": { 2020-04-02T23:37:46.369 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.369 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.369 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.369 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.369 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mkdir_latency": { 2020-04-02T23:37:46.369 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 14, 2020-04-02T23:37:46.370 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.015837759, 2020-04-02T23:37:46.370 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.001131268 2020-04-02T23:37:46.370 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.370 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mknod_latency": { 2020-04-02T23:37:46.370 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.370 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.370 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.371 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.371 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mksnap_latency": { 2020-04-02T23:37:46.371 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.371 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.371 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.371 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.371 INFO:teuthology.orchestra.run.smithi042.stdout: "req_open_latency": { 2020-04-02T23:37:46.371 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 352, 2020-04-02T23:37:46.372 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.353823959, 2020-04-02T23:37:46.372 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.001005181 2020-04-02T23:37:46.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.372 INFO:teuthology.orchestra.run.smithi042.stdout: "req_readdir_latency": { 2020-04-02T23:37:46.372 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 64, 2020-04-02T23:37:46.372 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.369337829, 2020-04-02T23:37:46.372 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.005770903 2020-04-02T23:37:46.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.373 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rename_latency": { 2020-04-02T23:37:46.373 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 22, 2020-04-02T23:37:46.373 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.043888610, 2020-04-02T23:37:46.373 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.001994936 2020-04-02T23:37:46.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.373 INFO:teuthology.orchestra.run.smithi042.stdout: "req_renamesnap_latency": { 2020-04-02T23:37:46.373 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.374 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.374 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.374 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.374 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmdir_latency": { 2020-04-02T23:37:46.374 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 14, 2020-04-02T23:37:46.374 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.220641904, 2020-04-02T23:37:46.374 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.015760136 2020-04-02T23:37:46.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.375 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmsnap_latency": { 2020-04-02T23:37:46.375 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.375 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.376 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.376 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmxattr_latency": { 2020-04-02T23:37:46.376 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.377 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.377 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.377 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.377 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setattr_latency": { 2020-04-02T23:37:46.377 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2020-04-02T23:37:46.377 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000433814, 2020-04-02T23:37:46.378 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000433814 2020-04-02T23:37:46.378 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.378 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setdirlayout_latency": { 2020-04-02T23:37:46.378 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.378 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.378 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.379 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.379 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setfilelock_latency": { 2020-04-02T23:37:46.379 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.379 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.379 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.379 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.379 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setlayout_latency": { 2020-04-02T23:37:46.380 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.380 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.380 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.380 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.380 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setxattr_latency": { 2020-04-02T23:37:46.380 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.380 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.381 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.381 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.381 INFO:teuthology.orchestra.run.smithi042.stdout: "req_symlink_latency": { 2020-04-02T23:37:46.381 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 4, 2020-04-02T23:37:46.381 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.003234182, 2020-04-02T23:37:46.381 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000808545 2020-04-02T23:37:46.381 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.381 INFO:teuthology.orchestra.run.smithi042.stdout: "req_unlink_latency": { 2020-04-02T23:37:46.382 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 437, 2020-04-02T23:37:46.384 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.555728186, 2020-04-02T23:37:46.384 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.001271689 2020-04-02T23:37:46.384 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.384 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_revoke_eviction": 0 2020-04-02T23:37:46.384 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.384 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_sessions": { 2020-04-02T23:37:46.384 INFO:teuthology.orchestra.run.smithi042.stdout: "session_count": 1, 2020-04-02T23:37:46.384 INFO:teuthology.orchestra.run.smithi042.stdout: "session_add": 1, 2020-04-02T23:37:46.385 INFO:teuthology.orchestra.run.smithi042.stdout: "session_remove": 0, 2020-04-02T23:37:46.385 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_open": 1, 2020-04-02T23:37:46.385 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_stale": 0, 2020-04-02T23:37:46.385 INFO:teuthology.orchestra.run.smithi042.stdout: "total_load": 294, 2020-04-02T23:37:46.385 INFO:teuthology.orchestra.run.smithi042.stdout: "average_load": 294, 2020-04-02T23:37:46.385 INFO:teuthology.orchestra.run.smithi042.stdout: "avg_session_uptime": 761 2020-04-02T23:37:46.385 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.385 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2020-04-02T23:37:46.386 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 0, 2020-04-02T23:37:46.386 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 0, 2020-04-02T23:37:46.386 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2020-04-02T23:37:46.386 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2020-04-02T23:37:46.386 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2020-04-02T23:37:46.387 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2020-04-02T23:37:46.387 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2020-04-02T23:37:46.387 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2020-04-02T23:37:46.387 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2020-04-02T23:37:46.387 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2020-04-02T23:37:46.387 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2020-04-02T23:37:46.388 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2020-04-02T23:37:46.388 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2020-04-02T23:37:46.388 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2020-04-02T23:37:46.388 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2020-04-02T23:37:46.388 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2020-04-02T23:37:46.388 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2020-04-02T23:37:46.389 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2020-04-02T23:37:46.389 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2020-04-02T23:37:46.389 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2020-04-02T23:37:46.389 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 1419155, 2020-04-02T23:37:46.389 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 411, 2020-04-02T23:37:46.389 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 176, 2020-04-02T23:37:46.389 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 2, 2020-04-02T23:37:46.390 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2020-04-02T23:37:46.390 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2020-04-02T23:37:46.390 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2020-04-02T23:37:46.390 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2020-04-02T23:37:46.390 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2020-04-02T23:37:46.390 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2020-04-02T23:37:46.390 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 6008, 2020-04-02T23:37:46.390 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 79, 2020-04-02T23:37:46.391 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2020-04-02T23:37:46.391 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2020-04-02T23:37:46.391 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2020-04-02T23:37:46.391 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2020-04-02T23:37:46.391 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 758303, 2020-04-02T23:37:46.391 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 13576, 2020-04-02T23:37:46.391 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2020-04-02T23:37:46.391 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2020-04-02T23:37:46.392 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2020-04-02T23:37:46.392 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2020-04-02T23:37:46.392 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.392 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter": { 2020-04-02T23:37:46.392 INFO:teuthology.orchestra.run.smithi042.stdout: "op_active": 10, 2020-04-02T23:37:46.392 INFO:teuthology.orchestra.run.smithi042.stdout: "op_laggy": 0, 2020-04-02T23:37:46.392 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send": 2082, 2020-04-02T23:37:46.393 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send_bytes": 8815272, 2020-04-02T23:37:46.393 INFO:teuthology.orchestra.run.smithi042.stdout: "op_resend": 31, 2020-04-02T23:37:46.393 INFO:teuthology.orchestra.run.smithi042.stdout: "op_reply": 2072, 2020-04-02T23:37:46.393 INFO:teuthology.orchestra.run.smithi042.stdout: "op": 2082, 2020-04-02T23:37:46.393 INFO:teuthology.orchestra.run.smithi042.stdout: "op_r": 27, 2020-04-02T23:37:46.393 INFO:teuthology.orchestra.run.smithi042.stdout: "op_w": 2055, 2020-04-02T23:37:46.393 INFO:teuthology.orchestra.run.smithi042.stdout: "op_rmw": 0, 2020-04-02T23:37:46.394 INFO:teuthology.orchestra.run.smithi042.stdout: "op_pg": 0, 2020-04-02T23:37:46.394 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_stat": 0, 2020-04-02T23:37:46.394 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_create": 11, 2020-04-02T23:37:46.394 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_read": 27, 2020-04-02T23:37:46.394 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_write": 1557, 2020-04-02T23:37:46.394 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writefull": 68, 2020-04-02T23:37:46.394 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writesame": 0, 2020-04-02T23:37:46.395 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_append": 0, 2020-04-02T23:37:46.395 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_zero": 0, 2020-04-02T23:37:46.395 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_truncate": 1, 2020-04-02T23:37:46.395 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_delete": 283, 2020-04-02T23:37:46.395 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_mapext": 0, 2020-04-02T23:37:46.395 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_sparse_read": 0, 2020-04-02T23:37:46.395 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_clonerange": 0, 2020-04-02T23:37:46.395 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_getxattr": 0, 2020-04-02T23:37:46.396 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_setxattr": 22, 2020-04-02T23:37:46.396 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_cmpxattr": 0, 2020-04-02T23:37:46.396 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_rmxattr": 0, 2020-04-02T23:37:46.396 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_resetxattrs": 0, 2020-04-02T23:37:46.396 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_call": 0, 2020-04-02T23:37:46.397 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_watch": 0, 2020-04-02T23:37:46.397 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_notify": 0, 2020-04-02T23:37:46.397 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_src_cmpxattr": 0, 2020-04-02T23:37:46.397 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls": 0, 2020-04-02T23:37:46.397 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls_filter": 0, 2020-04-02T23:37:46.397 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_other": 0, 2020-04-02T23:37:46.397 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_active": 0, 2020-04-02T23:37:46.397 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_send": 0, 2020-04-02T23:37:46.398 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_resend": 0, 2020-04-02T23:37:46.398 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_ping": 0, 2020-04-02T23:37:46.398 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_active": 0, 2020-04-02T23:37:46.398 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_send": 0, 2020-04-02T23:37:46.398 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_resend": 0, 2020-04-02T23:37:46.398 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_active": 0, 2020-04-02T23:37:46.398 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_send": 0, 2020-04-02T23:37:46.399 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_resend": 0, 2020-04-02T23:37:46.399 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_active": 0, 2020-04-02T23:37:46.399 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_send": 0, 2020-04-02T23:37:46.399 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_resend": 0, 2020-04-02T23:37:46.399 INFO:teuthology.orchestra.run.smithi042.stdout: "command_active": 0, 2020-04-02T23:37:46.399 INFO:teuthology.orchestra.run.smithi042.stdout: "command_send": 0, 2020-04-02T23:37:46.400 INFO:teuthology.orchestra.run.smithi042.stdout: "command_resend": 0, 2020-04-02T23:37:46.400 INFO:teuthology.orchestra.run.smithi042.stdout: "map_epoch": 0, 2020-04-02T23:37:46.400 INFO:teuthology.orchestra.run.smithi042.stdout: "map_full": 0, 2020-04-02T23:37:46.400 INFO:teuthology.orchestra.run.smithi042.stdout: "map_inc": 0, 2020-04-02T23:37:46.400 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_sessions": 6, 2020-04-02T23:37:46.400 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_open": 6, 2020-04-02T23:37:46.401 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_close": 0, 2020-04-02T23:37:46.401 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_laggy": 0, 2020-04-02T23:37:46.401 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_wr": 256, 2020-04-02T23:37:46.401 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_rd": 0, 2020-04-02T23:37:46.401 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_del": 81 2020-04-02T23:37:46.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.401 INFO:teuthology.orchestra.run.smithi042.stdout: "oft": { 2020-04-02T23:37:46.402 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_objs": 1, 2020-04-02T23:37:46.402 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_kv_pairs": 0, 2020-04-02T23:37:46.402 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_updates": 0, 2020-04-02T23:37:46.402 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_removes": 0 2020-04-02T23:37:46.402 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.402 INFO:teuthology.orchestra.run.smithi042.stdout: "purge_queue": { 2020-04-02T23:37:46.402 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops": 11, 2020-04-02T23:37:46.403 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops_high_water": 12, 2020-04-02T23:37:46.403 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing": 1, 2020-04-02T23:37:46.403 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_high_water": 3, 2020-04-02T23:37:46.403 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed": 233, 2020-04-02T23:37:46.403 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_item_in_journal": 153 2020-04-02T23:37:46.403 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.403 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-04-02T23:37:46.403 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2020-04-02T23:37:46.404 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2020-04-02T23:37:46.404 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2020-04-02T23:37:46.404 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 6451, 2020-04-02T23:37:46.404 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 1460947, 2020-04-02T23:37:46.404 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2020-04-02T23:37:46.404 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 6451, 2020-04-02T23:37:46.404 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2020-04-02T23:37:46.405 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2020-04-02T23:37:46.405 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 6451, 2020-04-02T23:37:46.405 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 1460947, 2020-04-02T23:37:46.405 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2020-04-02T23:37:46.405 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.405 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.405 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.405 INFO:teuthology.orchestra.run.smithi042.stdout: } 2020-04-02T23:37:46.406 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.406 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_bytes": { 2020-04-02T23:37:46.406 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2020-04-02T23:37:46.406 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2020-04-02T23:37:46.406 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2020-04-02T23:37:46.406 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2020-04-02T23:37:46.407 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2020-04-02T23:37:46.407 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2020-04-02T23:37:46.407 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2020-04-02T23:37:46.408 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 2082, 2020-04-02T23:37:46.408 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 8854266, 2020-04-02T23:37:46.408 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 1798, 2020-04-02T23:37:46.408 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 8854266, 2020-04-02T23:37:46.408 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2020-04-02T23:37:46.408 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.408 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.409 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.409 INFO:teuthology.orchestra.run.smithi042.stdout: } 2020-04-02T23:37:46.409 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.409 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_ops": { 2020-04-02T23:37:46.409 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 10, 2020-04-02T23:37:46.409 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 1024, 2020-04-02T23:37:46.409 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2020-04-02T23:37:46.410 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2020-04-02T23:37:46.410 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2020-04-02T23:37:46.410 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2020-04-02T23:37:46.410 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2020-04-02T23:37:46.410 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 2082, 2020-04-02T23:37:46.410 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 2082, 2020-04-02T23:37:46.410 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 2072, 2020-04-02T23:37:46.411 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 2072, 2020-04-02T23:37:46.411 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2020-04-02T23:37:46.411 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.411 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.411 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.411 INFO:teuthology.orchestra.run.smithi042.stdout: } 2020-04-02T23:37:46.411 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.412 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle": { 2020-04-02T23:37:46.412 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2020-04-02T23:37:46.412 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2020-04-02T23:37:46.412 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2020-04-02T23:37:46.412 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 386, 2020-04-02T23:37:46.412 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 38994, 2020-04-02T23:37:46.412 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2020-04-02T23:37:46.413 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 386, 2020-04-02T23:37:46.413 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2020-04-02T23:37:46.413 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2020-04-02T23:37:46.413 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 27, 2020-04-02T23:37:46.413 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 38994, 2020-04-02T23:37:46.413 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2020-04-02T23:37:46.413 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.413 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.414 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.414 INFO:teuthology.orchestra.run.smithi042.stdout: } 2020-04-02T23:37:46.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2020-04-02T23:37:46.414 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle-0x55f227fa5ae0": { 2020-04-02T23:37:46.414 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2020-04-02T23:37:46.414 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2020-04-02T23:37:46.414 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2020-04-02T23:37:46.415 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 3877, 2020-04-02T23:37:46.415 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 8614571, 2020-04-02T23:37:46.415 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2020-04-02T23:37:46.415 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 3877, 2020-04-02T23:37:46.415 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2020-04-02T23:37:46.415 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2020-04-02T23:37:46.415 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 1530, 2020-04-02T23:37:46.416 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 8614571, 2020-04-02T23:37:46.416 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2020-04-02T23:37:46.416 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2020-04-02T23:37:46.416 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2020-04-02T23:37:46.417 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2020-04-02T23:37:46.417 INFO:teuthology.orchestra.run.smithi042.stdout: } 2020-04-02T23:37:46.417 INFO:teuthology.orchestra.run.smithi042.stdout: } 2020-04-02T23:37:46.417 INFO:teuthology.orchestra.run.smithi042.stdout:} 2020-04-02T23:37:46.419 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=1 2020-04-02T23:37:46.419 DEBUG:tasks.check_counter:Getting stats from b 2020-04-02T23:37:46.419 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:37:48.002 INFO:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2020-04-02T23:37:55.028 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2020-04-02T23:37:55.028 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2020-04-02T23:37:55.028 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 2, 2020-04-02T23:37:55.028 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 2, 2020-04-02T23:37:55.029 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 214, 2020-04-02T23:37:55.029 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 280, 2020-04-02T23:37:55.029 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 4, 2020-04-02T23:37:55.029 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 18446744073709551614, 2020-04-02T23:37:55.029 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.001513067, 2020-04-02T23:37:55.029 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.000023850, 2020-04-02T23:37:55.029 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.000314461, 2020-04-02T23:37:55.030 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2020-04-02T23:37:55.030 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2020-04-02T23:37:55.030 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 2, 2020-04-02T23:37:55.030 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000549765, 2020-04-02T23:37:55.030 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000274882 2020-04-02T23:37:55.030 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2020-04-02T23:37:55.030 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2020-04-02T23:37:55.031 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2020-04-02T23:37:55.031 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2020-04-02T23:37:55.031 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2020-04-02T23:37:55.031 INFO:teuthology.orchestra.run.smithi084.stdout: } 2020-04-02T23:37:55.031 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2020-04-02T23:37:55.031 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2020-04-02T23:37:55.031 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 207, 2020-04-02T23:37:55.031 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 205, 2020-04-02T23:37:55.032 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 103340, 2020-04-02T23:37:55.032 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 108960, 2020-04-02T23:37:55.032 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 2, 2020-04-02T23:37:55.032 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 0, 2020-04-02T23:37:55.032 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.028390497, 2020-04-02T23:37:55.032 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.008268497, 2020-04-02T23:37:55.032 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.014257980, 2020-04-02T23:37:55.033 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.003263298, 2020-04-02T23:37:55.033 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2020-04-02T23:37:55.033 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 205, 2020-04-02T23:37:55.033 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.010748232, 2020-04-02T23:37:55.033 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000052430 2020-04-02T23:37:55.033 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2020-04-02T23:37:55.033 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2020-04-02T23:37:55.033 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2020-04-02T23:37:55.034 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2020-04-02T23:37:55.034 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2020-04-02T23:37:55.034 INFO:teuthology.orchestra.run.smithi084.stdout: } 2020-04-02T23:37:55.034 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2020-04-02T23:37:55.034 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2020-04-02T23:37:55.034 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 1, 2020-04-02T23:37:55.034 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 160, 2020-04-02T23:37:55.035 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 87, 2020-04-02T23:37:55.035 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 88928, 2020-04-02T23:37:55.035 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 3, 2020-04-02T23:37:55.035 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 0, 2020-04-02T23:37:55.035 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.009276492, 2020-04-02T23:37:55.035 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.006807758, 2020-04-02T23:37:55.035 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.001234920, 2020-04-02T23:37:55.035 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2020-04-02T23:37:55.036 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2020-04-02T23:37:55.036 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 158, 2020-04-02T23:37:55.036 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.010892611, 2020-04-02T23:37:55.036 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000068940 2020-04-02T23:37:55.036 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2020-04-02T23:37:55.036 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2020-04-02T23:37:55.036 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2020-04-02T23:37:55.037 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2020-04-02T23:37:55.037 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2020-04-02T23:37:55.037 INFO:teuthology.orchestra.run.smithi084.stdout: } 2020-04-02T23:37:55.037 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2020-04-02T23:37:55.037 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2020-04-02T23:37:55.037 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 0, 2020-04-02T23:37:55.037 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2020-04-02T23:37:55.038 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2020-04-02T23:37:55.038 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2020-04-02T23:37:55.038 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 0, 2020-04-02T23:37:55.038 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 0, 2020-04-02T23:37:55.038 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2020-04-02T23:37:55.038 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2020-04-02T23:37:55.039 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2020-04-02T23:37:55.039 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2020-04-02T23:37:55.039 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2020-04-02T23:37:55.039 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2020-04-02T23:37:55.039 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2020-04-02T23:37:55.039 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2020-04-02T23:37:55.039 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2020-04-02T23:37:55.040 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2020-04-02T23:37:55.040 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2020-04-02T23:37:55.040 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2020-04-02T23:37:55.040 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2020-04-02T23:37:55.040 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2020-04-02T23:37:55.040 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2020-04-02T23:37:55.040 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2020-04-02T23:37:55.041 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2020-04-02T23:37:55.041 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2020-04-02T23:37:55.041 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 82669, 2020-04-02T23:37:55.041 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 36, 2020-04-02T23:37:55.041 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2020-04-02T23:37:55.041 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2020-04-02T23:37:55.041 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2020-04-02T23:37:55.041 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2020-04-02T23:37:55.042 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2020-04-02T23:37:55.042 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2020-04-02T23:37:55.042 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2020-04-02T23:37:55.042 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2020-04-02T23:37:55.042 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 0, 2020-04-02T23:37:55.042 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 0, 2020-04-02T23:37:55.042 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2020-04-02T23:37:55.043 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2020-04-02T23:37:55.043 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2020-04-02T23:37:55.043 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2020-04-02T23:37:55.043 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 0, 2020-04-02T23:37:55.044 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 0, 2020-04-02T23:37:55.044 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2020-04-02T23:37:55.044 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2020-04-02T23:37:55.044 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2020-04-02T23:37:55.044 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2020-04-02T23:37:55.044 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2020-04-02T23:37:55.045 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-04-02T23:37:55.045 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2020-04-02T23:37:55.046 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2020-04-02T23:37:55.046 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2020-04-02T23:37:55.046 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 206, 2020-04-02T23:37:55.046 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 87298, 2020-04-02T23:37:55.046 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2020-04-02T23:37:55.046 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 206, 2020-04-02T23:37:55.046 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2020-04-02T23:37:55.047 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2020-04-02T23:37:55.047 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 206, 2020-04-02T23:37:55.047 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 87298, 2020-04-02T23:37:55.047 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2020-04-02T23:37:55.047 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2020-04-02T23:37:55.047 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2020-04-02T23:37:55.048 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2020-04-02T23:37:55.048 INFO:teuthology.orchestra.run.smithi084.stdout: } 2020-04-02T23:37:55.048 INFO:teuthology.orchestra.run.smithi084.stdout: } 2020-04-02T23:37:55.048 INFO:teuthology.orchestra.run.smithi084.stdout:} 2020-04-02T23:37:55.049 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.b 2020-04-02T23:37:55.050 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2020-04-02T23:37:55.063 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2020-04-02T23:37:55.063 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:37:55.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:37:55.080 INFO:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-02T23:37:55.080 INFO:teuthology.orchestra.run.smithi042:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:37:55.155 INFO:teuthology.orchestra.run.smithi042.stdout:fuseblk 2020-04-02T23:37:55.156 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-02T23:37:55.156 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:37:55.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:37:55.205 INFO:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-02T23:37:55.205 INFO:teuthology.orchestra.run.smithi042:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:37:55.271 INFO:teuthology.orchestra.run.smithi042.stdout:fuseblk 2020-04-02T23:37:55.271 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-04-02T23:37:55.271 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi042.front.sepia.ceph.com... 2020-04-02T23:37:55.272 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:37:55.323 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-04-02T23:37:55.323 INFO:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:37:55.419 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi042.stderr:ceph-fuse[29107]: fuse finished with error 0 and tester_r 0 2020-04-02T23:37:55.430 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:37:55.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-04-02T23:37:55.446 INFO:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-04-02T23:37:55.446 INFO:teuthology.orchestra.run.smithi042:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:37:55.505 INFO:teuthology.orchestra.run.smithi042.stdout:ext2/ext3 2020-04-02T23:37:55.505 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-04-02T23:37:55.506 INFO:teuthology.orchestra.run:waiting for 900 2020-04-02T23:38:13.517 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:38:13.531 INFO:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:38:13.576 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:38:13.591 INFO:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-04-02T23:38:13.651 INFO:tasks.ceph.osd.0.smithi042.stderr:2020-04-02T23:38:13.649+0000 7f3e0bd53700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36274) UID: 0 2020-04-02T23:38:13.651 INFO:tasks.ceph.osd.1.smithi042.stderr:2020-04-02T23:38:13.649+0000 7f0f58646700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36274) UID: 0 2020-04-02T23:38:13.651 INFO:tasks.ceph.osd.2.smithi042.stderr:2020-04-02T23:38:13.649+0000 7f71aecac700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36274) UID: 0 2020-04-02T23:38:13.652 INFO:tasks.ceph.osd.3.smithi042.stderr:2020-04-02T23:38:13.649+0000 7f9ddb5ad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 36274) UID: 0 2020-04-02T23:38:14.568 INFO:tasks.ceph.osd.4.smithi084.stderr:2020-04-02T23:38:14.566+0000 7f2bb0c4d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 26396) UID: 0 2020-04-02T23:38:14.569 INFO:tasks.ceph.osd.5.smithi084.stderr:2020-04-02T23:38:14.566+0000 7fe96bc43700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 26396) UID: 0 2020-04-02T23:38:14.569 INFO:tasks.ceph.osd.6.smithi084.stderr:2020-04-02T23:38:14.566+0000 7fd2d641d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 26396) UID: 0 2020-04-02T23:38:14.569 INFO:tasks.ceph.osd.7.smithi084.stderr:2020-04-02T23:38:14.566+0000 7f5cd0ce1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 26396) UID: 0 2020-04-02T23:39:20.923 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:20.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-04-02T23:39:20.938 INFO:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-04-02T23:39:21.148 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2020-04-02T23:39:21.160 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2020-04-02T23:39:21.160 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:21.191 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:39:21.677 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.672+0000 7ff44eb7d700 1 Processor -- start 2020-04-02T23:39:21.678 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.673+0000 7ff44eb7d700 1 -- start start 2020-04-02T23:39:21.678 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.674+0000 7ff44eb7d700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440038cd0 0x7ff440005870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:21.678 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.674+0000 7ff44eb7d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff44003d1c0 0x7ff44003d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:21.678 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.674+0000 7ff44eb7d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff440039c80 con 0x7ff440005cd0 2020-04-02T23:39:21.679 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.674+0000 7ff44eb7d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff440006e60 con 0x7ff44003d1c0 2020-04-02T23:39:21.679 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.674+0000 7ff44eb7d700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4400311f0 con 0x7ff440038cd0 2020-04-02T23:39:21.679 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.674+0000 7ff44e37c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff44003d1c0 0x7ff44003d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:21.679 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.674+0000 7ff44e37c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff44003d1c0 0x7ff44003d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.42:35010/0 (socket says 172.21.15.42:35010) 2020-04-02T23:39:21.679 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.674+0000 7ff44e37c700 1 -- 172.21.15.42:0/3090860089 learned_addr learned my addr 172.21.15.42:0/3090860089 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:39:21.686 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.683+0000 7ff44db7b700 1 --2- 172.21.15.42:0/3090860089 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440038cd0 0x7ff440005870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:21.686 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.683+0000 7ff44e37c700 1 -- 172.21.15.42:0/3090860089 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440038cd0 msgr2=0x7ff440005870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:21.686 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.683+0000 7ff44e37c700 1 --2- 172.21.15.42:0/3090860089 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440038cd0 0x7ff440005870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.683+0000 7ff44e37c700 1 -- 172.21.15.42:0/3090860089 >> v1:172.21.15.84:6789/0 conn(0x7ff440005cd0 legacy=0x7ff44003cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.683+0000 7ff44e37c700 1 -- 172.21.15.42:0/3090860089 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44003a3c0 con 0x7ff44003d1c0 2020-04-02T23:39:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.683+0000 7ff44db7b700 1 --2- 172.21.15.42:0/3090860089 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440038cd0 0x7ff440005870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:39:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.683+0000 7ff44e37c700 1 --2- 172.21.15.42:0/3090860089 >> v2:172.21.15.84:3300/0 conn(0x7ff44003d1c0 0x7ff44003d650 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff440042150 tx=0x7ff444007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.683+0000 7ff44e37c700 1 --2- 172.21.15.42:0/3090860089 >> v2:172.21.15.84:3300/0 conn(0x7ff44003d1c0 0x7ff44003d650 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff440042150 tx=0x7ff444007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.683+0000 7ff44e37c700 1 --2- 172.21.15.42:0/3090860089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff44003d1c0 0x7ff44003d650 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7ff440042150 tx=0x7ff444007a40).ready entity=mon.1 client_cookie=1ba266771761230b server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.683+0000 7ff44e37c700 1 --2- 172.21.15.42:0/3090860089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff44003d1c0 0x7ff44003d650 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7ff440042150 tx=0x7ff444007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:21.688 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.683+0000 7ff44e37c700 1 --2- 172.21.15.42:0/3090860089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff44003d1c0 0x7ff44003d650 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7ff440042150 tx=0x7ff444007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:21.688 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.683+0000 7ff44e37c700 1 --2- 172.21.15.42:0/3090860089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff44003d1c0 0x7ff44003d650 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7ff440042150 tx=0x7ff444007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:21.691 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.688+0000 7ff44cb79700 1 -- 172.21.15.42:0/3090860089 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4440116e0 con 0x7ff44003d1c0 2020-04-02T23:39:21.691 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.688+0000 7ff44cb79700 1 -- 172.21.15.42:0/3090860089 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff444011840 con 0x7ff44003d1c0 2020-04-02T23:39:21.691 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.688+0000 7ff44cb79700 1 -- 172.21.15.42:0/3090860089 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff444011c60 con 0x7ff44003d1c0 2020-04-02T23:39:21.692 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.689+0000 7ff44eb7d700 1 -- 172.21.15.42:0/3090860089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff44003d1c0 msgr2=0x7ff44003d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:21.692 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.689+0000 7ff44eb7d700 1 --2- 172.21.15.42:0/3090860089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff44003d1c0 0x7ff44003d650 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7ff440042150 tx=0x7ff444007a40).stop 2020-04-02T23:39:21.695 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.693+0000 7ff44eb7d700 1 -- 172.21.15.42:0/3090860089 shutdown_connections 2020-04-02T23:39:21.696 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.693+0000 7ff44eb7d700 1 --2- 172.21.15.42:0/3090860089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff44003d1c0 0x7ff44003d650 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:21.696 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.693+0000 7ff44eb7d700 1 --2- 172.21.15.42:0/3090860089 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440038cd0 0x7ff440005870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:21.696 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.693+0000 7ff44eb7d700 1 -- 172.21.15.42:0/3090860089 >> 172.21.15.42:0/3090860089 conn(0x7ff440041260 msgr2=0x7ff440041670 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:21.700 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.697+0000 7ff44eb7d700 1 -- 172.21.15.42:0/3090860089 shutdown_connections 2020-04-02T23:39:21.700 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.697+0000 7ff44eb7d700 1 -- 172.21.15.42:0/3090860089 wait complete. 2020-04-02T23:39:21.701 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.698+0000 7ff44eb7d700 1 Processor -- start 2020-04-02T23:39:21.701 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.699+0000 7ff44eb7d700 1 -- start start 2020-04-02T23:39:21.708 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.699+0000 7ff44eb7d700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440005cd0 0x7ff440037480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:21.709 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.699+0000 7ff44eb7d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff440038cd0 0x7ff4400c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:21.709 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.699+0000 7ff44eb7d700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff440037050 con 0x7ff44003d1c0 2020-04-02T23:39:21.709 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.699+0000 7ff44eb7d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44002f640 con 0x7ff440038cd0 2020-04-02T23:39:21.709 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.699+0000 7ff44eb7d700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff440037ff0 con 0x7ff440005cd0 2020-04-02T23:39:21.709 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.700+0000 7ff44db7b700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440005cd0 0x7ff440037480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:21.709 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.700+0000 7ff44db7b700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440005cd0 0x7ff440037480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.42:60278/0 (socket says 172.21.15.42:60278) 2020-04-02T23:39:21.709 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.700+0000 7ff44db7b700 1 -- 172.21.15.42:0/2403843428 learned_addr learned my addr 172.21.15.42:0/2403843428 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:39:21.710 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.701+0000 7ff44d37a700 1 --2- 172.21.15.42:0/2403843428 >> v2:172.21.15.84:3300/0 conn(0x7ff440038cd0 0x7ff4400c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:21.710 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.701+0000 7ff44db7b700 1 -- 172.21.15.42:0/2403843428 >> v2:172.21.15.84:3300/0 conn(0x7ff440038cd0 msgr2=0x7ff4400c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:21.710 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.701+0000 7ff44db7b700 1 --2- 172.21.15.42:0/2403843428 >> v2:172.21.15.84:3300/0 conn(0x7ff440038cd0 0x7ff4400c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:21.710 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.701+0000 7ff44db7b700 1 -- 172.21.15.42:0/2403843428 >> v1:172.21.15.84:6789/0 conn(0x7ff44003d1c0 legacy=0x7ff4400c81b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-04-02T23:39:21.710 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.701+0000 7ff44db7b700 1 -- 172.21.15.42:0/2403843428 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44002fed0 con 0x7ff440005cd0 2020-04-02T23:39:21.710 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.701+0000 7ff44d37a700 1 --2- 172.21.15.42:0/2403843428 >> v2:172.21.15.84:3300/0 conn(0x7ff440038cd0 0x7ff4400c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:39:21.711 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.701+0000 7ff44db7b700 1 --2- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440005cd0 0x7ff440037480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4400045f0 tx=0x7ff44805a0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:21.711 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.701+0000 7ff44db7b700 1 --2- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440005cd0 0x7ff440037480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4400045f0 tx=0x7ff44805a0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:21.711 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.701+0000 7ff44db7b700 1 --2- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440005cd0 0x7ff440037480 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7ff4400045f0 tx=0x7ff44805a0c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:21.711 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.701+0000 7ff44db7b700 1 --2- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440005cd0 0x7ff440037480 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7ff4400045f0 tx=0x7ff44805a0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:21.711 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.701+0000 7ff44db7b700 1 --2- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440005cd0 0x7ff440037480 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7ff4400045f0 tx=0x7ff44805a0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:21.711 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.701+0000 7ff44db7b700 1 --2- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440005cd0 0x7ff440037480 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7ff4400045f0 tx=0x7ff44805a0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:21.711 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.701+0000 7ff436ffd700 1 -- 172.21.15.42:0/2403843428 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff448080760 con 0x7ff440005cd0 2020-04-02T23:39:21.711 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.702+0000 7ff436ffd700 1 -- 172.21.15.42:0/2403843428 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff448080900 con 0x7ff440005cd0 2020-04-02T23:39:21.712 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.702+0000 7ff436ffd700 1 -- 172.21.15.42:0/2403843428 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff448080d20 con 0x7ff440005cd0 2020-04-02T23:39:21.712 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.705+0000 7ff44eb7d700 1 -- 172.21.15.42:0/2403843428 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff440030170 con 0x7ff440005cd0 2020-04-02T23:39:21.712 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.705+0000 7ff44eb7d700 1 -- 172.21.15.42:0/2403843428 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44002df10 con 0x7ff440005cd0 2020-04-02T23:39:21.712 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.708+0000 7ff44eb7d700 1 -- 172.21.15.42:0/2403843428 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff424003340 con 0x7ff440005cd0 2020-04-02T23:39:21.721 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.719+0000 7ff44db7b700 1 --2- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440005cd0 0x7ff440037480 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7ff4400045f0 tx=0x7ff44805a0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:21.722 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.719+0000 7ff436ffd700 1 -- 172.21.15.42:0/2403843428 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff4480622f0 con 0x7ff440005cd0 2020-04-02T23:39:21.722 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.719+0000 7ff44db7b700 1 --2- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440005cd0 0x7ff440037480 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7ff4400045f0 tx=0x7ff44805a0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:21.725 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.721+0000 7ff44db7b700 1 --2- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440005cd0 0x7ff440037480 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7ff4400045f0 tx=0x7ff44805a0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:21.725 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.721+0000 7ff436ffd700 1 --2- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ff42804d720 0x7ff42804fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:21.726 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.721+0000 7ff436ffd700 1 -- 172.21.15.42:0/2403843428 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff4480cf140 con 0x7ff440005cd0 2020-04-02T23:39:21.726 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.722+0000 7ff436ffd700 1 -- 172.21.15.42:0/2403843428 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7ff4480cf460 con 0x7ff440005cd0 2020-04-02T23:39:21.729 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.726+0000 7ff44d37a700 1 --2- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ff42804d720 0x7ff42804fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:21.731 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.727+0000 7ff44d37a700 1 --2- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ff42804d720 0x7ff42804fbe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff438002f40 tx=0x7ff438007c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:21.731 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.728+0000 7ff44d37a700 1 --2- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ff42804d720 0x7ff42804fbe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff438002f40 tx=0x7ff438007c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:21.731 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:21.728+0000 7ff44d37a700 1 --2- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ff42804d720 0x7ff42804fbe0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7ff438002f40 tx=0x7ff438007c80).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.019+0000 7ff44eb7d700 1 -- 172.21.15.42:0/2403843428 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4240021d0 con 0x7ff440005cd0 2020-04-02T23:39:22.027 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.024+0000 7ff44db7b700 1 --2- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440005cd0 0x7ff440037480 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7ff4400045f0 tx=0x7ff44805a0c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:22.027 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.024+0000 7ff436ffd700 1 -- 172.21.15.42:0/2403843428 <== mon.2 v2:172.21.15.84:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16299 (secure 0 0 0) 0x7ff4480aa900 con 0x7ff440005cd0 2020-04-02T23:39:22.033 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:39:22.033 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":26,"fsid":"571c521c-9ca7-4052-ba5b-7a77e18ff12c","created":"2020-04-02T23:24:23.980442+0000","modified":"2020-04-02T23:24:48.393847+0000","last_up_change":"2020-04-02T23:24:36.096260+0000","last_in_change":"2020-04-02T23:24:36.096260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:24:27.091980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:24:40.298468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:24:43.688260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:24:45.991301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"976aac36-1cf8-408b-bf56-9f0eefe43b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":24836},{"type":"v1","addr":"172.21.15.42:6801","nonce":24836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":24836},{"type":"v1","addr":"172.21.15.42:6803","nonce":24836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":24836},{"type":"v1","addr":"172.21.15.42:6807","nonce":24836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":24836},{"type":"v1","addr":"172.21.15.42:6805","nonce":24836}]},"public_addr":"172.21.15.42:6801/24836","cluster_addr":"172.21.15.42:6803/24836","heartbeat_back_addr":"172.21.15.42:6807/24836","heartbeat_front_addr":"172.21.15.42:6805/24836","state":["exists","up"]},{"osd":1,"uuid":"22c1e489-ab99-4205-ba9d-fbfc144d2a8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":24881},{"type":"v1","addr":"172.21.15.42:6809","nonce":24881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":24881},{"type":"v1","addr":"172.21.15.42:6811","nonce":24881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":24881},{"type":"v1","addr":"172.21.15.42:6815","nonce":24881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":24881},{"type":"v1","addr":"172.21.15.42:6813","nonce":24881}]},"public_addr":"172.21.15.42:6809/24881","cluster_addr":"172.21.15.42:6811/24881","heartbeat_back_addr":"172.21.15.42:6815/24881","heartbeat_front_addr":"172.21.15.42:6813/24881","state":["exists","up"]},{"osd":2,"uuid":"f0b18b09-93c0-4286-8d15-746611ba53cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":24917},{"type":"v1","addr":"172.21.15.42:6817","nonce":24917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":24917},{"type":"v1","addr":"172.21.15.42:6819","nonce":24917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":24917},{"type":"v1","addr":"172.21.15.42:6823","nonce":24917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":24917},{"type":"v1","addr":"172.21.15.42:6821","nonce":24917}]},"public_addr":"172.21.15.42:6817/24917","cluster_addr":"172.21.15.42:6819/24917","heartbeat_back_addr":"172.21.15.42:6823/24917","heartbeat_front_addr":"172.21.15.42:6821/24917","state":["exists","up"]},{"osd":3,"uuid":"989d4a69-9abe-44de-95f2-6c7cbbe07471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":24940},{"type":"v1","addr":"172.21.15.42:6825","nonce":24940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":24940},{"type":"v1","addr":"172.21.15.42:6827","nonce":24940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":24940},{"type":"v1","addr":"172.21.15.42:6831","nonce":24940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":24940},{"type":"v1","addr":"172.21.15.42:6829","nonce":24940}]},"public_addr":"172.21.15.42:6825/24940","cluster_addr":"172.21.15.42:6827/24940","heartbeat_back_addr":"172.21.15.42:6831/24940","heartbeat_front_addr":"172.21.15.42:6829/24940","state":["exists","up"]},{"osd":4,"uuid":"b1a2ce60-ae80-4f8a-97a3-4fbb1399fdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":24239},{"type":"v1","addr":"172.21.15.84:6803","nonce":24239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":24239},{"type":"v1","addr":"172.21.15.84:6805","nonce":24239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":24239},{"type":"v1","addr":"172.21.15.84:6809","nonce":24239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":24239},{"type":"v1","addr":"172.21.15.84:6807","nonce":24239}]},"public_addr":"172.21.15.84:6803/24239","cluster_addr":"172.21.15.84:6805/24239","heartbeat_back_addr":"172.21.15.84:6809/24239","heartbeat_front_addr":"172.21.15.84:6807/24239","state":["exists","up"]},{"osd":5,"uuid":"396b36e5-7226-4e8e-aa8a-749cb5cec101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":24276},{"type":"v1","addr":"172.21.15.84:6811","nonce":24276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":24276},{"type":"v1","addr":"172.21.15.84:6813","nonce":24276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":24276},{"type":"v1","addr":"172.21.15.84:6817","nonce":24276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":24276},{"type":"v1","addr":"172.21.15.84:6815","nonce":24276}]},"public_addr":"172.21.15.84:6811/24276","cluster_addr":"172.21.15.84:6813/24276","heartbeat_back_addr":"172.21.15.84:6817/24276","heartbeat_front_addr":"172.21.15.84:6815/24276","state":["exists","up"]},{"osd":6,"uuid":"884bb915-28c3-463d-8046-e2908f6e8e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":24319},{"type":"v1","addr":"172.21.15.84:6819","nonce":24319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":24319},{"type":"v1","addr":"172.21.15.84:6821","nonce":24319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":24319},{"type":"v1","addr":"172.21.15.84:6825","nonce":24319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":24319},{"type":"v1","addr":"172.21.15.84:6823","nonce":24319}]},"public_addr":"172.21.15.84:6819/24319","cluster_addr":"172.21.15.84:6821/24319","heartbeat_back_addr":"172.21.15.84:6825/24319","heartbeat_front_addr":"172.21.15.84:6823/24319","state":["exists","up"]},{"osd":7,"uuid":"70e90d1d-f081-4de5-af4b-e987c159e597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":24349},{"type":"v1","addr":"172.21.15.84:6827","nonce":24349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":24349},{"type":"v1","addr":"172.21.15.84:6829","nonce":24349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":24349},{"type":"v1","addr":"172.21.15.84:6833","nonce":24349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":24349},{"type":"v1","addr":"172.21.15.84:6831","nonce":24349}]},"public_addr":"172.21.15.84:6827/24349","cluster_addr":"172.21.15.84:6829/24349","heartbeat_back_addr":"172.21.15.84:6833/24349","heartbeat_front_addr":"172.21.15.84:6831/24349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.195657+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.241354+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.257764+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.368827+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.967296+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.991068+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.077047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.095727+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:39:22.039 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.035+0000 7ff44eb7d700 1 -- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ff42804d720 msgr2=0x7ff42804fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:22.039 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.035+0000 7ff44eb7d700 1 --2- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ff42804d720 0x7ff42804fbe0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7ff438002f40 tx=0x7ff438007c80).stop 2020-04-02T23:39:22.039 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.035+0000 7ff44eb7d700 1 -- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440005cd0 msgr2=0x7ff440037480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:22.039 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.035+0000 7ff44eb7d700 1 --2- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440005cd0 0x7ff440037480 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7ff4400045f0 tx=0x7ff44805a0c0).stop 2020-04-02T23:39:22.039 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.035+0000 7ff44eb7d700 1 -- 172.21.15.42:0/2403843428 shutdown_connections 2020-04-02T23:39:22.039 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.035+0000 7ff44eb7d700 1 --2- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ff42804d720 0x7ff42804fbe0 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0x7ff438002f40 tx=0x7ff438007c80).stop 2020-04-02T23:39:22.040 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.035+0000 7ff44eb7d700 1 --2- 172.21.15.42:0/2403843428 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff440005cd0 0x7ff440037480 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:22.040 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.035+0000 7ff44eb7d700 1 --2- 172.21.15.42:0/2403843428 >> v2:172.21.15.84:3300/0 conn(0x7ff440038cd0 0x7ff4400c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:22.040 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.036+0000 7ff44eb7d700 1 -- 172.21.15.42:0/2403843428 >> 172.21.15.42:0/2403843428 conn(0x7ff440041260 msgr2=0x7ff4400c9410 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:22.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.041+0000 7ff44eb7d700 1 -- 172.21.15.42:0/2403843428 shutdown_connections 2020-04-02T23:39:22.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.041+0000 7ff44eb7d700 1 -- 172.21.15.42:0/2403843428 wait complete. 2020-04-02T23:39:22.070 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:22.106 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-02T23:39:22.386 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.378+0000 7fc01acd2700 1 Processor -- start 2020-04-02T23:39:22.386 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.380+0000 7fc01acd2700 1 -- start start 2020-04-02T23:39:22.387 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.381+0000 7fc01acd2700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc0140ac310 0x7fc01409e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:22.387 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.381+0000 7fc01acd2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc0140a6310 0x7fc014066a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:22.387 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.381+0000 7fc01acd2700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0140a6a20 con 0x7fc014066e70 2020-04-02T23:39:22.387 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.381+0000 7fc01acd2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc014066570 con 0x7fc0140a6310 2020-04-02T23:39:22.387 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.381+0000 7fc01acd2700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140a6770 con 0x7fc0140ac310 2020-04-02T23:39:22.388 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.386+0000 7fc013fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc0140a6310 0x7fc014066a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:22.389 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.386+0000 7fc013fff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc0140a6310 0x7fc014066a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.42:35024/0 (socket says 172.21.15.42:35024) 2020-04-02T23:39:22.389 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.386+0000 7fc013fff700 1 -- 172.21.15.42:0/3879211062 learned_addr learned my addr 172.21.15.42:0/3879211062 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:39:22.391 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.386+0000 7fc013fff700 1 -- 172.21.15.42:0/3879211062 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc0140ac310 msgr2=0x7fc01409e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:22.391 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.386+0000 7fc013fff700 1 --2- 172.21.15.42:0/3879211062 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc0140ac310 0x7fc01409e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:22.391 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.386+0000 7fc013fff700 1 -- 172.21.15.42:0/3879211062 >> v1:172.21.15.84:6789/0 conn(0x7fc014066e70 legacy=0x7fc01413c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:22.391 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.386+0000 7fc0137fe700 1 -- 172.21.15.42:0/3879211062 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736091004 0 0) 0x7fc0140a6a20 con 0x7fc014066e70 2020-04-02T23:39:22.391 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.386+0000 7fc013fff700 1 -- 172.21.15.42:0/3879211062 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0140ac6f0 con 0x7fc0140a6310 2020-04-02T23:39:22.391 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.386+0000 7fc013fff700 1 --2- 172.21.15.42:0/3879211062 >> v2:172.21.15.84:3300/0 conn(0x7fc0140a6310 0x7fc014066a10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc008002f30 tx=0x7fc008007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:22.391 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.386+0000 7fc013fff700 1 --2- 172.21.15.42:0/3879211062 >> v2:172.21.15.84:3300/0 conn(0x7fc0140a6310 0x7fc014066a10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc008002f30 tx=0x7fc008007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:22.392 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.386+0000 7fc013fff700 1 --2- 172.21.15.42:0/3879211062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0140a6310 0x7fc014066a10 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7fc008002f30 tx=0x7fc008007a40).ready entity=mon.1 client_cookie=5e614ff6140da82a server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:22.392 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.387+0000 7fc013fff700 1 --2- 172.21.15.42:0/3879211062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0140a6310 0x7fc014066a10 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fc008002f30 tx=0x7fc008007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:22.392 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.387+0000 7fc0137fe700 1 -- 172.21.15.42:0/3879211062 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc008008e20 con 0x7fc0140a6310 2020-04-02T23:39:22.392 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.387+0000 7fc013fff700 1 --2- 172.21.15.42:0/3879211062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0140a6310 0x7fc014066a10 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fc008002f30 tx=0x7fc008007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:22.392 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.387+0000 7fc0137fe700 1 -- 172.21.15.42:0/3879211062 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc008011910 con 0x7fc0140a6310 2020-04-02T23:39:22.392 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.387+0000 7fc013fff700 1 --2- 172.21.15.42:0/3879211062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0140a6310 0x7fc014066a10 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7fc008002f30 tx=0x7fc008007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:22.393 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.387+0000 7fc0137fe700 1 -- 172.21.15.42:0/3879211062 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc008008e20 con 0x7fc0140a6310 2020-04-02T23:39:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.388+0000 7fc01acd2700 1 -- 172.21.15.42:0/3879211062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0140a6310 msgr2=0x7fc014066a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.388+0000 7fc01acd2700 1 --2- 172.21.15.42:0/3879211062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0140a6310 0x7fc014066a10 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7fc008002f30 tx=0x7fc008007a40).stop 2020-04-02T23:39:22.396 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.393+0000 7fc01acd2700 1 -- 172.21.15.42:0/3879211062 shutdown_connections 2020-04-02T23:39:22.396 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.393+0000 7fc01acd2700 1 --2- 172.21.15.42:0/3879211062 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc0140ac310 0x7fc01409e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:22.396 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.393+0000 7fc01acd2700 1 --2- 172.21.15.42:0/3879211062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0140a6310 0x7fc014066a10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:22.396 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.393+0000 7fc01acd2700 1 -- 172.21.15.42:0/3879211062 >> 172.21.15.42:0/3879211062 conn(0x7fc01405c7e0 msgr2=0x7fc0140aba40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:22.402 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.399+0000 7fc01acd2700 1 -- 172.21.15.42:0/3879211062 shutdown_connections 2020-04-02T23:39:22.406 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.403+0000 7fc01acd2700 1 -- 172.21.15.42:0/3879211062 wait complete. 2020-04-02T23:39:22.407 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.404+0000 7fc01acd2700 1 Processor -- start 2020-04-02T23:39:22.407 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.404+0000 7fc01acd2700 1 -- start start 2020-04-02T23:39:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.405+0000 7fc01acd2700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc014066e70 0x7fc014133d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.405+0000 7fc01acd2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc0140ac310 0x7fc014132440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.405+0000 7fc01acd2700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc014135950 con 0x7fc0140a6310 2020-04-02T23:39:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.405+0000 7fc01acd2700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc014135770 con 0x7fc014066e70 2020-04-02T23:39:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.405+0000 7fc01acd2700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0140a21c0 con 0x7fc0140ac310 2020-04-02T23:39:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.405+0000 7fc018a6e700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc014066e70 0x7fc014133d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.405+0000 7fc013fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc0140a6310 0x7fc014131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59962/0 (socket says 172.21.15.42:59962) 2020-04-02T23:39:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.405+0000 7fc013fff700 1 -- 172.21.15.42:0/114650876 learned_addr learned my addr 172.21.15.42:0/114650876 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.405+0000 7fc01926f700 1 --2- 172.21.15.42:0/114650876 >> v2:172.21.15.84:3300/0 conn(0x7fc0140ac310 0x7fc014132440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.405+0000 7fc018a6e700 1 -- 172.21.15.42:0/114650876 >> v2:172.21.15.84:3300/0 conn(0x7fc0140ac310 msgr2=0x7fc014132440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.405+0000 7fc018a6e700 1 --2- 172.21.15.42:0/114650876 >> v2:172.21.15.84:3300/0 conn(0x7fc0140ac310 0x7fc014132440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.405+0000 7fc018a6e700 1 -- 172.21.15.42:0/114650876 >> v1:172.21.15.42:6789/0 conn(0x7fc0140a6310 legacy=0x7fc014131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.405+0000 7fc011ffb700 1 -- 172.21.15.42:0/114650876 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810079395 0 0) 0x7fc014135950 con 0x7fc0140a6310 2020-04-02T23:39:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.405+0000 7fc018a6e700 1 -- 172.21.15.42:0/114650876 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0140a2460 con 0x7fc014066e70 2020-04-02T23:39:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.405+0000 7fc018a6e700 1 --2- 172.21.15.42:0/114650876 >> v2:172.21.15.42:3300/0 conn(0x7fc014066e70 0x7fc014133d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc000002f30 tx=0x7fc000010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.405+0000 7fc018a6e700 1 --2- 172.21.15.42:0/114650876 >> v2:172.21.15.42:3300/0 conn(0x7fc014066e70 0x7fc014133d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc000002f30 tx=0x7fc000010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.405+0000 7fc018a6e700 1 --2- 172.21.15.42:0/114650876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc014066e70 0x7fc014133d60 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7fc000002f30 tx=0x7fc000010910).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.406+0000 7fc018a6e700 1 --2- 172.21.15.42:0/114650876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc014066e70 0x7fc014133d60 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fc000002f30 tx=0x7fc000010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.406+0000 7fc011ffb700 1 -- 172.21.15.42:0/114650876 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc000005df0 con 0x7fc014066e70 2020-04-02T23:39:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.406+0000 7fc018a6e700 1 --2- 172.21.15.42:0/114650876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc014066e70 0x7fc014133d60 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fc000002f30 tx=0x7fc000010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.406+0000 7fc01acd2700 1 -- 172.21.15.42:0/114650876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0140a2700 con 0x7fc014066e70 2020-04-02T23:39:22.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.406+0000 7fc011ffb700 1 -- 172.21.15.42:0/114650876 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc000007160 con 0x7fc014066e70 2020-04-02T23:39:22.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.406+0000 7fc018a6e700 1 --2- 172.21.15.42:0/114650876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc014066e70 0x7fc014133d60 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fc000002f30 tx=0x7fc000010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:22.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.406+0000 7fc011ffb700 1 -- 172.21.15.42:0/114650876 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc000007540 con 0x7fc014066e70 2020-04-02T23:39:22.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.406+0000 7fc01acd2700 1 -- 172.21.15.42:0/114650876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc014135270 con 0x7fc014066e70 2020-04-02T23:39:22.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.406+0000 7fc018a6e700 1 --2- 172.21.15.42:0/114650876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc014066e70 0x7fc014133d60 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fc000002f30 tx=0x7fc000010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:22.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.407+0000 7fc011ffb700 1 -- 172.21.15.42:0/114650876 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fc0000088d0 con 0x7fc014066e70 2020-04-02T23:39:22.417 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.407+0000 7fc018a6e700 1 --2- 172.21.15.42:0/114650876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc014066e70 0x7fc014133d60 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fc000002f30 tx=0x7fc000010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:22.417 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.407+0000 7fc011ffb700 1 --2- 172.21.15.42:0/114650876 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fbffc04d420 0x7fbffc04f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:22.417 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.408+0000 7fc011ffb700 1 -- 172.21.15.42:0/114650876 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc000060bc0 con 0x7fc014066e70 2020-04-02T23:39:22.417 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.408+0000 7fc013fff700 1 --2- 172.21.15.42:0/114650876 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fbffc04d420 0x7fbffc04f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:22.417 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.408+0000 7fc013fff700 1 --2- 172.21.15.42:0/114650876 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fbffc04d420 0x7fbffc04f8e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc008010300 tx=0x7fc008007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:22.417 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.408+0000 7fc013fff700 1 --2- 172.21.15.42:0/114650876 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fbffc04d420 0x7fbffc04f8e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc008010300 tx=0x7fc008007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:22.417 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.408+0000 7fc013fff700 1 --2- 172.21.15.42:0/114650876 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fbffc04d420 0x7fbffc04f8e0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7fc008010300 tx=0x7fc008007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:22.418 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.409+0000 7fc01acd2700 1 -- 172.21.15.42:0/114650876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01405edc0 con 0x7fc014066e70 2020-04-02T23:39:22.436 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.433+0000 7fc018a6e700 1 --2- 172.21.15.42:0/114650876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc014066e70 0x7fc014133d60 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7fc000002f30 tx=0x7fc000010910).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:22.436 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.433+0000 7fc011ffb700 1 -- 172.21.15.42:0/114650876 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fc00003c350 con 0x7fc014066e70 2020-04-02T23:39:22.708 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.706+0000 7fc01acd2700 1 -- 172.21.15.42:0/114650876 --> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc0140a28c0 con 0x7fbffc04d420 2020-04-02T23:39:22.721 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.715+0000 7fc013fff700 1 --2- 172.21.15.42:0/114650876 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fbffc04d420 0x7fbffc04f8e0 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fc008010300 tx=0x7fc008007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:22.721 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.719+0000 7fc011ffb700 1 -- 172.21.15.42:0/114650876 <== mgr.4100 v2:172.21.15.84:6800/23437 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+107372 (secure 0 0 0) 0x7fc0140a28c0 con 0x7fbffc04d420 2020-04-02T23:39:22.724 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:39:22.744 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.741+0000 7fc01acd2700 1 -- 172.21.15.42:0/114650876 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fbffc04d420 msgr2=0x7fbffc04f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:22.745 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.741+0000 7fc01acd2700 1 --2- 172.21.15.42:0/114650876 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fbffc04d420 0x7fbffc04f8e0 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7fc008010300 tx=0x7fc008007a40).stop 2020-04-02T23:39:22.745 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.742+0000 7fc01acd2700 1 -- 172.21.15.42:0/114650876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc014066e70 msgr2=0x7fc014133d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:22.745 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.742+0000 7fc01acd2700 1 --2- 172.21.15.42:0/114650876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc014066e70 0x7fc014133d60 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7fc000002f30 tx=0x7fc000010910).stop 2020-04-02T23:39:22.748 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.745+0000 7fc01acd2700 1 -- 172.21.15.42:0/114650876 shutdown_connections 2020-04-02T23:39:22.748 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.745+0000 7fc01acd2700 1 --2- 172.21.15.42:0/114650876 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fbffc04d420 0x7fbffc04f8e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:22.748 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.745+0000 7fc01acd2700 1 --2- 172.21.15.42:0/114650876 >> v2:172.21.15.84:3300/0 conn(0x7fc0140ac310 0x7fc014132440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:22.748 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.745+0000 7fc01acd2700 1 --2- 172.21.15.42:0/114650876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc014066e70 0x7fc014133d60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:22.748 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.745+0000 7fc01acd2700 1 -- 172.21.15.42:0/114650876 >> 172.21.15.42:0/114650876 conn(0x7fc01405c7e0 msgr2=0x7fc01409dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:22.754 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.751+0000 7fc01acd2700 1 -- 172.21.15.42:0/114650876 shutdown_connections 2020-04-02T23:39:22.759 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:22.751+0000 7fc01acd2700 1 -- 172.21.15.42:0/114650876 wait complete. 2020-04-02T23:39:22.763 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2020-04-02T23:39:22.791 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":469,"stamp":"2020-04-02T23:39:21.281498+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":13344560034,"num_objects":3315,"num_object_clones":0,"num_object_copies":13188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3315,"num_whiteouts":0,"num_read":27,"num_read_kb":56,"num_write":443940,"num_write_kb":14881795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88068,"ondisk_log_size":88068,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":26785148,"kb_used_data":18396476,"kb_used_omap":7386,"kb_used_meta":8381221,"kb_avail":728189572,"statfs":{"total":773094113280,"available":745666121728,"internally_reserved":8589934592,"allocated":18837991424,"data_stored":27002848118,"data_compressed":815436754,"data_compressed_allocated":8353521664,"data_compressed_original":16519729152,"omap_allocated":7563560,"internal_metadata":8582371032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,1,1,2,0,0,0,0,0,0,0,0,0,0,0,404,414],"upper_bound":262144},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2974,"num_write_kb":11976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002102"},"pg_stats":[{"pgid":"4.2","version":"26'16391","reported_seq":"16402","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:18.517574+0000","last_change":"2020-04-02T23:24:47.993492+0000","last_active":"2020-04-02T23:39:18.517574+0000","last_peered":"2020-04-02T23:39:18.517574+0000","last_clean":"2020-04-02T23:39:18.517574+0000","last_became_active":"2020-04-02T23:24:47.993002+0000","last_became_peered":"2020-04-02T23:24:47.993002+0000","last_unstale":"2020-04-02T23:39:18.517574+0000","last_undegraded":"2020-04-02T23:39:18.517574+0000","last_fullsized":"2020-04-02T23:39:18.517574+0000","mapping_epoch":24,"log_start":"26'529","ondisk_log_start":"26'529","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":15862,"ondisk_log_size":15862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1732786730,"num_objects":425,"num_object_clones":0,"num_object_copies":1700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":425,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57503,"num_write_kb":1921474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"14","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.990633+0000","last_change":"2020-04-02T23:24:42.210860+0000","last_active":"2020-04-02T23:24:47.990633+0000","last_peered":"2020-04-02T23:24:47.990633+0000","last_clean":"2020-04-02T23:24:47.990633+0000","last_became_active":"2020-04-02T23:24:42.210455+0000","last_became_peered":"2020-04-02T23:24:42.210455+0000","last_unstale":"2020-04-02T23:24:47.990633+0000","last_undegraded":"2020-04-02T23:24:47.990633+0000","last_fullsized":"2020-04-02T23:24:47.990633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'24","reported_seq":"36","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:37:44.644344+0000","last_change":"2020-04-02T23:24:44.978026+0000","last_active":"2020-04-02T23:37:44.644344+0000","last_peered":"2020-04-02T23:37:44.644344+0000","last_clean":"2020-04-02T23:37:44.644344+0000","last_became_active":"2020-04-02T23:24:44.977559+0000","last_became_peered":"2020-04-02T23:24:44.977559+0000","last_unstale":"2020-04-02T23:37:44.644344+0000","last_undegraded":"2020-04-02T23:37:44.644344+0000","last_fullsized":"2020-04-02T23:37:44.644344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"26'13794","reported_seq":"13805","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:37:56.084695+0000","last_change":"2020-04-02T23:24:48.354332+0000","last_active":"2020-04-02T23:37:56.084695+0000","last_peered":"2020-04-02T23:37:56.084695+0000","last_clean":"2020-04-02T23:37:56.084695+0000","last_became_active":"2020-04-02T23:24:48.353610+0000","last_became_peered":"2020-04-02T23:24:48.353610+0000","last_unstale":"2020-04-02T23:37:56.084695+0000","last_undegraded":"2020-04-02T23:37:56.084695+0000","last_fullsized":"2020-04-02T23:37:56.084695+0000","mapping_epoch":24,"log_start":"26'3713","ondisk_log_start":"26'3713","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10081,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1556185562,"num_objects":382,"num_object_clones":0,"num_object_copies":1528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":382,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48210,"num_write_kb":1720160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983921+0000","last_change":"2020-04-02T23:24:42.210957+0000","last_active":"2020-04-02T23:24:47.983921+0000","last_peered":"2020-04-02T23:24:47.983921+0000","last_clean":"2020-04-02T23:24:47.983921+0000","last_became_active":"2020-04-02T23:24:42.210546+0000","last_became_peered":"2020-04-02T23:24:42.210546+0000","last_unstale":"2020-04-02T23:24:47.983921+0000","last_undegraded":"2020-04-02T23:24:47.983921+0000","last_fullsized":"2020-04-02T23:24:47.983921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"26'995","reported_seq":"1007","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:37:55.976799+0000","last_change":"2020-04-02T23:24:44.977311+0000","last_active":"2020-04-02T23:37:55.976799+0000","last_peered":"2020-04-02T23:37:55.976799+0000","last_clean":"2020-04-02T23:37:55.976799+0000","last_became_active":"2020-04-02T23:24:44.976952+0000","last_became_peered":"2020-04-02T23:24:44.976952+0000","last_unstale":"2020-04-02T23:37:55.976799+0000","last_undegraded":"2020-04-02T23:37:55.976799+0000","last_fullsized":"2020-04-02T23:37:55.976799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":995,"ondisk_log_size":995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4424991,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":995,"num_write_kb":4670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"26'15174","reported_seq":"15185","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:37:56.035072+0000","last_change":"2020-04-02T23:24:48.354357+0000","last_active":"2020-04-02T23:37:56.035072+0000","last_peered":"2020-04-02T23:37:56.035072+0000","last_clean":"2020-04-02T23:37:56.035072+0000","last_became_active":"2020-04-02T23:24:48.353668+0000","last_became_peered":"2020-04-02T23:24:48.353668+0000","last_unstale":"2020-04-02T23:37:56.035072+0000","last_undegraded":"2020-04-02T23:37:56.035072+0000","last_fullsized":"2020-04-02T23:37:56.035072+0000","mapping_epoch":24,"log_start":"26'5173","ondisk_log_start":"26'5173","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10001,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1640447255,"num_objects":403,"num_object_clones":0,"num_object_copies":1612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":403,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53440,"num_write_kb":1823426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.986299+0000","last_change":"2020-04-02T23:24:41.967219+0000","last_active":"2020-04-02T23:24:47.986299+0000","last_peered":"2020-04-02T23:24:47.986299+0000","last_clean":"2020-04-02T23:24:47.986299+0000","last_became_active":"2020-04-02T23:24:41.966868+0000","last_became_peered":"2020-04-02T23:24:41.966868+0000","last_unstale":"2020-04-02T23:24:47.986299+0000","last_undegraded":"2020-04-02T23:24:47.986299+0000","last_fullsized":"2020-04-02T23:24:47.986299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"26'11","reported_seq":"22","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:30:54.458584+0000","last_change":"2020-04-02T23:24:44.978238+0000","last_active":"2020-04-02T23:30:54.458584+0000","last_peered":"2020-04-02T23:30:54.458584+0000","last_clean":"2020-04-02T23:30:54.458584+0000","last_became_active":"2020-04-02T23:24:44.977934+0000","last_became_peered":"2020-04-02T23:24:44.977934+0000","last_unstale":"2020-04-02T23:30:54.458584+0000","last_undegraded":"2020-04-02T23:30:54.458584+0000","last_fullsized":"2020-04-02T23:30:54.458584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"26'15267","reported_seq":"15278","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:37:55.939902+0000","last_change":"2020-04-02T23:24:48.354531+0000","last_active":"2020-04-02T23:37:55.939902+0000","last_peered":"2020-04-02T23:37:55.939902+0000","last_clean":"2020-04-02T23:37:55.939902+0000","last_became_active":"2020-04-02T23:24:48.353432+0000","last_became_peered":"2020-04-02T23:24:48.353432+0000","last_unstale":"2020-04-02T23:37:55.939902+0000","last_undegraded":"2020-04-02T23:37:55.939902+0000","last_fullsized":"2020-04-02T23:37:55.939902+0000","mapping_epoch":24,"log_start":"26'5241","ondisk_log_start":"26'5241","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10026,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1631728942,"num_objects":403,"num_object_clones":0,"num_object_copies":1612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":403,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54493,"num_write_kb":1823228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983940+0000","last_change":"2020-04-02T23:24:42.200692+0000","last_active":"2020-04-02T23:24:47.983940+0000","last_peered":"2020-04-02T23:24:47.983940+0000","last_clean":"2020-04-02T23:24:47.983940+0000","last_became_active":"2020-04-02T23:24:42.200326+0000","last_became_peered":"2020-04-02T23:24:42.200326+0000","last_unstale":"2020-04-02T23:24:47.983940+0000","last_undegraded":"2020-04-02T23:24:47.983940+0000","last_fullsized":"2020-04-02T23:24:47.983940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:48.178748+0000","last_change":"2020-04-02T23:24:37.115477+0000","last_active":"2020-04-02T23:24:48.178748+0000","last_peered":"2020-04-02T23:24:48.178748+0000","last_clean":"2020-04-02T23:24:48.178748+0000","last_became_active":"2020-04-02T23:24:37.114896+0000","last_became_peered":"2020-04-02T23:24:37.114896+0000","last_unstale":"2020-04-02T23:24:48.178748+0000","last_undegraded":"2020-04-02T23:24:48.178748+0000","last_fullsized":"2020-04-02T23:24:48.178748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:28.069299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:28.069299+0000","last_clean_scrub_stamp":"2020-04-02T23:24:28.069299+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"26'3","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:25:45.029664+0000","last_change":"2020-04-02T23:24:44.977844+0000","last_active":"2020-04-02T23:25:45.029664+0000","last_peered":"2020-04-02T23:25:45.029664+0000","last_clean":"2020-04-02T23:25:45.029664+0000","last_became_active":"2020-04-02T23:24:44.977355+0000","last_became_peered":"2020-04-02T23:24:44.977355+0000","last_unstale":"2020-04-02T23:25:45.029664+0000","last_undegraded":"2020-04-02T23:25:45.029664+0000","last_fullsized":"2020-04-02T23:25:45.029664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"26'15799","reported_seq":"15810","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:37:45.850219+0000","last_change":"2020-04-02T23:24:48.180609+0000","last_active":"2020-04-02T23:37:45.850219+0000","last_peered":"2020-04-02T23:37:45.850219+0000","last_clean":"2020-04-02T23:37:45.850219+0000","last_became_active":"2020-04-02T23:24:48.179989+0000","last_became_peered":"2020-04-02T23:24:48.179989+0000","last_unstale":"2020-04-02T23:37:45.850219+0000","last_undegraded":"2020-04-02T23:37:45.850219+0000","last_fullsized":"2020-04-02T23:37:45.850219+0000","mapping_epoch":24,"log_start":"26'5720","ondisk_log_start":"26'5720","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10079,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1606796672,"num_objects":398,"num_object_clones":0,"num_object_copies":1592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55808,"num_write_kb":1812324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983937+0000","last_change":"2020-04-02T23:24:41.967177+0000","last_active":"2020-04-02T23:24:47.983937+0000","last_peered":"2020-04-02T23:24:47.983937+0000","last_clean":"2020-04-02T23:24:47.983937+0000","last_became_active":"2020-04-02T23:24:41.966804+0000","last_became_peered":"2020-04-02T23:24:41.966804+0000","last_unstale":"2020-04-02T23:24:47.983937+0000","last_undegraded":"2020-04-02T23:24:47.983937+0000","last_fullsized":"2020-04-02T23:24:47.983937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"26'35","reported_seq":"73","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:37:55.655588+0000","last_change":"2020-04-02T23:24:44.977656+0000","last_active":"2020-04-02T23:37:55.655588+0000","last_peered":"2020-04-02T23:37:55.655588+0000","last_clean":"2020-04-02T23:37:55.655588+0000","last_became_active":"2020-04-02T23:24:44.977243+0000","last_became_peered":"2020-04-02T23:24:44.977243+0000","last_unstale":"2020-04-02T23:37:55.655588+0000","last_undegraded":"2020-04-02T23:37:55.655588+0000","last_fullsized":"2020-04-02T23:37:55.655588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":39600,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":56,"num_write":37,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"26'16112","reported_seq":"16123","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:37:45.705164+0000","last_change":"2020-04-02T23:24:48.354355+0000","last_active":"2020-04-02T23:37:45.705164+0000","last_peered":"2020-04-02T23:37:45.705164+0000","last_clean":"2020-04-02T23:37:45.705164+0000","last_became_active":"2020-04-02T23:24:48.353592+0000","last_became_peered":"2020-04-02T23:24:48.353592+0000","last_unstale":"2020-04-02T23:37:45.705164+0000","last_undegraded":"2020-04-02T23:37:45.705164+0000","last_fullsized":"2020-04-02T23:37:45.705164+0000","mapping_epoch":24,"log_start":"26'6026","ondisk_log_start":"26'6026","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10086,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1719909191,"num_objects":424,"num_object_clones":0,"num_object_copies":1696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":424,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56121,"num_write_kb":1907521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.984549+0000","last_change":"2020-04-02T23:24:41.965438+0000","last_active":"2020-04-02T23:24:47.984549+0000","last_peered":"2020-04-02T23:24:47.984549+0000","last_clean":"2020-04-02T23:24:47.984549+0000","last_became_active":"2020-04-02T23:24:41.965120+0000","last_became_peered":"2020-04-02T23:24:41.965120+0000","last_unstale":"2020-04-02T23:24:47.984549+0000","last_undegraded":"2020-04-02T23:24:47.984549+0000","last_fullsized":"2020-04-02T23:24:47.984549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'606","reported_seq":"617","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:37:45.654383+0000","last_change":"2020-04-02T23:24:44.980384+0000","last_active":"2020-04-02T23:37:45.654383+0000","last_peered":"2020-04-02T23:37:45.654383+0000","last_clean":"2020-04-02T23:37:45.654383+0000","last_became_active":"2020-04-02T23:24:44.980010+0000","last_became_peered":"2020-04-02T23:24:44.980010+0000","last_unstale":"2020-04-02T23:37:45.654383+0000","last_undegraded":"2020-04-02T23:37:45.654383+0000","last_fullsized":"2020-04-02T23:37:45.654383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":606,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194938,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":604,"num_write_kb":4298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"26'15387","reported_seq":"15398","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:37:55.917579+0000","last_change":"2020-04-02T23:24:48.180789+0000","last_active":"2020-04-02T23:37:55.917579+0000","last_peered":"2020-04-02T23:37:55.917579+0000","last_clean":"2020-04-02T23:37:55.917579+0000","last_became_active":"2020-04-02T23:24:48.179994+0000","last_became_peered":"2020-04-02T23:24:48.179994+0000","last_unstale":"2020-04-02T23:37:55.917579+0000","last_undegraded":"2020-04-02T23:37:55.917579+0000","last_fullsized":"2020-04-02T23:37:55.917579+0000","mapping_epoch":24,"log_start":"26'5310","ondisk_log_start":"26'5310","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10077,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1640115164,"num_objects":402,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":402,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54426,"num_write_kb":1835362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'9","reported_seq":"20","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:25:45.021167+0000","last_change":"2020-04-02T23:24:44.979136+0000","last_active":"2020-04-02T23:25:45.021167+0000","last_peered":"2020-04-02T23:25:45.021167+0000","last_clean":"2020-04-02T23:25:45.021167+0000","last_became_active":"2020-04-02T23:24:44.978145+0000","last_became_peered":"2020-04-02T23:24:44.978145+0000","last_unstale":"2020-04-02T23:25:45.021167+0000","last_undegraded":"2020-04-02T23:25:45.021167+0000","last_fullsized":"2020-04-02T23:25:45.021167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"14","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.990041+0000","last_change":"2020-04-02T23:24:42.311572+0000","last_active":"2020-04-02T23:24:47.990041+0000","last_peered":"2020-04-02T23:24:47.990041+0000","last_clean":"2020-04-02T23:24:47.990041+0000","last_became_active":"2020-04-02T23:24:42.311136+0000","last_became_peered":"2020-04-02T23:24:42.311136+0000","last_unstale":"2020-04-02T23:24:47.990041+0000","last_undegraded":"2020-04-02T23:24:47.990041+0000","last_fullsized":"2020-04-02T23:24:47.990041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"26'17696","reported_seq":"17707","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:37:55.929310+0000","last_change":"2020-04-02T23:24:48.180425+0000","last_active":"2020-04-02T23:37:55.929310+0000","last_peered":"2020-04-02T23:37:55.929310+0000","last_clean":"2020-04-02T23:37:55.929310+0000","last_became_active":"2020-04-02T23:24:48.179883+0000","last_became_peered":"2020-04-02T23:24:48.179883+0000","last_unstale":"2020-04-02T23:37:55.929310+0000","last_undegraded":"2020-04-02T23:37:55.929310+0000","last_fullsized":"2020-04-02T23:37:55.929310+0000","mapping_epoch":24,"log_start":"26'7646","ondisk_log_start":"26'7646","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10050,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1807930263,"num_objects":442,"num_object_clones":0,"num_object_copies":1768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61940,"num_write_kb":2029025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983945+0000","last_change":"2020-04-02T23:24:42.311312+0000","last_active":"2020-04-02T23:24:47.983945+0000","last_peered":"2020-04-02T23:24:47.983945+0000","last_clean":"2020-04-02T23:24:47.983945+0000","last_became_active":"2020-04-02T23:24:42.310964+0000","last_became_peered":"2020-04-02T23:24:42.310964+0000","last_unstale":"2020-04-02T23:24:47.983945+0000","last_undegraded":"2020-04-02T23:24:47.983945+0000","last_fullsized":"2020-04-02T23:24:47.983945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'121","reported_seq":"132","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:37:50.976154+0000","last_change":"2020-04-02T23:24:44.974217+0000","last_active":"2020-04-02T23:37:50.976154+0000","last_peered":"2020-04-02T23:37:50.976154+0000","last_clean":"2020-04-02T23:37:50.976154+0000","last_became_active":"2020-04-02T23:24:44.973795+0000","last_became_peered":"2020-04-02T23:24:44.973795+0000","last_unstale":"2020-04-02T23:37:50.976154+0000","last_undegraded":"2020-04-02T23:37:50.976154+0000","last_fullsized":"2020-04-02T23:37:50.976154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":121,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":13335899779,"num_objects":3279,"num_object_clones":0,"num_object_copies":13116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3279,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":441941,"num_write_kb":14872520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18740514816,"data_stored":26898558976,"data_compressed":808867238,"data_compressed_allocated":8299118592,"data_compressed_original":16457162752,"omap_allocated":0,"internal_metadata":0},"log_size":86262,"ondisk_log_size":86262,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":8660255,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":27,"num_read_kb":56,"num_write":1997,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13582336,"data_stored":17320510,"data_compressed":1640270,"data_compressed_allocated":3801088,"data_compressed_original":7602176,"omap_allocated":4474845,"internal_metadata":0},"log_size":1804,"ondisk_log_size":1804,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1550595,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509618,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3917392,"kb_used_data":2868808,"kb_used_omap":1529,"kb_used_meta":1047046,"kb_avail":90454448,"statfs":{"total":96636764160,"available":92625354752,"internally_reserved":1073741824,"allocated":2937659392,"data_stored":4206291751,"data_compressed":128258244,"data_compressed_allocated":1315840000,"data_compressed_original":2584633344,"omap_allocated":1566281,"internal_metadata":1072175543},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":1.3149999999999999,"15min":0.80000000000000004},"min":{"1min":0.19800000000000001,"5min":0.192,"15min":0.19},"max":{"1min":0.55400000000000005,"5min":9.0990000000000002,"15min":9.0990000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.68700000000000006,"15min":0.56000000000000005},"min":{"1min":0.23699999999999999,"5min":0.223,"15min":0.19900000000000001},"max":{"1min":0.53800000000000003,"5min":7.6920000000000002,"15min":7.6920000000000002},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.627,"15min":0.50600000000000001},"min":{"1min":0.247,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.45000000000000001,"5min":5.5099999999999998,"15min":5.5099999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.41699999999999998,"5min":1.2669999999999999,"15min":0.83599999999999997},"min":{"1min":0.30299999999999999,"5min":0.23300000000000001,"15min":0.223},"max":{"1min":0.69899999999999995,"5min":8.3049999999999997,"15min":8.8030000000000008},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":1.5,"15min":0.91600000000000004},"min":{"1min":0.25900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52300000000000002,"5min":8.7690000000000001,"15min":8.8569999999999993},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.67400000000000004,"15min":0.622},"min":{"1min":0.32900000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.57299999999999995,"5min":3.899,"15min":5.6020000000000003},"last":0.34499999999999997}]},{"osd":3,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.70999999999999996,"15min":0.621},"min":{"1min":0.25600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46999999999999997,"5min":6.0250000000000004,"15min":9.8620000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":1.427,"15min":0.97099999999999997},"min":{"1min":0.29999999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.71599999999999997,"5min":8.4420000000000002,"15min":12.067},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.79900000000000004,"15min":0.61299999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.22800000000000001},"max":{"1min":0.69499999999999995,"5min":4.907,"15min":5.4619999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.81200000000000006,"15min":0.60499999999999998},"min":{"1min":0.25600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.65800000000000003,"5min":5.3310000000000004,"15min":5.3310000000000004},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":1.3440000000000001,"15min":0.89600000000000002},"min":{"1min":0.26500000000000001,"5min":0.255,"15min":0.24199999999999999},"max":{"1min":0.64700000000000002,"5min":9.5389999999999997,"15min":9.5389999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.94399999999999995,"15min":0.72499999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.26700000000000002},"max":{"1min":0.628,"5min":5.6500000000000004,"15min":5.6699999999999999},"last":0.44}]},{"osd":6,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":1.004,"15min":0.74399999999999999},"min":{"1min":0.31900000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68100000000000005,"5min":7.7359999999999998,"15min":7.7359999999999998},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.97099999999999997,"15min":0.72199999999999998},"min":{"1min":0.30299999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71599999999999997,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.64600000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542323,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1604992,"kb_used_data":556408,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92766848,"statfs":{"total":96636764160,"available":94993252352,"internally_reserved":1073741824,"allocated":569761792,"data_stored":820198749,"data_compressed":24431184,"data_compressed_allocated":250605568,"data_compressed_original":501211136,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.79100000000000004,"15min":0.57099999999999995},"min":{"1min":0.23000000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.46600000000000003,"5min":5.2089999999999996,"15min":5.2999999999999998},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.79800000000000004,"15min":0.58599999999999997},"min":{"1min":0.24099999999999999,"5min":0.20799999999999999,"15min":0.19600000000000001},"max":{"1min":0.51400000000000001,"5min":4.2690000000000001,"15min":5.0190000000000001},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.73599999999999999,"15min":0.57599999999999996},"min":{"1min":0.23100000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.51300000000000001,"5min":5.5289999999999999,"15min":5.5289999999999999},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.379,"5min":0.88700000000000001,"15min":0.66300000000000003},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.217},"max":{"1min":0.52400000000000002,"5min":5.1719999999999997,"15min":5.4820000000000002},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.76800000000000002,"15min":0.63100000000000001},"min":{"1min":0.30399999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56200000000000006,"5min":5.3769999999999998,"15min":11.308999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.98299999999999998,"15min":0.68899999999999995},"min":{"1min":0.29899999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.54800000000000004,"5min":7.5590000000000002,"15min":7.5590000000000002},"last":0.307}]},{"osd":3,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.94099999999999995,"15min":0.69799999999999995},"min":{"1min":0.29099999999999998,"5min":0.25700000000000001,"15min":0.249},"max":{"1min":0.55200000000000005,"5min":7.2160000000000002,"15min":7.2160000000000002},"last":0.376},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.95099999999999996,"15min":0.70699999999999996},"min":{"1min":0.28399999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59799999999999998,"5min":8.6630000000000003,"15min":8.6630000000000003},"last":0.505}]},{"osd":5,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.83199999999999996,"15min":0.65300000000000002},"min":{"1min":0.26800000000000002,"5min":0.22800000000000001,"15min":0.224},"max":{"1min":0.623,"5min":5.8860000000000001,"15min":5.8860000000000001},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.77300000000000002,"15min":0.58799999999999997},"min":{"1min":0.29799999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.54400000000000004,"5min":4.0919999999999996,"15min":5.1210000000000004},"last":0.49299999999999999}]},{"osd":6,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":1.0840000000000001,"15min":0.71199999999999997},"min":{"1min":0.25700000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.64100000000000001,"5min":18.419,"15min":18.419},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":1.1519999999999999,"15min":0.85499999999999998},"min":{"1min":0.33500000000000002,"5min":0.28000000000000003,"15min":0.23300000000000001},"max":{"1min":0.71899999999999997,"5min":22.329000000000001,"15min":22.329000000000001},"last":0.42399999999999999}]},{"osd":7,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.98799999999999999,"15min":0.71499999999999997},"min":{"1min":0.34100000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56100000000000005,"5min":6.6200000000000001,"15min":6.6200000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.79500000000000004,"15min":0.64300000000000002},"min":{"1min":0.379,"5min":0.254,"15min":0.254},"max":{"1min":0.624,"5min":5.7960000000000003,"15min":5.7960000000000003},"last":0.47099999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542323,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5092880,"kb_used_data":4044296,"kb_used_omap":212,"kb_used_meta":1048363,"kb_avail":89278960,"statfs":{"total":96636764160,"available":91421655040,"internally_reserved":1073741824,"allocated":4141359104,"data_stored":5934570279,"data_compressed":179775615,"data_compressed_allocated":1840386048,"data_compressed_original":3633782784,"omap_allocated":217393,"internal_metadata":1073524431},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,2,0,0,0,0,0,0,0,0,0,0,0,404,414],"upper_bound":262144},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":1.2210000000000001,"15min":0.747},"min":{"1min":0.22,"5min":0.186,"15min":0.157},"max":{"1min":0.59299999999999997,"5min":7.0700000000000003,"15min":7.0700000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.93300000000000005,"15min":0.66300000000000003},"min":{"1min":0.23899999999999999,"5min":0.20699999999999999,"15min":0.191},"max":{"1min":0.56999999999999995,"5min":5.5979999999999999,"15min":6.2060000000000004},"last":0.23799999999999999}]},{"osd":1,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":1.2609999999999999,"15min":0.78700000000000003},"min":{"1min":0.21099999999999999,"5min":0.20999999999999999,"15min":0.20000000000000001},"max":{"1min":0.55100000000000005,"5min":5.7169999999999996,"15min":5.7169999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.41299999999999998,"5min":1.2569999999999999,"15min":0.75600000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.21299999999999999},"max":{"1min":0.56100000000000005,"5min":6.9199999999999999,"15min":6.9199999999999999},"last":0.316}]},{"osd":2,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":1.22,"15min":0.78900000000000003},"min":{"1min":0.24399999999999999,"5min":0.23999999999999999,"15min":0.23000000000000001},"max":{"1min":0.54200000000000004,"5min":7.016,"15min":7.016},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.42599999999999999,"5min":1.292,"15min":0.81100000000000005},"min":{"1min":0.26400000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.58099999999999996,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":1.2430000000000001,"15min":0.77600000000000002},"min":{"1min":0.27200000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.60099999999999998,"5min":9.7159999999999993,"15min":9.7159999999999993},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":1.228,"15min":0.83199999999999996},"min":{"1min":0.26500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56899999999999995,"5min":5.5279999999999996,"15min":5.5279999999999996},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":1.1459999999999999,"15min":0.71099999999999997},"min":{"1min":0.23400000000000001,"5min":0.218,"15min":0.20699999999999999},"max":{"1min":0.52100000000000002,"5min":7.8099999999999996,"15min":7.8099999999999996},"last":0.434},{"interface":"front","average":{"1min":0.41899999999999998,"5min":1.522,"15min":0.871},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.622,"5min":9.9800000000000004,"15min":9.9800000000000004},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":1.2529999999999999,"15min":0.79600000000000004},"min":{"1min":0.251,"5min":0.24299999999999999,"15min":0.23799999999999999},"max":{"1min":0.60099999999999998,"5min":6.6890000000000001,"15min":6.6890000000000001},"last":0.372},{"interface":"front","average":{"1min":0.40899999999999997,"5min":1.3939999999999999,"15min":0.88700000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60599999999999998,"5min":13.016,"15min":13.016},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":1.3300000000000001,"15min":0.82399999999999995},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.63400000000000001,"5min":9.2710000000000008,"15min":9.2710000000000008},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":1.3979999999999999,"15min":0.874},"min":{"1min":0.26300000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.69199999999999995,"5min":6.1849999999999996,"15min":6.1849999999999996},"last":0.65500000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542323,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2266848,"kb_used_data":1218264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92104992,"statfs":{"total":96636764160,"available":94315511808,"internally_reserved":1073741824,"allocated":1247502336,"data_stored":1752108449,"data_compressed":54110553,"data_compressed_allocated":550985728,"data_compressed_original":1055760384,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.63300000000000001,"15min":0.49199999999999999},"min":{"1min":0.189,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.46700000000000003,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.74199999999999999,"15min":0.57499999999999996},"min":{"1min":0.21199999999999999,"5min":0.20499999999999999,"15min":0.19800000000000001},"max":{"1min":0.56100000000000005,"5min":7.3920000000000003,"15min":7.3920000000000003},"last":0.502}]},{"osd":1,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.78300000000000003,"15min":0.62},"min":{"1min":0.26900000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.64500000000000002,"5min":5.46,"15min":7.859},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.35699999999999998,"5min":1.095,"15min":0.71099999999999997},"min":{"1min":0.24399999999999999,"5min":0.20999999999999999,"15min":0.20499999999999999},"max":{"1min":0.58499999999999996,"5min":6.8319999999999999,"15min":8.1300000000000008},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.97499999999999998,"15min":0.64400000000000002},"min":{"1min":0.26700000000000002,"5min":0.23599999999999999,"15min":0.214},"max":{"1min":0.626,"5min":6.5679999999999996,"15min":6.5679999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.90600000000000003,"15min":0.69399999999999995},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.55500000000000005,"5min":5.6459999999999999,"15min":5.6459999999999999},"last":0.438}]},{"osd":3,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":1.089,"15min":0.71999999999999997},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.22700000000000001},"max":{"1min":0.54000000000000004,"5min":7.1189999999999998,"15min":7.1189999999999998},"last":0.246},{"interface":"front","average":{"1min":0.46600000000000003,"5min":1.0740000000000001,"15min":0.72699999999999998},"min":{"1min":0.29099999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59399999999999997,"5min":7.0780000000000003,"15min":7.0780000000000003},"last":0.371}]},{"osd":4,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.91600000000000004,"15min":0.61899999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.223},"max":{"1min":0.68400000000000005,"5min":6.5880000000000001,"15min":6.5880000000000001},"last":0.318},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.79200000000000004,"15min":0.61899999999999999},"min":{"1min":0.32100000000000001,"5min":0.253,"15min":0.192},"max":{"1min":0.64100000000000001,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":1.157,"15min":0.84899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.247},"max":{"1min":0.59799999999999998,"5min":10.731,"15min":18.593},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":1.1850000000000001,"15min":0.84999999999999998},"min":{"1min":0.30199999999999999,"5min":0.25700000000000001,"15min":0.246},"max":{"1min":0.63100000000000001,"5min":8.2870000000000008,"15min":18.402000000000001},"last":0.41699999999999998}]},{"osd":7,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":1.1639999999999999,"15min":0.74399999999999999},"min":{"1min":0.316,"5min":0.27300000000000002,"15min":0.245},"max":{"1min":0.629,"5min":9.0570000000000004,"15min":9.0570000000000004},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.93799999999999994,"15min":0.68999999999999995},"min":{"1min":0.30199999999999999,"5min":0.29599999999999999,"15min":0.253},"max":{"1min":0.73799999999999999,"5min":11.67,"15min":11.67},"last":0.48799999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509618,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3261672,"kb_used_data":2213088,"kb_used_omap":1390,"kb_used_meta":1047185,"kb_avail":91110168,"statfs":{"total":96636764160,"available":93296812032,"internally_reserved":1073741824,"allocated":2266202112,"data_stored":3278766150,"data_compressed":98951694,"data_compressed_allocated":1012731904,"data_compressed_original":2025463808,"omap_allocated":1423856,"internal_metadata":1072317968},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.71399999999999997,"15min":0.53600000000000003},"min":{"1min":0.185,"5min":0.159,"15min":0.156},"max":{"1min":0.52200000000000002,"5min":6.6529999999999996,"15min":6.6529999999999996},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.65100000000000002,"15min":0.47899999999999998},"min":{"1min":0.20300000000000001,"5min":0.17999999999999999,"15min":0.16400000000000001},"max":{"1min":0.56200000000000006,"5min":4.8979999999999997,"15min":5.0830000000000002},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.81200000000000006,"15min":0.54000000000000004},"min":{"1min":0.249,"5min":0.17799999999999999,"15min":0.17199999999999999},"max":{"1min":0.52300000000000002,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.83799999999999997,"15min":0.57699999999999996},"min":{"1min":0.21299999999999999,"5min":0.16200000000000001,"15min":0.152},"max":{"1min":0.49199999999999999,"5min":10.241,"15min":10.241},"last":0.442}]},{"osd":3,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.67200000000000004,"15min":0.49399999999999999},"min":{"1min":0.20000000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.46100000000000002,"5min":4.8879999999999999,"15min":5.0709999999999997},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.84199999999999997,"15min":0.60499999999999998},"min":{"1min":0.26100000000000001,"5min":0.20699999999999999,"15min":0.20000000000000001},"max":{"1min":0.57499999999999996,"5min":5.0350000000000001,"15min":5.1710000000000003},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.82699999999999996,"15min":0.66000000000000003},"min":{"1min":0.28199999999999997,"5min":0.224,"15min":0.224},"max":{"1min":0.59499999999999997,"5min":5.452,"15min":5.452},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.876,"15min":0.65900000000000003},"min":{"1min":0.35699999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.81000000000000005,"5min":5.274,"15min":5.274},"last":0.496}]},{"osd":5,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":1.0029999999999999,"15min":0.751},"min":{"1min":0.30499999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60899999999999999,"5min":6.5910000000000002,"15min":6.5910000000000002},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.73099999999999998,"15min":0.59999999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.59799999999999998,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":1.0469999999999999,"15min":0.84299999999999997},"min":{"1min":0.32600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.75800000000000001,"5min":5.1749999999999998,"15min":24.530999999999999},"last":0.371},{"interface":"front","average":{"1min":0.47699999999999998,"5min":1.179,"15min":0.89700000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.26200000000000001},"max":{"1min":0.69099999999999995,"5min":8.7899999999999991,"15min":24.390000000000001},"last":0.38600000000000001}]},{"osd":7,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":1.0309999999999999,"15min":0.88100000000000001},"min":{"1min":0.40500000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68999999999999995,"5min":7.2539999999999996,"15min":24.459},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.78100000000000003,"15min":0.71099999999999997},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.60199999999999998,"5min":5.9989999999999997,"15min":24.559000000000001},"last":0.40500000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509620,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3879072,"kb_used_data":2830488,"kb_used_omap":1514,"kb_used_meta":1047061,"kb_avail":90492768,"statfs":{"total":96636764160,"available":92664594432,"internally_reserved":1073741824,"allocated":2898419712,"data_stored":4163746599,"data_compressed":123304139,"data_compressed_allocated":1265487872,"data_compressed_original":2530975744,"omap_allocated":1550595,"internal_metadata":1072191229},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.498,"15min":0.46600000000000003},"min":{"1min":0.20699999999999999,"5min":0.152,"15min":0.152},"max":{"1min":0.44500000000000001,"5min":3.7069999999999999,"15min":8.6370000000000005},"last":0.185},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.88200000000000001,"15min":0.58699999999999997},"min":{"1min":0.23699999999999999,"5min":0.19900000000000001,"15min":0.17599999999999999},"max":{"1min":0.49399999999999999,"5min":8.5950000000000006,"15min":8.5950000000000006},"last":0.246}]},{"osd":2,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":1.0109999999999999,"15min":0.61799999999999999},"min":{"1min":0.20100000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.53400000000000003,"5min":8.8989999999999991,"15min":8.8989999999999991},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.80100000000000005,"15min":0.61699999999999999},"min":{"1min":0.215,"5min":0.20200000000000001,"15min":0.192},"max":{"1min":0.51600000000000001,"5min":12.585000000000001,"15min":12.585000000000001},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.78900000000000003,"15min":0.63900000000000001},"min":{"1min":0.253,"5min":0.218,"15min":0.218},"max":{"1min":0.56000000000000005,"5min":5.7130000000000001,"15min":8.6690000000000005},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.89800000000000002,"15min":0.63700000000000001},"min":{"1min":0.23599999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.57199999999999995,"5min":7.1840000000000002,"15min":8.4570000000000007},"last":0.28899999999999998}]},{"osd":4,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":1.054,"15min":0.79500000000000004},"min":{"1min":0.29699999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.51700000000000002,"5min":8.9600000000000009,"15min":8.9600000000000009},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.72099999999999997,"15min":0.68200000000000005},"min":{"1min":0.308,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59999999999999998,"5min":7.117,"15min":9.0879999999999992},"last":0.375}]},{"osd":5,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":1.2789999999999999,"15min":0.86199999999999999},"min":{"1min":0.25800000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.56699999999999995,"5min":8.5519999999999996,"15min":8.5519999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":1.294,"15min":0.89300000000000002},"min":{"1min":0.28499999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68100000000000005,"5min":8.9979999999999993,"15min":8.9979999999999993},"last":0.31}]},{"osd":6,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":1.516,"15min":0.95999999999999996},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.26800000000000002},"max":{"1min":0.58899999999999997,"5min":10.012,"15min":10.012},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":1.637,"15min":1.075},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":0.65400000000000003,"5min":10.760999999999999,"15min":10.760999999999999},"last":0.35199999999999998}]},{"osd":7,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":1.0660000000000001,"15min":0.81399999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.61499999999999999,"5min":12.641999999999999,"15min":12.641999999999999},"last":0.442},{"interface":"front","average":{"1min":0.53000000000000003,"5min":1.135,"15min":0.82099999999999995},"min":{"1min":0.39000000000000001,"5min":0.313,"15min":0.30299999999999999},"max":{"1min":0.65400000000000003,"5min":7.306,"15min":8.8460000000000001},"last":0.503}]}]},{"osd":2,"up_from":15,"seq":64424509618,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2803532,"kb_used_data":1754948,"kb_used_omap":1237,"kb_used_meta":1047338,"kb_avail":91568308,"statfs":{"total":96636764160,"available":93765947392,"internally_reserved":1073741824,"allocated":1797066752,"data_stored":2584435606,"data_compressed":76996459,"data_compressed_allocated":787546112,"data_compressed_original":1575092224,"omap_allocated":1267315,"internal_metadata":1072474509},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.82899999999999996,"15min":0.55500000000000005},"min":{"1min":0.183,"5min":0.161,"15min":0.153},"max":{"1min":0.46999999999999997,"5min":6.8869999999999996,"15min":6.8869999999999996},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.90400000000000003,"15min":0.59099999999999997},"min":{"1min":0.20300000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.52800000000000002,"5min":4.907,"15min":4.907},"last":0.248}]},{"osd":1,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.81200000000000006,"15min":0.55100000000000005},"min":{"1min":0.254,"5min":0.182,"15min":0.16},"max":{"1min":0.52100000000000002,"5min":7.0449999999999999,"15min":7.0449999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":1.0529999999999999,"15min":0.64500000000000002},"min":{"1min":0.28599999999999998,"5min":0.223,"15min":0.223},"max":{"1min":0.51800000000000002,"5min":9.4179999999999993,"15min":9.4179999999999993},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":1.0169999999999999,"15min":0.66200000000000003},"min":{"1min":0.20499999999999999,"5min":0.191,"15min":0.184},"max":{"1min":0.47199999999999998,"5min":6.5789999999999997,"15min":6.5789999999999997},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.37,"5min":1.071,"15min":0.69099999999999995},"min":{"1min":0.24399999999999999,"5min":0.20399999999999999,"15min":0.20100000000000001},"max":{"1min":0.48599999999999999,"5min":8.891,"15min":8.891},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.97699999999999998,"15min":0.73299999999999998},"min":{"1min":0.27500000000000002,"5min":0.27100000000000002,"15min":0.26700000000000002},"max":{"1min":0.56299999999999994,"5min":9.0619999999999994,"15min":9.0619999999999994},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.44,"5min":1.002,"15min":0.76500000000000001},"min":{"1min":0.31900000000000001,"5min":0.26400000000000001,"15min":0.25900000000000001},"max":{"1min":0.69799999999999995,"5min":5.5970000000000004,"15min":5.5970000000000004},"last":0.38800000000000001}]},{"osd":5,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":1.1319999999999999,"15min":0.79200000000000004},"min":{"1min":0.26700000000000002,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":0.504,"5min":8.3539999999999992,"15min":8.3539999999999992},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":1.0740000000000001,"15min":0.77500000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27500000000000002},"max":{"1min":0.57599999999999996,"5min":8.9949999999999992,"15min":8.9949999999999992},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":1.96,"15min":1.202},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.61099999999999999,"5min":68.593000000000004,"15min":68.593000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.443,"5min":2.0289999999999999,"15min":1.252},"min":{"1min":0.32600000000000001,"5min":0.307,"15min":0.28999999999999998},"max":{"1min":0.55600000000000005,"5min":68.489000000000004,"15min":68.489000000000004},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":1.3120000000000001,"15min":0.878},"min":{"1min":0.34799999999999998,"5min":0.33200000000000002,"15min":0.32700000000000001},"max":{"1min":0.65800000000000003,"5min":6.2519999999999998,"15min":6.2519999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":1.163,"15min":0.83399999999999996},"min":{"1min":0.374,"5min":0.32300000000000001,"15min":0.311},"max":{"1min":0.59999999999999998,"5min":9.0999999999999996,"15min":9.0999999999999996},"last":0.45000000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509620,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3958760,"kb_used_data":2910176,"kb_used_omap":1502,"kb_used_meta":1047073,"kb_avail":90413080,"statfs":{"total":96636764160,"available":92582993920,"internally_reserved":1073741824,"allocated":2980020224,"data_stored":4262730535,"data_compressed":129608866,"data_compressed_allocated":1329938432,"data_compressed_original":2612809728,"omap_allocated":1538120,"internal_metadata":1072203704},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.255,"5min":0.83899999999999997,"15min":0.58999999999999997},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.154},"max":{"1min":0.51200000000000001,"5min":7.6989999999999998,"15min":7.6989999999999998},"last":0.247},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.71999999999999997,"15min":0.46999999999999997},"min":{"1min":0.20999999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.52800000000000002,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":0.29999999999999999}]},{"osd":1,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":1.1439999999999999,"15min":0.71599999999999997},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.17999999999999999},"max":{"1min":0.52600000000000002,"5min":7.5549999999999997,"15min":7.5549999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.93300000000000005,"15min":0.61899999999999999},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.182},"max":{"1min":0.46400000000000002,"5min":7.585,"15min":7.585},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":1.0149999999999999,"15min":0.71199999999999997},"min":{"1min":0.216,"5min":0.21199999999999999,"15min":0.18099999999999999},"max":{"1min":0.622,"5min":7.6379999999999999,"15min":7.6379999999999999},"last":0.218},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.88800000000000001,"15min":0.61899999999999999},"min":{"1min":0.24099999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.59399999999999997,"5min":7.6369999999999996,"15min":7.6369999999999996},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":1.2230000000000001,"15min":0.80100000000000005},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.54000000000000004,"5min":6.9569999999999999,"15min":6.9569999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":1.0760000000000001,"15min":0.78700000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25700000000000001},"max":{"1min":0.56799999999999995,"5min":5.6849999999999996,"15min":5.6849999999999996},"last":0.371}]},{"osd":5,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":1.24,"15min":0.82599999999999996},"min":{"1min":0.33900000000000002,"5min":0.29399999999999998,"15min":0.27900000000000003},"max":{"1min":0.501,"5min":9.7520000000000007,"15min":9.7520000000000007},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":1.23,"15min":0.81200000000000006},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55700000000000005,"5min":8.8650000000000002,"15min":8.8650000000000002},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":1.4810000000000001,"15min":0.93400000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.502,"5min":8.0009999999999994,"15min":8.0009999999999994},"last":0.505},{"interface":"front","average":{"1min":0.45500000000000002,"5min":1.429,"15min":0.94199999999999995},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58599999999999997,"5min":9.8759999999999994,"15min":9.8759999999999994},"last":0.42999999999999999}]},{"osd":7,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":1.149,"15min":0.81200000000000006},"min":{"1min":0.35699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.58399999999999996,"5min":7.5149999999999997,"15min":7.5149999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.47399999999999998,"5min":1.109,"15min":0.84399999999999997},"min":{"1min":0.373,"5min":0.312,"15min":0.312},"max":{"1min":0.58099999999999996,"5min":6.8079999999999998,"15min":6.8079999999999998},"last":0.40899999999999997}]}]}]}} 2020-04-02T23:39:22.796 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:22.849 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-02T23:39:23.104 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.098+0000 7fb14a632700 1 Processor -- start 2020-04-02T23:39:23.111 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.106+0000 7fb14a632700 1 -- start start 2020-04-02T23:39:23.111 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.107+0000 7fb14a632700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb1440a9aa0 0x7fb1441324a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:23.111 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.107+0000 7fb14a632700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb144132900 0x7fb144142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:23.111 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.108+0000 7fb14a632700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1440a9f50 con 0x7fb1440ac310 2020-04-02T23:39:23.112 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.108+0000 7fb14a632700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1440ab660 con 0x7fb1440a9aa0 2020-04-02T23:39:23.112 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.108+0000 7fb14a632700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440a6180 con 0x7fb144132900 2020-04-02T23:39:23.113 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.109+0000 7fb13b7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb1440a9aa0 0x7fb1441324a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:23.113 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.109+0000 7fb13b7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb1440a9aa0 0x7fb1441324a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40546/0 (socket says 172.21.15.42:40546) 2020-04-02T23:39:23.114 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.109+0000 7fb13b7fe700 1 -- 172.21.15.42:0/1569832275 learned_addr learned my addr 172.21.15.42:0/1569832275 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:39:23.114 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.109+0000 7fb13b7fe700 1 -- 172.21.15.42:0/1569832275 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb144132900 msgr2=0x7fb144142fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:39:23.114 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.109+0000 7fb13b7fe700 1 --2- 172.21.15.42:0/1569832275 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb144132900 0x7fb144142fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:23.114 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.109+0000 7fb13b7fe700 1 -- 172.21.15.42:0/1569832275 >> v1:172.21.15.42:6789/0 conn(0x7fb1440ac310 legacy=0x7fb144138680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:39:23.114 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.109+0000 7fb13b7fe700 1 -- 172.21.15.42:0/1569832275 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1440a6420 con 0x7fb1440a9aa0 2020-04-02T23:39:23.114 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.109+0000 7fb13b7fe700 1 --2- 172.21.15.42:0/1569832275 >> v2:172.21.15.42:3300/0 conn(0x7fb1440a9aa0 0x7fb1441324a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb1440ac830 tx=0x7fb12c010140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:23.115 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.110+0000 7fb13b7fe700 1 --2- 172.21.15.42:0/1569832275 >> v2:172.21.15.42:3300/0 conn(0x7fb1440a9aa0 0x7fb1441324a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb1440ac830 tx=0x7fb12c010140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:23.115 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.110+0000 7fb13b7fe700 1 --2- 172.21.15.42:0/1569832275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1440a9aa0 0x7fb1441324a0 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7fb1440ac830 tx=0x7fb12c010140).ready entity=mon.0 client_cookie=6c5f109cf8fcdbca server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:23.115 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.110+0000 7fb13b7fe700 1 --2- 172.21.15.42:0/1569832275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1440a9aa0 0x7fb1441324a0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7fb1440ac830 tx=0x7fb12c010140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:23.115 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.110+0000 7fb1437fe700 1 -- 172.21.15.42:0/1569832275 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb12c011720 con 0x7fb1440a9aa0 2020-04-02T23:39:23.115 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.110+0000 7fb13b7fe700 1 --2- 172.21.15.42:0/1569832275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1440a9aa0 0x7fb1441324a0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7fb1440ac830 tx=0x7fb12c010140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:23.115 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.110+0000 7fb1437fe700 1 -- 172.21.15.42:0/1569832275 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c011880 con 0x7fb1440a9aa0 2020-04-02T23:39:23.115 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.110+0000 7fb13b7fe700 1 --2- 172.21.15.42:0/1569832275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1440a9aa0 0x7fb1441324a0 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7fb1440ac830 tx=0x7fb12c010140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:23.116 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.110+0000 7fb1437fe700 1 -- 172.21.15.42:0/1569832275 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb12c011720 con 0x7fb1440a9aa0 2020-04-02T23:39:23.119 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.116+0000 7fb14a632700 1 -- 172.21.15.42:0/1569832275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1440a9aa0 msgr2=0x7fb1441324a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:23.119 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.116+0000 7fb14a632700 1 --2- 172.21.15.42:0/1569832275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1440a9aa0 0x7fb1441324a0 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7fb1440ac830 tx=0x7fb12c010140).stop 2020-04-02T23:39:23.126 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.123+0000 7fb14a632700 1 -- 172.21.15.42:0/1569832275 shutdown_connections 2020-04-02T23:39:23.126 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.123+0000 7fb14a632700 1 --2- 172.21.15.42:0/1569832275 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fb144132900 0x7fb144142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:23.126 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.123+0000 7fb14a632700 1 --2- 172.21.15.42:0/1569832275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1440a9aa0 0x7fb1441324a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:23.126 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.123+0000 7fb14a632700 1 -- 172.21.15.42:0/1569832275 >> 172.21.15.42:0/1569832275 conn(0x7fb144060980 msgr2=0x7fb1440ab880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:23.134 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.132+0000 7fb14a632700 1 -- 172.21.15.42:0/1569832275 shutdown_connections 2020-04-02T23:39:23.135 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.132+0000 7fb14a632700 1 -- 172.21.15.42:0/1569832275 wait complete. 2020-04-02T23:39:23.137 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.134+0000 7fb14a632700 1 Processor -- start 2020-04-02T23:39:23.138 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.135+0000 7fb14a632700 1 -- start start 2020-04-02T23:39:23.139 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.136+0000 7fb14a632700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb144132900 0x7fb14414a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:23.139 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.136+0000 7fb14a632700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb144134110 con 0x7fb1440a9aa0 2020-04-02T23:39:23.139 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.136+0000 7fb14a632700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb144139830 con 0x7fb1440ac310 2020-04-02T23:39:23.139 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.136+0000 7fb14a632700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1441330a0 con 0x7fb144132900 2020-04-02T23:39:23.140 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.136+0000 7fb13b7fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb1440ac310 0x7fb14414a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:54354/0 (socket says 172.21.15.42:54354) 2020-04-02T23:39:23.140 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.136+0000 7fb13b7fe700 1 -- 172.21.15.42:0/4066194580 learned_addr learned my addr 172.21.15.42:0/4066194580 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:23.140 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.136+0000 7fb148bcf700 1 --2- 172.21.15.42:0/4066194580 >> v2:172.21.15.42:3300/0 conn(0x7fb144132900 0x7fb14414a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:23.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.138+0000 7fb148bcf700 1 -- 172.21.15.42:0/4066194580 >> v1:172.21.15.84:6789/0 conn(0x7fb1440ac310 legacy=0x7fb14414a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:23.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.138+0000 7fb148bcf700 1 -- 172.21.15.42:0/4066194580 >> v1:172.21.15.42:6789/0 conn(0x7fb1440a9aa0 legacy=0x7fb144134420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:23.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.138+0000 7fb148bcf700 1 -- 172.21.15.42:0/4066194580 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb144133340 con 0x7fb144132900 2020-04-02T23:39:23.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.138+0000 7fb148bcf700 1 --2- 172.21.15.42:0/4066194580 >> v2:172.21.15.42:3300/0 conn(0x7fb144132900 0x7fb14414a820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb144137770 tx=0x7fb13c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:23.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.138+0000 7fb148bcf700 1 --2- 172.21.15.42:0/4066194580 >> v2:172.21.15.42:3300/0 conn(0x7fb144132900 0x7fb14414a820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb144137770 tx=0x7fb13c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:23.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.138+0000 7fb148bcf700 1 --2- 172.21.15.42:0/4066194580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb144132900 0x7fb14414a820 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7fb144137770 tx=0x7fb13c010c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:23.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.139+0000 7fb148bcf700 1 --2- 172.21.15.42:0/4066194580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb144132900 0x7fb14414a820 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fb144137770 tx=0x7fb13c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:23.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.139+0000 7fb148bcf700 1 --2- 172.21.15.42:0/4066194580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb144132900 0x7fb14414a820 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fb144137770 tx=0x7fb13c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:23.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.139+0000 7fb148bcf700 1 --2- 172.21.15.42:0/4066194580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb144132900 0x7fb14414a820 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fb144137770 tx=0x7fb13c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:23.146 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.144+0000 7fb141ffb700 1 -- 172.21.15.42:0/4066194580 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb13c013060 con 0x7fb144132900 2020-04-02T23:39:23.147 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.144+0000 7fb141ffb700 1 -- 172.21.15.42:0/4066194580 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c005d10 con 0x7fb144132900 2020-04-02T23:39:23.151 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.146+0000 7fb14a632700 1 -- 172.21.15.42:0/4066194580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb144133cd0 con 0x7fb144132900 2020-04-02T23:39:23.151 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.146+0000 7fb141ffb700 1 -- 172.21.15.42:0/4066194580 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb13c005e80 con 0x7fb144132900 2020-04-02T23:39:23.152 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.146+0000 7fb14a632700 1 -- 172.21.15.42:0/4066194580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb144135f80 con 0x7fb144132900 2020-04-02T23:39:23.152 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.147+0000 7fb14a632700 1 -- 172.21.15.42:0/4066194580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb144056c50 con 0x7fb144132900 2020-04-02T23:39:23.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.153+0000 7fb148bcf700 1 --2- 172.21.15.42:0/4066194580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb144132900 0x7fb14414a820 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fb144137770 tx=0x7fb13c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:23.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.154+0000 7fb141ffb700 1 -- 172.21.15.42:0/4066194580 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fb13c0018a0 con 0x7fb144132900 2020-04-02T23:39:23.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.154+0000 7fb148bcf700 1 --2- 172.21.15.42:0/4066194580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb144132900 0x7fb14414a820 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fb144137770 tx=0x7fb13c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:23.159 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.155+0000 7fb141ffb700 1 --2- 172.21.15.42:0/4066194580 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb12404d630 0x7fb12404faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:23.159 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.155+0000 7fb141ffb700 1 -- 172.21.15.42:0/4066194580 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb13c060f20 con 0x7fb144132900 2020-04-02T23:39:23.159 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.155+0000 7fb143fff700 1 --2- 172.21.15.42:0/4066194580 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb12404d630 0x7fb12404faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:23.159 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.155+0000 7fb143fff700 1 --2- 172.21.15.42:0/4066194580 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb12404d630 0x7fb12404faf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb134000f80 tx=0x7fb134007b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:23.159 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.155+0000 7fb143fff700 1 --2- 172.21.15.42:0/4066194580 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb12404d630 0x7fb12404faf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb134000f80 tx=0x7fb134007b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:23.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.155+0000 7fb143fff700 1 --2- 172.21.15.42:0/4066194580 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb12404d630 0x7fb12404faf0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7fb134000f80 tx=0x7fb134007b50).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:23.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.155+0000 7fb148bcf700 1 --2- 172.21.15.42:0/4066194580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb144132900 0x7fb14414a820 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fb144137770 tx=0x7fb13c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:23.160 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.156+0000 7fb141ffb700 1 -- 172.21.15.42:0/4066194580 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fb13c03c620 con 0x7fb144132900 2020-04-02T23:39:23.441 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.438+0000 7fb14a632700 1 -- 172.21.15.42:0/4066194580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb14405a6b0 con 0x7fb144132900 2020-04-02T23:39:23.442 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.439+0000 7fb148bcf700 1 --2- 172.21.15.42:0/4066194580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb144132900 0x7fb14414a820 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7fb144137770 tx=0x7fb13c010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:23.442 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.439+0000 7fb141ffb700 1 -- 172.21.15.42:0/4066194580 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fb13c03fc40 con 0x7fb144132900 2020-04-02T23:39:23.442 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:39:23.443 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":26,"fsid":"571c521c-9ca7-4052-ba5b-7a77e18ff12c","created":"2020-04-02T23:24:23.980442+0000","modified":"2020-04-02T23:24:48.393847+0000","last_up_change":"2020-04-02T23:24:36.096260+0000","last_in_change":"2020-04-02T23:24:36.096260+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-02T23:24:27.091980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-02T23:24:40.298468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-04-02T23:24:43.688260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-04-02T23:24:45.991301+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"976aac36-1cf8-408b-bf56-9f0eefe43b06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":24836},{"type":"v1","addr":"172.21.15.42:6801","nonce":24836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":24836},{"type":"v1","addr":"172.21.15.42:6803","nonce":24836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":24836},{"type":"v1","addr":"172.21.15.42:6807","nonce":24836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":24836},{"type":"v1","addr":"172.21.15.42:6805","nonce":24836}]},"public_addr":"172.21.15.42:6801/24836","cluster_addr":"172.21.15.42:6803/24836","heartbeat_back_addr":"172.21.15.42:6807/24836","heartbeat_front_addr":"172.21.15.42:6805/24836","state":["exists","up"]},{"osd":1,"uuid":"22c1e489-ab99-4205-ba9d-fbfc144d2a8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":24881},{"type":"v1","addr":"172.21.15.42:6809","nonce":24881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":24881},{"type":"v1","addr":"172.21.15.42:6811","nonce":24881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":24881},{"type":"v1","addr":"172.21.15.42:6815","nonce":24881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":24881},{"type":"v1","addr":"172.21.15.42:6813","nonce":24881}]},"public_addr":"172.21.15.42:6809/24881","cluster_addr":"172.21.15.42:6811/24881","heartbeat_back_addr":"172.21.15.42:6815/24881","heartbeat_front_addr":"172.21.15.42:6813/24881","state":["exists","up"]},{"osd":2,"uuid":"f0b18b09-93c0-4286-8d15-746611ba53cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":24917},{"type":"v1","addr":"172.21.15.42:6817","nonce":24917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":24917},{"type":"v1","addr":"172.21.15.42:6819","nonce":24917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":24917},{"type":"v1","addr":"172.21.15.42:6823","nonce":24917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":24917},{"type":"v1","addr":"172.21.15.42:6821","nonce":24917}]},"public_addr":"172.21.15.42:6817/24917","cluster_addr":"172.21.15.42:6819/24917","heartbeat_back_addr":"172.21.15.42:6823/24917","heartbeat_front_addr":"172.21.15.42:6821/24917","state":["exists","up"]},{"osd":3,"uuid":"989d4a69-9abe-44de-95f2-6c7cbbe07471","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":24940},{"type":"v1","addr":"172.21.15.42:6825","nonce":24940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":24940},{"type":"v1","addr":"172.21.15.42:6827","nonce":24940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":24940},{"type":"v1","addr":"172.21.15.42:6831","nonce":24940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":24940},{"type":"v1","addr":"172.21.15.42:6829","nonce":24940}]},"public_addr":"172.21.15.42:6825/24940","cluster_addr":"172.21.15.42:6827/24940","heartbeat_back_addr":"172.21.15.42:6831/24940","heartbeat_front_addr":"172.21.15.42:6829/24940","state":["exists","up"]},{"osd":4,"uuid":"b1a2ce60-ae80-4f8a-97a3-4fbb1399fdfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":24239},{"type":"v1","addr":"172.21.15.84:6803","nonce":24239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":24239},{"type":"v1","addr":"172.21.15.84:6805","nonce":24239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":24239},{"type":"v1","addr":"172.21.15.84:6809","nonce":24239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":24239},{"type":"v1","addr":"172.21.15.84:6807","nonce":24239}]},"public_addr":"172.21.15.84:6803/24239","cluster_addr":"172.21.15.84:6805/24239","heartbeat_back_addr":"172.21.15.84:6809/24239","heartbeat_front_addr":"172.21.15.84:6807/24239","state":["exists","up"]},{"osd":5,"uuid":"396b36e5-7226-4e8e-aa8a-749cb5cec101","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":24276},{"type":"v1","addr":"172.21.15.84:6811","nonce":24276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":24276},{"type":"v1","addr":"172.21.15.84:6813","nonce":24276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":24276},{"type":"v1","addr":"172.21.15.84:6817","nonce":24276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":24276},{"type":"v1","addr":"172.21.15.84:6815","nonce":24276}]},"public_addr":"172.21.15.84:6811/24276","cluster_addr":"172.21.15.84:6813/24276","heartbeat_back_addr":"172.21.15.84:6817/24276","heartbeat_front_addr":"172.21.15.84:6815/24276","state":["exists","up"]},{"osd":6,"uuid":"884bb915-28c3-463d-8046-e2908f6e8e96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":24319},{"type":"v1","addr":"172.21.15.84:6819","nonce":24319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":24319},{"type":"v1","addr":"172.21.15.84:6821","nonce":24319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":24319},{"type":"v1","addr":"172.21.15.84:6825","nonce":24319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":24319},{"type":"v1","addr":"172.21.15.84:6823","nonce":24319}]},"public_addr":"172.21.15.84:6819/24319","cluster_addr":"172.21.15.84:6821/24319","heartbeat_back_addr":"172.21.15.84:6825/24319","heartbeat_front_addr":"172.21.15.84:6823/24319","state":["exists","up"]},{"osd":7,"uuid":"70e90d1d-f081-4de5-af4b-e987c159e597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":24349},{"type":"v1","addr":"172.21.15.84:6827","nonce":24349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":24349},{"type":"v1","addr":"172.21.15.84:6829","nonce":24349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":24349},{"type":"v1","addr":"172.21.15.84:6833","nonce":24349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":24349},{"type":"v1","addr":"172.21.15.84:6831","nonce":24349}]},"public_addr":"172.21.15.84:6827/24349","cluster_addr":"172.21.15.84:6829/24349","heartbeat_back_addr":"172.21.15.84:6833/24349","heartbeat_front_addr":"172.21.15.84:6831/24349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.195657+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.241354+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.257764+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.368827+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.967296+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:33.991068+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.077047+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-02T23:24:34.095727+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-02T23:39:23.444 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.441+0000 7fb14a632700 1 -- 172.21.15.42:0/4066194580 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb12404d630 msgr2=0x7fb12404faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:23.444 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.441+0000 7fb14a632700 1 --2- 172.21.15.42:0/4066194580 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb12404d630 0x7fb12404faf0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7fb134000f80 tx=0x7fb134007b50).stop 2020-04-02T23:39:23.444 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.441+0000 7fb14a632700 1 -- 172.21.15.42:0/4066194580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb144132900 msgr2=0x7fb14414a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:23.444 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.441+0000 7fb14a632700 1 --2- 172.21.15.42:0/4066194580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb144132900 0x7fb14414a820 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7fb144137770 tx=0x7fb13c010c30).stop 2020-04-02T23:39:23.444 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.441+0000 7fb14a632700 1 -- 172.21.15.42:0/4066194580 shutdown_connections 2020-04-02T23:39:23.445 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.441+0000 7fb14a632700 1 --2- 172.21.15.42:0/4066194580 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fb12404d630 0x7fb12404faf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:23.445 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.441+0000 7fb14a632700 1 --2- 172.21.15.42:0/4066194580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb144132900 0x7fb14414a820 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:23.445 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.441+0000 7fb14a632700 1 -- 172.21.15.42:0/4066194580 >> 172.21.15.42:0/4066194580 conn(0x7fb144060980 msgr2=0x7fb144069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:23.445 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.441+0000 7fb14a632700 1 -- 172.21.15.42:0/4066194580 shutdown_connections 2020-04-02T23:39:23.445 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:23.441+0000 7fb14a632700 1 -- 172.21.15.42:0/4066194580 wait complete. 2020-04-02T23:39:24.467 INFO:tasks.ceph:Scrubbing osd.4 2020-04-02T23:39:24.468 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:24.516 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 config set osd_debug_deep_scrub_sleep 0 2020-04-02T23:39:24.753 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.750+0000 7f4d4e555700 1 Processor -- start 2020-04-02T23:39:24.753 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.751+0000 7f4d4e555700 1 -- start start 2020-04-02T23:39:24.755 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.752+0000 7f4d4e555700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4d480ab410 0x7f4d4805ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:24.763 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.756+0000 7f4d477fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4d480a1ed0 0x7f4d48138510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:54360/0 (socket says 172.21.15.42:54360) 2020-04-02T23:39:24.763 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.756+0000 7f4d477fe700 1 -- 172.21.15.42:0/1528961562 learned_addr learned my addr 172.21.15.42:0/1528961562 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:24.763 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.757+0000 7f4d4e555700 1 -- 172.21.15.42:0/1528961562 --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4809a690 con 0x7f4d48138c20 2020-04-02T23:39:24.764 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.761+0000 7f4d4e555700 1 -- 172.21.15.42:0/1528961562 --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d480a4580 con 0x7f4d480a1ed0 2020-04-02T23:39:24.764 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.761+0000 7f4d4e555700 1 -- 172.21.15.42:0/1528961562 --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d480a4820 con 0x7f4d480ab410 2020-04-02T23:39:24.764 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.761+0000 7f4d47fff700 1 --2- 172.21.15.42:0/1528961562 >> v2:172.21.15.42:3300/0 conn(0x7f4d480ab410 0x7f4d4805ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:24.766 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.761+0000 7f4d46ffd700 1 -- 172.21.15.42:0/1528961562 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3534750252 0 0) 0x7f4d480a4580 con 0x7f4d480a1ed0 2020-04-02T23:39:24.766 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.761+0000 7f4d46ffd700 1 -- 172.21.15.42:0/1528961562 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d34003230 con 0x7f4d480a1ed0 2020-04-02T23:39:24.766 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.762+0000 7f4d46ffd700 1 -- 172.21.15.42:0/1528961562 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045009068 0 0) 0x7f4d4809a690 con 0x7f4d48138c20 2020-04-02T23:39:24.766 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.762+0000 7f4d46ffd700 1 -- 172.21.15.42:0/1528961562 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d480a4580 con 0x7f4d48138c20 2020-04-02T23:39:24.767 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.762+0000 7f4d46ffd700 1 -- 172.21.15.42:0/1528961562 <== mon.1 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1115237737 0 0) 0x7f4d34003230 con 0x7f4d480a1ed0 2020-04-02T23:39:24.767 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.762+0000 7f4d46ffd700 1 -- 172.21.15.42:0/1528961562 >> v2:172.21.15.42:3300/0 conn(0x7f4d480ab410 msgr2=0x7f4d4805ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:24.767 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.762+0000 7f4d46ffd700 1 --2- 172.21.15.42:0/1528961562 >> v2:172.21.15.42:3300/0 conn(0x7f4d480ab410 0x7f4d4805ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:24.767 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.762+0000 7f4d46ffd700 1 -- 172.21.15.42:0/1528961562 >> v1:172.21.15.42:6789/0 conn(0x7f4d48138c20 legacy=0x7f4d4813f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:24.767 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.762+0000 7f4d46ffd700 1 -- 172.21.15.42:0/1528961562 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d480a4ac0 con 0x7f4d480a1ed0 2020-04-02T23:39:24.767 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.762+0000 7f4d46ffd700 1 -- 172.21.15.42:0/1528961562 <== mon.1 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7f4d380016d0 con 0x7f4d480a1ed0 2020-04-02T23:39:24.768 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.762+0000 7f4d46ffd700 1 -- 172.21.15.42:0/1528961562 >> v1:172.21.15.84:6789/0 conn(0x7f4d480a1ed0 legacy=0x7f4d48138510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:24.768 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.762+0000 7f4d46ffd700 1 --2- 172.21.15.42:0/1528961562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d340038b0 0x7f4d34003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:24.768 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.762+0000 7f4d46ffd700 1 --2- 172.21.15.42:0/1528961562 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4d34007810 0x7f4d340044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:24.768 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.762+0000 7f4d46ffd700 1 --2- 172.21.15.42:0/1528961562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d34004930 0x7f4d34004de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:24.768 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.762+0000 7f4d46ffd700 1 -- 172.21.15.42:0/1528961562 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d480a4820 con 0x7f4d34004930 2020-04-02T23:39:24.768 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.762+0000 7f4d46ffd700 1 -- 172.21.15.42:0/1528961562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d34005240 con 0x7f4d340038b0 2020-04-02T23:39:24.768 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.762+0000 7f4d46ffd700 1 -- 172.21.15.42:0/1528961562 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d34014520 con 0x7f4d34007810 2020-04-02T23:39:24.768 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.762+0000 7f4d47fff700 1 --2- 172.21.15.42:0/1528961562 >> v2:172.21.15.42:3300/0 conn(0x7f4d480ab410 0x7f4d4805ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:39:24.769 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.762+0000 7f4d4caf2700 1 --2- 172.21.15.42:0/1528961562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d34004930 0x7f4d34004de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:24.769 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.762+0000 7f4d477fe700 1 --2- 172.21.15.42:0/1528961562 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4d34007810 0x7f4d340044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:24.769 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.763+0000 7f4d4caf2700 1 -- 172.21.15.42:0/1528961562 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4d34007810 msgr2=0x7f4d340044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:24.769 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.763+0000 7f4d4caf2700 1 --2- 172.21.15.42:0/1528961562 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4d34007810 0x7f4d340044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:24.769 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.763+0000 7f4d4caf2700 1 -- 172.21.15.42:0/1528961562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d340038b0 msgr2=0x7f4d34003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:24.769 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.763+0000 7f4d4caf2700 1 --2- 172.21.15.42:0/1528961562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d340038b0 0x7f4d34003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:24.769 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.763+0000 7f4d4caf2700 1 -- 172.21.15.42:0/1528961562 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d480a4ac0 con 0x7f4d34004930 2020-04-02T23:39:24.770 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.763+0000 7f4d4caf2700 1 --2- 172.21.15.42:0/1528961562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d34004930 0x7f4d34004de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4d40001450 tx=0x7f4d40001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:24.770 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.763+0000 7f4d4caf2700 1 -- 172.21.15.42:0/1528961562 reap_dead start 2020-04-02T23:39:24.770 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.763+0000 7f4d4caf2700 1 --2- 172.21.15.42:0/1528961562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d34004930 0x7f4d34004de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4d40001450 tx=0x7f4d40001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:24.770 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.763+0000 7f4d4caf2700 1 --2- 172.21.15.42:0/1528961562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d34004930 0x7f4d34004de0 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7f4d40001450 tx=0x7f4d40001930).ready entity=mon.0 client_cookie=c78a318d65511892 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:24.770 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.763+0000 7f4d4caf2700 1 --2- 172.21.15.42:0/1528961562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d34004930 0x7f4d34004de0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f4d40001450 tx=0x7f4d40001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:24.770 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.763+0000 7f4d46ffd700 1 -- 172.21.15.42:0/1528961562 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d4000ce30 con 0x7f4d34004930 2020-04-02T23:39:24.770 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.763+0000 7f4d4caf2700 1 --2- 172.21.15.42:0/1528961562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d34004930 0x7f4d34004de0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f4d40001450 tx=0x7f4d40001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:24.771 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.763+0000 7f4d46ffd700 1 -- 172.21.15.42:0/1528961562 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d400111b0 con 0x7f4d34004930 2020-04-02T23:39:24.771 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.763+0000 7f4d4caf2700 1 --2- 172.21.15.42:0/1528961562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d34004930 0x7f4d34004de0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7f4d40001450 tx=0x7f4d40001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:24.771 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.763+0000 7f4d46ffd700 1 -- 172.21.15.42:0/1528961562 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d4000ce30 con 0x7f4d34004930 2020-04-02T23:39:24.771 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.765+0000 7f4d4e555700 1 -- 172.21.15.42:0/1528961562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d34004930 msgr2=0x7f4d34004de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:24.771 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.765+0000 7f4d4e555700 1 --2- 172.21.15.42:0/1528961562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d34004930 0x7f4d34004de0 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7f4d40001450 tx=0x7f4d40001930).stop 2020-04-02T23:39:24.780 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.777+0000 7f4d4e555700 1 -- 172.21.15.42:0/1528961562 shutdown_connections 2020-04-02T23:39:24.780 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.777+0000 7f4d4e555700 1 --2- 172.21.15.42:0/1528961562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d34004930 0x7f4d34004de0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:24.780 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.777+0000 7f4d4e555700 1 -- 172.21.15.42:0/1528961562 >> 172.21.15.42:0/1528961562 conn(0x7f4d4805b720 msgr2=0x7f4d480aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:24.780 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.777+0000 7f4d4e555700 1 -- 172.21.15.42:0/1528961562 shutdown_connections 2020-04-02T23:39:24.781 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.778+0000 7f4d4e555700 1 -- 172.21.15.42:0/1528961562 wait complete. 2020-04-02T23:39:24.782 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.779+0000 7f4d4e555700 1 Processor -- start 2020-04-02T23:39:24.782 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.779+0000 7f4d4e555700 1 -- start start 2020-04-02T23:39:24.783 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.780+0000 7f4d4e555700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4d48137c10 0x7f4d4814d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:24.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.781+0000 7f4d4e555700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d480a6330 con 0x7f4d48062390 2020-04-02T23:39:24.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.781+0000 7f4d4e555700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d48138050 con 0x7f4d34004930 2020-04-02T23:39:24.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.781+0000 7f4d4e555700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d48062d20 con 0x7f4d48137c10 2020-04-02T23:39:24.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.781+0000 7f4d4caf2700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4d48137c10 0x7f4d4814d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:24.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.781+0000 7f4d477fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f4d48062390 0x7f4d48137500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:59992/0 (socket says 172.21.15.42:59992) 2020-04-02T23:39:24.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.781+0000 7f4d477fe700 1 -- 172.21.15.42:0/2935981081 learned_addr learned my addr 172.21.15.42:0/2935981081 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:24.785 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.781+0000 7f4d4caf2700 1 -- 172.21.15.42:0/2935981081 >> v1:172.21.15.84:6789/0 conn(0x7f4d34004930 legacy=0x7f4d48063a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:24.785 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.781+0000 7f4d4caf2700 1 -- 172.21.15.42:0/2935981081 >> v1:172.21.15.42:6789/0 conn(0x7f4d48062390 legacy=0x7f4d48137500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:24.786 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.781+0000 7f4d4caf2700 1 -- 172.21.15.42:0/2935981081 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d480610f0 con 0x7f4d48137c10 2020-04-02T23:39:24.786 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.782+0000 7f4d4caf2700 1 --2- 172.21.15.42:0/2935981081 >> v2:172.21.15.42:3300/0 conn(0x7f4d48137c10 0x7f4d4814d600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d380010d0 tx=0x7f4d40001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:24.786 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.782+0000 7f4d4caf2700 1 --2- 172.21.15.42:0/2935981081 >> v2:172.21.15.42:3300/0 conn(0x7f4d48137c10 0x7f4d4814d600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d380010d0 tx=0x7f4d40001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:24.786 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.782+0000 7f4d4caf2700 1 --2- 172.21.15.42:0/2935981081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d48137c10 0x7f4d4814d600 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7f4d380010d0 tx=0x7f4d40001930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:24.786 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.782+0000 7f4d4caf2700 1 --2- 172.21.15.42:0/2935981081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d48137c10 0x7f4d4814d600 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f4d380010d0 tx=0x7f4d40001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:24.786 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.782+0000 7f4d4caf2700 1 --2- 172.21.15.42:0/2935981081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d48137c10 0x7f4d4814d600 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f4d380010d0 tx=0x7f4d40001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:24.786 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.782+0000 7f4d4caf2700 1 --2- 172.21.15.42:0/2935981081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d48137c10 0x7f4d4814d600 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f4d380010d0 tx=0x7f4d40001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:24.794 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.788+0000 7f4d457fa700 1 -- 172.21.15.42:0/2935981081 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d4000ce30 con 0x7f4d48137c10 2020-04-02T23:39:24.794 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.788+0000 7f4d457fa700 1 -- 172.21.15.42:0/2935981081 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d40011e70 con 0x7f4d48137c10 2020-04-02T23:39:24.794 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.788+0000 7f4d457fa700 1 -- 172.21.15.42:0/2935981081 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d40010650 con 0x7f4d48137c10 2020-04-02T23:39:24.795 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.792+0000 7f4d4e555700 1 -- 172.21.15.42:0/2935981081 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d48061390 con 0x7f4d48137c10 2020-04-02T23:39:24.795 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.792+0000 7f4d4e555700 1 -- 172.21.15.42:0/2935981081 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d48139cb0 con 0x7f4d48137c10 2020-04-02T23:39:24.801 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.798+0000 7f4d4caf2700 1 --2- 172.21.15.42:0/2935981081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d48137c10 0x7f4d4814d600 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f4d380010d0 tx=0x7f4d40001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.798+0000 7f4d4e555700 1 -- 172.21.15.42:0/2935981081 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d4805d2e0 con 0x7f4d48137c10 2020-04-02T23:39:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.798+0000 7f4d457fa700 1 -- 172.21.15.42:0/2935981081 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f4d40006860 con 0x7f4d48137c10 2020-04-02T23:39:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.798+0000 7f4d4caf2700 1 --2- 172.21.15.42:0/2935981081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d48137c10 0x7f4d4814d600 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f4d380010d0 tx=0x7f4d40001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.799+0000 7f4d4caf2700 1 --2- 172.21.15.42:0/2935981081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d48137c10 0x7f4d4814d600 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f4d380010d0 tx=0x7f4d40001930).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.799+0000 7f4d457fa700 1 --2- 172.21.15.42:0/2935981081 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4d2804d570 0x7f4d2804fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.799+0000 7f4d457fa700 1 -- 172.21.15.42:0/2935981081 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4d400610e0 con 0x7f4d48137c10 2020-04-02T23:39:24.803 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.799+0000 7f4d457fa700 1 --2- 172.21.15.42:0/2935981081 >> [v2:172.21.15.84:6802/24239,v1:172.21.15.84:6803/24239] conn(0x7f4d28054890 0x7f4d28056cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:24.803 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.799+0000 7f4d457fa700 1 -- 172.21.15.42:0/2935981081 --> [v2:172.21.15.84:6802/24239,v1:172.21.15.84:6803/24239] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d28057270 con 0x7f4d28054890 2020-04-02T23:39:24.803 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.799+0000 7f4d457fa700 1 -- 172.21.15.42:0/2935981081 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d40062520 con 0x7f4d48137c10 2020-04-02T23:39:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.799+0000 7f4d477fe700 1 --2- 172.21.15.42:0/2935981081 >> [v2:172.21.15.84:6802/24239,v1:172.21.15.84:6803/24239] conn(0x7f4d28054890 0x7f4d28056cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.800+0000 7f4d477fe700 1 --2- 172.21.15.42:0/2935981081 >> [v2:172.21.15.84:6802/24239,v1:172.21.15.84:6803/24239] conn(0x7f4d28054890 0x7f4d28056cb0 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.801+0000 7f4d47fff700 1 --2- 172.21.15.42:0/2935981081 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4d2804d570 0x7f4d2804fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:24.805 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.801+0000 7f4d47fff700 1 --2- 172.21.15.42:0/2935981081 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4d2804d570 0x7f4d2804fa30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4d3c002ed0 tx=0x7f4d3c0079e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:24.805 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.802+0000 7f4d47fff700 1 --2- 172.21.15.42:0/2935981081 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4d2804d570 0x7f4d2804fa30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4d3c002ed0 tx=0x7f4d3c0079e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:24.805 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.802+0000 7f4d47fff700 1 --2- 172.21.15.42:0/2935981081 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4d2804d570 0x7f4d2804fa30 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f4d3c002ed0 tx=0x7f4d3c0079e0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:24.808 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.805+0000 7f4d457fa700 1 -- 172.21.15.42:0/2935981081 <== osd.4 v2:172.21.15.84:6802/24239 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f4d28057270 con 0x7f4d28054890 2020-04-02T23:39:24.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.834+0000 7f4d4e555700 1 -- 172.21.15.42:0/2935981081 --> [v2:172.21.15.84:6802/24239,v1:172.21.15.84:6803/24239] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4d48061e20 con 0x7f4d28054890 2020-04-02T23:39:24.837 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.834+0000 7f4d457fa700 1 -- 172.21.15.42:0/2935981081 <== osd.4 v2:172.21.15.84:6802/24239 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4d48061e20 con 0x7f4d28054890 2020-04-02T23:39:24.837 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2020-04-02T23:39:24.838 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-04-02T23:39:24.838 INFO:teuthology.orchestra.run.smithi042.stdout:} 2020-04-02T23:39:24.840 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.837+0000 7f4d4e555700 1 -- 172.21.15.42:0/2935981081 >> [v2:172.21.15.84:6802/24239,v1:172.21.15.84:6803/24239] conn(0x7f4d28054890 msgr2=0x7f4d28056cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:24.840 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.837+0000 7f4d4e555700 1 --2- 172.21.15.42:0/2935981081 >> [v2:172.21.15.84:6802/24239,v1:172.21.15.84:6803/24239] conn(0x7f4d28054890 0x7f4d28056cb0 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:24.840 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.837+0000 7f4d4e555700 1 -- 172.21.15.42:0/2935981081 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4d2804d570 msgr2=0x7f4d2804fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:24.840 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.837+0000 7f4d4e555700 1 --2- 172.21.15.42:0/2935981081 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4d2804d570 0x7f4d2804fa30 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7f4d3c002ed0 tx=0x7f4d3c0079e0).stop 2020-04-02T23:39:24.840 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.837+0000 7f4d4e555700 1 -- 172.21.15.42:0/2935981081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d48137c10 msgr2=0x7f4d4814d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:24.840 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.837+0000 7f4d4e555700 1 --2- 172.21.15.42:0/2935981081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d48137c10 0x7f4d4814d600 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7f4d380010d0 tx=0x7f4d40001930).stop 2020-04-02T23:39:24.840 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.837+0000 7f4d4caf2700 1 -- 172.21.15.42:0/2935981081 reap_dead start 2020-04-02T23:39:24.841 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.838+0000 7f4d4e555700 1 -- 172.21.15.42:0/2935981081 shutdown_connections 2020-04-02T23:39:24.841 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.838+0000 7f4d4e555700 1 --2- 172.21.15.42:0/2935981081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d48137c10 0x7f4d4814d600 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:24.841 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.838+0000 7f4d4e555700 1 -- 172.21.15.42:0/2935981081 >> 172.21.15.42:0/2935981081 conn(0x7f4d4805b720 msgr2=0x7f4d48069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.838+0000 7f4d4e555700 1 -- 172.21.15.42:0/2935981081 shutdown_connections 2020-04-02T23:39:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:24.838+0000 7f4d4e555700 1 -- 172.21.15.42:0/2935981081 wait complete. 2020-04-02T23:39:24.863 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:24.938 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 4 2020-04-02T23:39:25.230 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.227+0000 7f9e50ac4700 1 Processor -- start 2020-04-02T23:39:25.230 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.227+0000 7f9e50ac4700 1 -- start start 2020-04-02T23:39:25.231 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.228+0000 7f9e50ac4700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9e4c05b6e0 0x7f9e4c0a5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:25.232 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.228+0000 7f9e50ac4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9e4c0a6200 0x7f9e4c133730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:25.232 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.228+0000 7f9e50ac4700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9e4c133b90 0x7f9e4c0a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:25.232 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.228+0000 7f9e50ac4700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e4c0a4aa0 con 0x7f9e4c133b90 2020-04-02T23:39:25.232 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.228+0000 7f9e50ac4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e4c0a56a0 con 0x7f9e4c0a6200 2020-04-02T23:39:25.233 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.228+0000 7f9e50ac4700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c0a83d0 con 0x7f9e4c05b6e0 2020-04-02T23:39:25.233 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.228+0000 7f9e49d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9e4c0a6200 0x7f9e4c133730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:25.233 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.228+0000 7f9e4ad9d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9e4c133b90 0x7f9e4c0a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:25.233 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.228+0000 7f9e49d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9e4c0a6200 0x7f9e4c133730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.42:35070/0 (socket says 172.21.15.42:35070) 2020-04-02T23:39:25.234 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.228+0000 7f9e49d9b700 1 -- 172.21.15.42:0/663369166 learned_addr learned my addr 172.21.15.42:0/663369166 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:39:25.234 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.228+0000 7f9e4ad9d700 1 -- 172.21.15.42:0/663369166 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9e4c05b6e0 msgr2=0x7f9e4c0a5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:25.235 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.231+0000 7f9e4a59c700 1 --2- 172.21.15.42:0/663369166 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9e4c05b6e0 0x7f9e4c0a5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:25.235 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.231+0000 7f9e4ad9d700 1 --2- 172.21.15.42:0/663369166 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9e4c05b6e0 0x7f9e4c0a5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:25.236 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.231+0000 7f9e4ad9d700 1 -- 172.21.15.42:0/663369166 >> v2:172.21.15.84:3300/0 conn(0x7f9e4c0a6200 msgr2=0x7f9e4c133730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:25.236 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.231+0000 7f9e4ad9d700 1 --2- 172.21.15.42:0/663369166 >> v2:172.21.15.84:3300/0 conn(0x7f9e4c0a6200 0x7f9e4c133730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:25.236 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.231+0000 7f9e4ad9d700 1 -- 172.21.15.42:0/663369166 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4c0a5890 con 0x7f9e4c133b90 2020-04-02T23:39:25.236 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.231+0000 7f9e49d9b700 1 --2- 172.21.15.42:0/663369166 >> v2:172.21.15.84:3300/0 conn(0x7f9e4c0a6200 0x7f9e4c133730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-04-02T23:39:25.237 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.231+0000 7f9e4ad9d700 1 --2- 172.21.15.42:0/663369166 >> v2:172.21.15.42:3300/0 conn(0x7f9e4c133b90 0x7f9e4c0a95b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9e440032b0 tx=0x7f9e44007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.237 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.231+0000 7f9e4ad9d700 1 --2- 172.21.15.42:0/663369166 >> v2:172.21.15.42:3300/0 conn(0x7f9e4c133b90 0x7f9e4c0a95b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9e440032b0 tx=0x7f9e44007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.237 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.231+0000 7f9e4ad9d700 1 --2- 172.21.15.42:0/663369166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e4c133b90 0x7f9e4c0a95b0 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7f9e440032b0 tx=0x7f9e44007dc0).ready entity=mon.0 client_cookie=e02210c7b872a835 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:25.237 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.232+0000 7f9e4ad9d700 1 --2- 172.21.15.42:0/663369166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e4c133b90 0x7f9e4c0a95b0 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f9e440032b0 tx=0x7f9e44007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.238 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.232+0000 7f9e4ad9d700 1 --2- 172.21.15.42:0/663369166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e4c133b90 0x7f9e4c0a95b0 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f9e440032b0 tx=0x7f9e44007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.238 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.232+0000 7f9e4ad9d700 1 --2- 172.21.15.42:0/663369166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e4c133b90 0x7f9e4c0a95b0 secure :-1 s=THROTTLE_DONE pgs=212 cs=0 l=1 rx=0x7f9e440032b0 tx=0x7f9e44007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.240 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.234+0000 7f9e4959a700 1 -- 172.21.15.42:0/663369166 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e4400a160 con 0x7f9e4c133b90 2020-04-02T23:39:25.240 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.234+0000 7f9e4959a700 1 -- 172.21.15.42:0/663369166 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4400a2c0 con 0x7f9e4c133b90 2020-04-02T23:39:25.240 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.234+0000 7f9e4959a700 1 -- 172.21.15.42:0/663369166 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e4400a620 con 0x7f9e4c133b90 2020-04-02T23:39:25.240 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.234+0000 7f9e50ac4700 1 -- 172.21.15.42:0/663369166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e4c133b90 msgr2=0x7f9e4c0a95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:25.240 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.234+0000 7f9e50ac4700 1 --2- 172.21.15.42:0/663369166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e4c133b90 0x7f9e4c0a95b0 secure :-1 s=READY pgs=212 cs=0 l=1 rx=0x7f9e440032b0 tx=0x7f9e44007dc0).stop 2020-04-02T23:39:25.241 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.235+0000 7f9e50ac4700 1 -- 172.21.15.42:0/663369166 shutdown_connections 2020-04-02T23:39:25.241 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.235+0000 7f9e50ac4700 1 --2- 172.21.15.42:0/663369166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e4c133b90 0x7f9e4c0a95b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:25.242 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.235+0000 7f9e50ac4700 1 --2- 172.21.15.42:0/663369166 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9e4c05b6e0 0x7f9e4c0a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:25.242 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.235+0000 7f9e50ac4700 1 --2- 172.21.15.42:0/663369166 >> v2:172.21.15.84:3300/0 conn(0x7f9e4c0a6200 0x7f9e4c133730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:25.242 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.235+0000 7f9e50ac4700 1 -- 172.21.15.42:0/663369166 >> 172.21.15.42:0/663369166 conn(0x7f9e4c062a40 msgr2=0x7f9e4c05ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:25.242 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.235+0000 7f9e50ac4700 1 -- 172.21.15.42:0/663369166 shutdown_connections 2020-04-02T23:39:25.242 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.235+0000 7f9e50ac4700 1 -- 172.21.15.42:0/663369166 wait complete. 2020-04-02T23:39:25.243 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.236+0000 7f9e50ac4700 1 Processor -- start 2020-04-02T23:39:25.243 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.236+0000 7f9e50ac4700 1 -- start start 2020-04-02T23:39:25.248 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.237+0000 7f9e50ac4700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9e4c05b6e0 0x7f9e4c1380b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:25.248 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.237+0000 7f9e50ac4700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e4c138510 con 0x7f9e4c133b90 2020-04-02T23:39:25.249 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.237+0000 7f9e50ac4700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e4c05f2c0 con 0x7f9e4c0a6200 2020-04-02T23:39:25.249 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.237+0000 7f9e50ac4700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e4c05f560 con 0x7f9e4c05b6e0 2020-04-02T23:39:25.249 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.237+0000 7f9e4ad9d700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f9e4c133b90 0x7f9e4c14d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60010/0 (socket says 172.21.15.42:60010) 2020-04-02T23:39:25.249 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.238+0000 7f9e4ad9d700 1 -- 172.21.15.42:0/201423415 learned_addr learned my addr 172.21.15.42:0/201423415 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:25.250 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.238+0000 7f9e3b7fe700 1 -- 172.21.15.42:0/201423415 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199032601 0 0) 0x7f9e4c05f2c0 con 0x7f9e4c0a6200 2020-04-02T23:39:25.250 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.238+0000 7f9e3b7fe700 1 -- 172.21.15.42:0/201423415 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e28002fe0 con 0x7f9e4c0a6200 2020-04-02T23:39:25.250 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.238+0000 7f9e3b7fe700 1 -- 172.21.15.42:0/201423415 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310194547 0 0) 0x7f9e4c0a5890 con 0x7f9e4c133b90 2020-04-02T23:39:25.250 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.238+0000 7f9e3b7fe700 1 -- 172.21.15.42:0/201423415 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e4c05f2c0 con 0x7f9e4c133b90 2020-04-02T23:39:25.251 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.238+0000 7f9e3b7fe700 1 -- 172.21.15.42:0/201423415 <== mon.1 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2779396743 0 0) 0x7f9e28002fe0 con 0x7f9e4c0a6200 2020-04-02T23:39:25.251 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.238+0000 7f9e3b7fe700 1 -- 172.21.15.42:0/201423415 --> v1:172.21.15.84:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9e4c0a5890 con 0x7f9e4c0a6200 2020-04-02T23:39:25.252 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.238+0000 7f9e3b7fe700 1 -- 172.21.15.42:0/201423415 <== mon.1 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7f9e400024c0 con 0x7f9e4c0a6200 2020-04-02T23:39:25.252 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.238+0000 7f9e3b7fe700 1 -- 172.21.15.42:0/201423415 >> v2:172.21.15.84:3300/0 conn(0x7f9e4c05b6e0 msgr2=0x7f9e4c1380b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2020-04-02T23:39:25.252 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.238+0000 7f9e3b7fe700 1 --2- 172.21.15.42:0/201423415 >> v2:172.21.15.84:3300/0 conn(0x7f9e4c05b6e0 0x7f9e4c1380b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:25.252 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.238+0000 7f9e3b7fe700 1 -- 172.21.15.42:0/201423415 >> v1:172.21.15.84:6789/0 conn(0x7f9e4c0a6200 legacy=0x7f9e4c09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:25.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.238+0000 7f9e3b7fe700 1 -- 172.21.15.42:0/201423415 >> v1:172.21.15.42:6789/0 conn(0x7f9e4c133b90 legacy=0x7f9e4c14d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:25.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.238+0000 7f9e3b7fe700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e28004b70 0x7f9e28004f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:25.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.238+0000 7f9e3b7fe700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9e28003670 0x7f9e28003ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:25.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.238+0000 7f9e3b7fe700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28003f30 0x7f9e2800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:25.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.238+0000 7f9e3b7fe700 1 -- 172.21.15.42:0/201423415 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c05f560 con 0x7f9e28004b70 2020-04-02T23:39:25.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.238+0000 7f9e3b7fe700 1 -- 172.21.15.42:0/201423415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e28004460 con 0x7f9e28003f30 2020-04-02T23:39:25.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.238+0000 7f9e3b7fe700 1 -- 172.21.15.42:0/201423415 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2800bbb0 con 0x7f9e28003670 2020-04-02T23:39:25.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.239+0000 7f9e49d9b700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9e28003670 0x7f9e28003ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:25.255 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.239+0000 7f9e4ad9d700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28003f30 0x7f9e2800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:25.255 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.239+0000 7f9e49d9b700 1 -- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28003f30 msgr2=0x7f9e2800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:25.255 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.239+0000 7f9e49d9b700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28003f30 0x7f9e2800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:25.255 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.239+0000 7f9e49d9b700 1 -- 172.21.15.42:0/201423415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e28004b70 msgr2=0x7f9e28004f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:25.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.239+0000 7f9e49d9b700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e28004b70 0x7f9e28004f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:25.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.239+0000 7f9e49d9b700 1 -- 172.21.15.42:0/201423415 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4c05f800 con 0x7f9e28003670 2020-04-02T23:39:25.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.239+0000 7f9e49d9b700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9e28003670 0x7f9e28003ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9e40007a60 tx=0x7f9e40007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.239+0000 7f9e49d9b700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9e28003670 0x7f9e28003ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9e40007a60 tx=0x7f9e40007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.257 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.239+0000 7f9e49d9b700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9e28003670 0x7f9e28003ad0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f9e40007a60 tx=0x7f9e40007ae0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:25.257 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.239+0000 7f9e4ad9d700 1 -- 172.21.15.42:0/201423415 reap_dead start 2020-04-02T23:39:25.257 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.239+0000 7f9e50ac4700 1 -- 172.21.15.42:0/201423415 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e4c09d030 con 0x7f9e28003670 2020-04-02T23:39:25.257 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.239+0000 7f9e49d9b700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9e28003670 0x7f9e28003ad0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f9e40007a60 tx=0x7f9e40007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.258 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.239+0000 7f9e49d9b700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9e28003670 0x7f9e28003ad0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f9e40007a60 tx=0x7f9e40007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.258 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.239+0000 7f9e49d9b700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9e28003670 0x7f9e28003ad0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f9e40007a60 tx=0x7f9e40007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.258 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.239+0000 7f9e3b7fe700 1 -- 172.21.15.42:0/201423415 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e40011ea0 con 0x7f9e28003670 2020-04-02T23:39:25.258 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.240+0000 7f9e3b7fe700 1 -- 172.21.15.42:0/201423415 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e400058b0 con 0x7f9e28003670 2020-04-02T23:39:25.258 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.240+0000 7f9e50ac4700 1 -- 172.21.15.42:0/201423415 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e4c1376f0 con 0x7f9e28003670 2020-04-02T23:39:25.259 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.240+0000 7f9e3b7fe700 1 -- 172.21.15.42:0/201423415 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e40005cd0 con 0x7f9e28003670 2020-04-02T23:39:25.259 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.240+0000 7f9e49d9b700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9e28003670 0x7f9e28003ad0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f9e40007a60 tx=0x7f9e40007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.259 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.241+0000 7f9e50ac4700 1 -- 172.21.15.42:0/201423415 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e4c05f990 con 0x7f9e28003670 2020-04-02T23:39:25.259 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.241+0000 7f9e3b7fe700 1 -- 172.21.15.42:0/201423415 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f9e40010250 con 0x7f9e28003670 2020-04-02T23:39:25.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.241+0000 7f9e49d9b700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9e28003670 0x7f9e28003ad0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f9e40007a60 tx=0x7f9e40007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.241+0000 7f9e3b7fe700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9e28053a70 0x7f9e28055f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:25.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.241+0000 7f9e3b7fe700 1 -- 172.21.15.42:0/201423415 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f9e400615f0 con 0x7f9e28003670 2020-04-02T23:39:25.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.243+0000 7f9e4a59c700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9e28053a70 0x7f9e28055f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:25.260 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.243+0000 7f9e4a59c700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9e28053a70 0x7f9e28055f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9e3c002f30 tx=0x7f9e3c008990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.261 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.243+0000 7f9e4a59c700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9e28053a70 0x7f9e28055f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9e3c002f30 tx=0x7f9e3c008990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.261 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.243+0000 7f9e4a59c700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9e28053a70 0x7f9e28055f30 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f9e3c002f30 tx=0x7f9e3c008990).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:25.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.246+0000 7f9e49d9b700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9e28003670 0x7f9e28003ad0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7f9e40007a60 tx=0x7f9e40007ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.262 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.246+0000 7f9e3b7fe700 1 -- 172.21.15.42:0/201423415 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f9e4003cdb0 con 0x7f9e28003670 2020-04-02T23:39:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.541+0000 7f9e50ac4700 1 -- 172.21.15.42:0/201423415 --> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e4c060fc0 con 0x7f9e28053a70 2020-04-02T23:39:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.541+0000 7f9e4a59c700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9e28053a70 0x7f9e28055f30 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f9e3c002f30 tx=0x7f9e3c008990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.541+0000 7f9e3b7fe700 1 -- 172.21.15.42:0/201423415 <== mgr.4100 v2:172.21.15.84:6800/23437 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9e3c009cf0 con 0x7f9e28053a70 2020-04-02T23:39:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.544+0000 7f9e50ac4700 1 -- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9e28053a70 msgr2=0x7f9e28055f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.544+0000 7f9e50ac4700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9e28053a70 0x7f9e28055f30 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f9e3c002f30 tx=0x7f9e3c008990).stop 2020-04-02T23:39:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.544+0000 7f9e50ac4700 1 -- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9e28003670 msgr2=0x7f9e28003ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.544+0000 7f9e50ac4700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9e28003670 0x7f9e28003ad0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7f9e40007a60 tx=0x7f9e40007ae0).stop 2020-04-02T23:39:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.544+0000 7f9e50ac4700 1 -- 172.21.15.42:0/201423415 shutdown_connections 2020-04-02T23:39:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.544+0000 7f9e50ac4700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f9e28053a70 0x7f9e28055f30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.544+0000 7f9e50ac4700 1 --2- 172.21.15.42:0/201423415 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f9e28003670 0x7f9e28003ad0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.544+0000 7f9e50ac4700 1 -- 172.21.15.42:0/201423415 >> 172.21.15.42:0/201423415 conn(0x7f9e4c062a40 msgr2=0x7f9e4c069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:25.552 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.544+0000 7f9e50ac4700 1 -- 172.21.15.42:0/201423415 shutdown_connections 2020-04-02T23:39:25.552 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.544+0000 7f9e50ac4700 1 -- 172.21.15.42:0/201423415 wait complete. 2020-04-02T23:39:25.552 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 4 to deep-scrub 2020-04-02T23:39:25.572 INFO:tasks.ceph:Scrubbing osd.5 2020-04-02T23:39:25.572 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:25.637 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 config set osd_debug_deep_scrub_sleep 0 2020-04-02T23:39:25.893 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.886+0000 7f3eb4527700 1 Processor -- start 2020-04-02T23:39:25.893 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.886+0000 7f3eb4527700 1 -- start start 2020-04-02T23:39:25.893 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.887+0000 7f3eb4527700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3eac13edd0 0x7f3eac1411c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:25.893 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.887+0000 7f3eb4527700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac0a6e80 con 0x7f3eac0ac4d0 2020-04-02T23:39:25.894 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.887+0000 7f3eb4527700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac0a7bd0 con 0x7f3eac0a6540 2020-04-02T23:39:25.894 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.887+0000 7f3eb4527700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eac09ed30 con 0x7f3eac13edd0 2020-04-02T23:39:25.894 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.888+0000 7f3eb22c3700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f3eac0ac4d0 0x7f3eac0a74c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60022/0 (socket says 172.21.15.42:60022) 2020-04-02T23:39:25.894 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.888+0000 7f3eb22c3700 1 -- 172.21.15.42:0/2472657074 learned_addr learned my addr 172.21.15.42:0/2472657074 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:25.894 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.888+0000 7f3eb12c1700 1 -- 172.21.15.42:0/2472657074 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551662585 0 0) 0x7f3eac0a6e80 con 0x7f3eac0ac4d0 2020-04-02T23:39:25.894 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.888+0000 7f3eb12c1700 1 -- 172.21.15.42:0/2472657074 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e98003230 con 0x7f3eac0ac4d0 2020-04-02T23:39:25.895 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.888+0000 7f3eb2ac4700 1 --2- 172.21.15.42:0/2472657074 >> v2:172.21.15.42:3300/0 conn(0x7f3eac13edd0 0x7f3eac1411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:25.895 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.889+0000 7f3eb2ac4700 1 -- 172.21.15.42:0/2472657074 >> v1:172.21.15.84:6789/0 conn(0x7f3eac0a6540 legacy=0x7f3eac1390e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:25.895 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.889+0000 7f3eb2ac4700 1 -- 172.21.15.42:0/2472657074 >> v1:172.21.15.42:6789/0 conn(0x7f3eac0ac4d0 legacy=0x7f3eac0a74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:25.895 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.889+0000 7f3eb2ac4700 1 -- 172.21.15.42:0/2472657074 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac0a6be0 con 0x7f3eac13edd0 2020-04-02T23:39:25.895 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.890+0000 7f3eb2ac4700 1 --2- 172.21.15.42:0/2472657074 >> v2:172.21.15.42:3300/0 conn(0x7f3eac13edd0 0x7f3eac1411c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3e9c002f30 tx=0x7f3e9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.895 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.890+0000 7f3eb2ac4700 1 --2- 172.21.15.42:0/2472657074 >> v2:172.21.15.42:3300/0 conn(0x7f3eac13edd0 0x7f3eac1411c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3e9c002f30 tx=0x7f3e9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.895 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.890+0000 7f3eb2ac4700 1 --2- 172.21.15.42:0/2472657074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3eac13edd0 0x7f3eac1411c0 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f3e9c002f30 tx=0x7f3e9c007a40).ready entity=mon.0 client_cookie=5720fac30fdba556 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:25.895 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.890+0000 7f3eb2ac4700 1 --2- 172.21.15.42:0/2472657074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3eac13edd0 0x7f3eac1411c0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f3e9c002f30 tx=0x7f3e9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.896 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.890+0000 7f3eb2ac4700 1 --2- 172.21.15.42:0/2472657074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3eac13edd0 0x7f3eac1411c0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f3e9c002f30 tx=0x7f3e9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.896 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.890+0000 7f3eb2ac4700 1 --2- 172.21.15.42:0/2472657074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3eac13edd0 0x7f3eac1411c0 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f3e9c002f30 tx=0x7f3e9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.898 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.894+0000 7f3eb12c1700 1 -- 172.21.15.42:0/2472657074 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e9c0115b0 con 0x7f3eac13edd0 2020-04-02T23:39:25.899 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.896+0000 7f3eb12c1700 1 -- 172.21.15.42:0/2472657074 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9c011710 con 0x7f3eac13edd0 2020-04-02T23:39:25.899 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.897+0000 7f3eb4527700 1 -- 172.21.15.42:0/2472657074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3eac13edd0 msgr2=0x7f3eac1411c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:25.899 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.897+0000 7f3eb4527700 1 --2- 172.21.15.42:0/2472657074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3eac13edd0 0x7f3eac1411c0 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f3e9c002f30 tx=0x7f3e9c007a40).stop 2020-04-02T23:39:25.908 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.905+0000 7f3eb4527700 1 -- 172.21.15.42:0/2472657074 shutdown_connections 2020-04-02T23:39:25.908 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.905+0000 7f3eb4527700 1 --2- 172.21.15.42:0/2472657074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3eac13edd0 0x7f3eac1411c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:25.908 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.905+0000 7f3eb4527700 1 -- 172.21.15.42:0/2472657074 >> 172.21.15.42:0/2472657074 conn(0x7f3eac05c7e0 msgr2=0x7f3eac0aba40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:25.914 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.911+0000 7f3eb4527700 1 -- 172.21.15.42:0/2472657074 shutdown_connections 2020-04-02T23:39:25.922 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.914+0000 7f3eb4527700 1 -- 172.21.15.42:0/2472657074 wait complete. 2020-04-02T23:39:25.922 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.915+0000 7f3eb4527700 1 Processor -- start 2020-04-02T23:39:25.922 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.916+0000 7f3eb4527700 1 -- start start 2020-04-02T23:39:25.922 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.916+0000 7f3eb4527700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3eac0ac4d0 0x7f3eac12c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:25.923 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.916+0000 7f3eb4527700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3eac13edd0 0x7f3eac12cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:25.923 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.916+0000 7f3eb4527700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac0656e0 con 0x7f3eac0a6540 2020-04-02T23:39:25.923 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.916+0000 7f3eb4527700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eac09f8a0 con 0x7f3eac13edd0 2020-04-02T23:39:25.923 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.916+0000 7f3eb4527700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac062460 con 0x7f3eac0ac4d0 2020-04-02T23:39:25.923 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.917+0000 7f3eb2ac4700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3eac13edd0 0x7f3eac12cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:25.923 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.917+0000 7f3eb2ac4700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3eac13edd0 0x7f3eac12cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40606/0 (socket says 172.21.15.42:40606) 2020-04-02T23:39:25.923 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.917+0000 7f3eb2ac4700 1 -- 172.21.15.42:0/1596693363 learned_addr learned my addr 172.21.15.42:0/1596693363 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:39:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.917+0000 7f3eb2ac4700 1 -- 172.21.15.42:0/1596693363 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3eac0ac4d0 msgr2=0x7f3eac12c800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-04-02T23:39:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.917+0000 7f3eb2ac4700 1 --2- 172.21.15.42:0/1596693363 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f3eac0ac4d0 0x7f3eac12c800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.917+0000 7f3eb2ac4700 1 -- 172.21.15.42:0/1596693363 >> v1:172.21.15.84:6789/0 conn(0x7f3eac0a6540 legacy=0x7f3eac0a07b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2020-04-02T23:39:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.917+0000 7f3eb2ac4700 1 -- 172.21.15.42:0/1596693363 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac062700 con 0x7f3eac13edd0 2020-04-02T23:39:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.917+0000 7f3eb2ac4700 1 --2- 172.21.15.42:0/1596693363 >> v2:172.21.15.42:3300/0 conn(0x7f3eac13edd0 0x7f3eac12cc60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3eac0a0690 tx=0x7f3e9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.917+0000 7f3eb2ac4700 1 --2- 172.21.15.42:0/1596693363 >> v2:172.21.15.42:3300/0 conn(0x7f3eac13edd0 0x7f3eac12cc60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3eac0a0690 tx=0x7f3e9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.917+0000 7f3eb2ac4700 1 --2- 172.21.15.42:0/1596693363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3eac13edd0 0x7f3eac12cc60 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7f3eac0a0690 tx=0x7f3e9c007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:25.925 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.918+0000 7f3eb2ac4700 1 --2- 172.21.15.42:0/1596693363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3eac13edd0 0x7f3eac12cc60 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f3eac0a0690 tx=0x7f3e9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.925 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.918+0000 7f3eb2ac4700 1 --2- 172.21.15.42:0/1596693363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3eac13edd0 0x7f3eac12cc60 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f3eac0a0690 tx=0x7f3e9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.925 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.918+0000 7f3eb2ac4700 1 --2- 172.21.15.42:0/1596693363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3eac13edd0 0x7f3eac12cc60 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f3eac0a0690 tx=0x7f3e9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.922+0000 7f3ea37fe700 1 -- 172.21.15.42:0/1596693363 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e9c0058b0 con 0x7f3eac13edd0 2020-04-02T23:39:25.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.922+0000 7f3ea37fe700 1 -- 172.21.15.42:0/1596693363 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9c005a10 con 0x7f3eac13edd0 2020-04-02T23:39:25.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.922+0000 7f3eb4527700 1 -- 172.21.15.42:0/1596693363 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eac0620e0 con 0x7f3eac13edd0 2020-04-02T23:39:25.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.922+0000 7f3eb4527700 1 -- 172.21.15.42:0/1596693363 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eac149c40 con 0x7f3eac13edd0 2020-04-02T23:39:25.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.922+0000 7f3ea37fe700 1 -- 172.21.15.42:0/1596693363 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e9c005db0 con 0x7f3eac13edd0 2020-04-02T23:39:25.926 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.923+0000 7f3eb2ac4700 1 --2- 172.21.15.42:0/1596693363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3eac13edd0 0x7f3eac12cc60 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f3eac0a0690 tx=0x7f3e9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.927 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.924+0000 7f3eb2ac4700 1 --2- 172.21.15.42:0/1596693363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3eac13edd0 0x7f3eac12cc60 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f3eac0a0690 tx=0x7f3e9c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.924+0000 7f3ea37fe700 1 -- 172.21.15.42:0/1596693363 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f3e9c0118c0 con 0x7f3eac13edd0 2020-04-02T23:39:25.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.924+0000 7f3ea37fe700 1 --2- 172.21.15.42:0/1596693363 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f3e9804da10 0x7f3e9804fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:25.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.924+0000 7f3ea37fe700 1 -- 172.21.15.42:0/1596693363 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f3e9c061770 con 0x7f3eac13edd0 2020-04-02T23:39:25.928 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.924+0000 7f3eb4527700 1 --2- 172.21.15.42:0/1596693363 >> [v2:172.21.15.84:6810/24276,v1:172.21.15.84:6811/24276] conn(0x7f3e940028a0 0x7f3e94002d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:25.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.924+0000 7f3eb4527700 1 -- 172.21.15.42:0/1596693363 --> [v2:172.21.15.84:6810/24276,v1:172.21.15.84:6811/24276] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e94001d30 con 0x7f3e940028a0 2020-04-02T23:39:25.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.925+0000 7f3eb1ac2700 1 --2- 172.21.15.42:0/1596693363 >> [v2:172.21.15.84:6810/24276,v1:172.21.15.84:6811/24276] conn(0x7f3e940028a0 0x7f3e94002d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:25.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.925+0000 7f3eb1ac2700 1 --2- 172.21.15.42:0/1596693363 >> [v2:172.21.15.84:6810/24276,v1:172.21.15.84:6811/24276] conn(0x7f3e940028a0 0x7f3e94002d50 crc :-1 s=READY pgs=9 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:25.929 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.926+0000 7f3eb22c3700 1 --2- 172.21.15.42:0/1596693363 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f3e9804da10 0x7f3e9804fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:25.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.927+0000 7f3eb22c3700 1 --2- 172.21.15.42:0/1596693363 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f3e9804da10 0x7f3e9804fed0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ea4001450 tx=0x7f3ea4001740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.927+0000 7f3eb22c3700 1 --2- 172.21.15.42:0/1596693363 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f3e9804da10 0x7f3e9804fed0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ea4001450 tx=0x7f3ea4001740).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:25.930 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.927+0000 7f3eb22c3700 1 --2- 172.21.15.42:0/1596693363 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f3e9804da10 0x7f3e9804fed0 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f3ea4001450 tx=0x7f3ea4001740).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:25.931 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.929+0000 7f3ea37fe700 1 -- 172.21.15.42:0/1596693363 <== osd.5 v2:172.21.15.84:6810/24276 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f3e94001d30 con 0x7f3e940028a0 2020-04-02T23:39:25.966 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.964+0000 7f3eb4527700 1 -- 172.21.15.42:0/1596693363 --> [v2:172.21.15.84:6810/24276,v1:172.21.15.84:6811/24276] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3e94000bd0 con 0x7f3e940028a0 2020-04-02T23:39:25.967 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.964+0000 7f3ea37fe700 1 -- 172.21.15.42:0/1596693363 <== osd.5 v2:172.21.15.84:6810/24276 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3e94000bd0 con 0x7f3e940028a0 2020-04-02T23:39:25.967 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2020-04-02T23:39:25.967 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-04-02T23:39:25.967 INFO:teuthology.orchestra.run.smithi042.stdout:} 2020-04-02T23:39:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.965+0000 7f3eb4527700 1 -- 172.21.15.42:0/1596693363 >> [v2:172.21.15.84:6810/24276,v1:172.21.15.84:6811/24276] conn(0x7f3e940028a0 msgr2=0x7f3e94002d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.965+0000 7f3eb4527700 1 --2- 172.21.15.42:0/1596693363 >> [v2:172.21.15.84:6810/24276,v1:172.21.15.84:6811/24276] conn(0x7f3e940028a0 0x7f3e94002d50 crc :-1 s=READY pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.965+0000 7f3eb4527700 1 -- 172.21.15.42:0/1596693363 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f3e9804da10 msgr2=0x7f3e9804fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.965+0000 7f3eb4527700 1 --2- 172.21.15.42:0/1596693363 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f3e9804da10 0x7f3e9804fed0 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f3ea4001450 tx=0x7f3ea4001740).stop 2020-04-02T23:39:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.965+0000 7f3eb4527700 1 -- 172.21.15.42:0/1596693363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3eac13edd0 msgr2=0x7f3eac12cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:25.970 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.966+0000 7f3eb4527700 1 --2- 172.21.15.42:0/1596693363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3eac13edd0 0x7f3eac12cc60 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7f3eac0a0690 tx=0x7f3e9c007a40).stop 2020-04-02T23:39:25.970 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.966+0000 7f3eb2ac4700 1 -- 172.21.15.42:0/1596693363 reap_dead start 2020-04-02T23:39:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.966+0000 7f3eb4527700 1 -- 172.21.15.42:0/1596693363 shutdown_connections 2020-04-02T23:39:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.966+0000 7f3eb4527700 1 --2- 172.21.15.42:0/1596693363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3eac13edd0 0x7f3eac12cc60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.966+0000 7f3eb4527700 1 -- 172.21.15.42:0/1596693363 >> 172.21.15.42:0/1596693363 conn(0x7f3eac05c7e0 msgr2=0x7f3eac069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.966+0000 7f3eb4527700 1 -- 172.21.15.42:0/1596693363 shutdown_connections 2020-04-02T23:39:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:25.966+0000 7f3eb4527700 1 -- 172.21.15.42:0/1596693363 wait complete. 2020-04-02T23:39:25.985 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:26.063 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 5 2020-04-02T23:39:26.307 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.304+0000 7f4b7351e700 1 Processor -- start 2020-04-02T23:39:26.307 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.304+0000 7f4b7351e700 1 -- start start 2020-04-02T23:39:26.308 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.304+0000 7f4b7351e700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4b6c05c090 0x7f4b6c05c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:26.308 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.304+0000 7f4b7351e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b6c141060 0x7f4b6c143450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:26.308 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.305+0000 7f4b7351e700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b6c05c950 con 0x7f4b6c0aa1a0 2020-04-02T23:39:26.308 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.305+0000 7f4b7351e700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6c0aacd0 con 0x7f4b6c05c090 2020-04-02T23:39:26.308 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.305+0000 7f4b7351e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6c0a2980 con 0x7f4b6c141060 2020-04-02T23:39:26.309 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.305+0000 7f4b712ba700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f4b6c0aa1a0 0x7f4b6c138720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60036/0 (socket says 172.21.15.42:60036) 2020-04-02T23:39:26.309 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.305+0000 7f4b712ba700 1 -- 172.21.15.42:0/3712635327 learned_addr learned my addr 172.21.15.42:0/3712635327 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:26.314 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.309+0000 7f4b63fff700 1 -- 172.21.15.42:0/3712635327 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271370790 0 0) 0x7f4b6c05c950 con 0x7f4b6c0aa1a0 2020-04-02T23:39:26.315 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.309+0000 7f4b63fff700 1 -- 172.21.15.42:0/3712635327 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b50003230 con 0x7f4b6c0aa1a0 2020-04-02T23:39:26.315 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.309+0000 7f4b71abb700 1 --2- 172.21.15.42:0/3712635327 >> v2:172.21.15.84:3300/0 conn(0x7f4b6c141060 0x7f4b6c143450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:26.315 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.309+0000 7f4b63fff700 1 -- 172.21.15.42:0/3712635327 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1333882111 0 0) 0x7f4b50003230 con 0x7f4b6c0aa1a0 2020-04-02T23:39:26.315 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.309+0000 7f4b63fff700 1 -- 172.21.15.42:0/3712635327 >> v2:172.21.15.84:3300/0 conn(0x7f4b6c141060 msgr2=0x7f4b6c143450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:26.315 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.309+0000 7f4b63fff700 1 --2- 172.21.15.42:0/3712635327 >> v2:172.21.15.84:3300/0 conn(0x7f4b6c141060 0x7f4b6c143450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:26.315 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.309+0000 7f4b63fff700 1 -- 172.21.15.42:0/3712635327 >> v2:172.21.15.42:3300/0 conn(0x7f4b6c05c090 msgr2=0x7f4b6c05c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:26.315 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.309+0000 7f4b63fff700 1 --2- 172.21.15.42:0/3712635327 >> v2:172.21.15.42:3300/0 conn(0x7f4b6c05c090 0x7f4b6c05c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:26.316 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.309+0000 7f4b63fff700 1 -- 172.21.15.42:0/3712635327 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c13c100 con 0x7f4b6c0aa1a0 2020-04-02T23:39:26.316 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.310+0000 7f4b63fff700 1 -- 172.21.15.42:0/3712635327 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7f4b680016d0 con 0x7f4b6c0aa1a0 2020-04-02T23:39:26.316 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.310+0000 7f4b63fff700 1 -- 172.21.15.42:0/3712635327 >> v1:172.21.15.42:6789/0 conn(0x7f4b6c0aa1a0 legacy=0x7f4b6c138720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:26.316 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.310+0000 7f4b63fff700 1 --2- 172.21.15.42:0/3712635327 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4b50003720 0x7f4b50003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:26.316 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.310+0000 7f4b63fff700 1 --2- 172.21.15.42:0/3712635327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b500044d0 0x7f4b50004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:26.316 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.310+0000 7f4b63fff700 1 --2- 172.21.15.42:0/3712635327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b50004db0 0x7f4b5000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:26.316 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.310+0000 7f4b63fff700 1 -- 172.21.15.42:0/3712635327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c0aacd0 con 0x7f4b500044d0 2020-04-02T23:39:26.317 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.310+0000 7f4b63fff700 1 -- 172.21.15.42:0/3712635327 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c0a2980 con 0x7f4b50004db0 2020-04-02T23:39:26.317 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.310+0000 7f4b63fff700 1 -- 172.21.15.42:0/3712635327 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b50004240 con 0x7f4b50003720 2020-04-02T23:39:26.317 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.310+0000 7f4b71abb700 1 --2- 172.21.15.42:0/3712635327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b50004db0 0x7f4b5000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:26.317 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.310+0000 7f4b712ba700 1 --2- 172.21.15.42:0/3712635327 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4b50003720 0x7f4b50003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:26.317 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.310+0000 7f4b71abb700 1 -- 172.21.15.42:0/3712635327 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4b50003720 msgr2=0x7f4b50003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:26.317 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.310+0000 7f4b71abb700 1 --2- 172.21.15.42:0/3712635327 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4b50003720 0x7f4b50003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:26.317 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.310+0000 7f4b71abb700 1 -- 172.21.15.42:0/3712635327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b500044d0 msgr2=0x7f4b50004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:26.318 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.310+0000 7f4b71abb700 1 --2- 172.21.15.42:0/3712635327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b500044d0 0x7f4b50004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:26.318 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.310+0000 7f4b71abb700 1 -- 172.21.15.42:0/3712635327 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b50003230 con 0x7f4b50004db0 2020-04-02T23:39:26.318 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.310+0000 7f4b712ba700 1 --2- 172.21.15.42:0/3712635327 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4b50003720 0x7f4b50003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:39:26.318 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.310+0000 7f4b71abb700 1 --2- 172.21.15.42:0/3712635327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b50004db0 0x7f4b5000b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4b500054a0 tx=0x7f4b64010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.318 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.310+0000 7f4b71abb700 1 -- 172.21.15.42:0/3712635327 reap_dead start 2020-04-02T23:39:26.318 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.310+0000 7f4b71abb700 1 --2- 172.21.15.42:0/3712635327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b50004db0 0x7f4b5000b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4b500054a0 tx=0x7f4b64010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.318 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.310+0000 7f4b71abb700 1 --2- 172.21.15.42:0/3712635327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b50004db0 0x7f4b5000b720 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b64010350).ready entity=mon.1 client_cookie=7f99dba71de2000d server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:26.319 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.312+0000 7f4b71abb700 1 --2- 172.21.15.42:0/3712635327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b50004db0 0x7f4b5000b720 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b64010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.319 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.312+0000 7f4b71abb700 1 --2- 172.21.15.42:0/3712635327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b50004db0 0x7f4b5000b720 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b64010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.319 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.312+0000 7f4b71abb700 1 --2- 172.21.15.42:0/3712635327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b50004db0 0x7f4b5000b720 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b64010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.320 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.313+0000 7f4b63fff700 1 -- 172.21.15.42:0/3712635327 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b64010e30 con 0x7f4b50004db0 2020-04-02T23:39:26.320 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.313+0000 7f4b63fff700 1 -- 172.21.15.42:0/3712635327 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b64005c30 con 0x7f4b50004db0 2020-04-02T23:39:26.320 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.313+0000 7f4b63fff700 1 -- 172.21.15.42:0/3712635327 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b640110c0 con 0x7f4b50004db0 2020-04-02T23:39:26.320 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.313+0000 7f4b7351e700 1 -- 172.21.15.42:0/3712635327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b50004db0 msgr2=0x7f4b5000b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:26.320 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.313+0000 7f4b7351e700 1 --2- 172.21.15.42:0/3712635327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b50004db0 0x7f4b5000b720 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b64010350).stop 2020-04-02T23:39:26.321 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.315+0000 7f4b7351e700 1 -- 172.21.15.42:0/3712635327 shutdown_connections 2020-04-02T23:39:26.321 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.315+0000 7f4b7351e700 1 --2- 172.21.15.42:0/3712635327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b50004db0 0x7f4b5000b720 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:26.321 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.315+0000 7f4b7351e700 1 -- 172.21.15.42:0/3712635327 >> 172.21.15.42:0/3712635327 conn(0x7f4b6c0aedc0 msgr2=0x7f4b6c0af1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:26.321 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.316+0000 7f4b7351e700 1 -- 172.21.15.42:0/3712635327 shutdown_connections 2020-04-02T23:39:26.321 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.319+0000 7f4b7351e700 1 -- 172.21.15.42:0/3712635327 wait complete. 2020-04-02T23:39:26.323 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.320+0000 7f4b7351e700 1 Processor -- start 2020-04-02T23:39:26.323 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.320+0000 7f4b7351e700 1 -- start start 2020-04-02T23:39:26.324 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.321+0000 7f4b7351e700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4b50004db0 0x7f4b6c134b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:26.324 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.321+0000 7f4b7351e700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4b6c138370 0x7f4b6c135490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:26.324 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.321+0000 7f4b7351e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b6c131dd0 0x7f4b6c132260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:26.324 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.321+0000 7f4b7351e700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6c135fe0 con 0x7f4b50004db0 2020-04-02T23:39:26.325 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.321+0000 7f4b7351e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6c0afaf0 con 0x7f4b6c131dd0 2020-04-02T23:39:26.325 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.321+0000 7f4b7351e700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c0a3970 con 0x7f4b6c138370 2020-04-02T23:39:26.325 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.321+0000 7f4b712ba700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4b50004db0 0x7f4b6c134b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:26.325 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.321+0000 7f4b71abb700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b6c131dd0 0x7f4b6c132260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:26.325 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.321+0000 7f4b712ba700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4b50004db0 0x7f4b6c134b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40624/0 (socket says 172.21.15.42:40624) 2020-04-02T23:39:26.325 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.321+0000 7f4b712ba700 1 -- 172.21.15.42:0/4213200478 learned_addr learned my addr 172.21.15.42:0/4213200478 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:39:26.325 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.321+0000 7f4b70ab9700 1 --2- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4b6c138370 0x7f4b6c135490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:26.328 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.322+0000 7f4b71abb700 1 -- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4b6c138370 msgr2=0x7f4b6c135490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:26.328 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.322+0000 7f4b71abb700 1 --2- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4b6c138370 0x7f4b6c135490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:26.328 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.322+0000 7f4b71abb700 1 -- 172.21.15.42:0/4213200478 >> v2:172.21.15.42:3300/0 conn(0x7f4b50004db0 msgr2=0x7f4b6c134b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:26.328 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.322+0000 7f4b71abb700 1 --2- 172.21.15.42:0/4213200478 >> v2:172.21.15.42:3300/0 conn(0x7f4b50004db0 0x7f4b6c134b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:26.328 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.322+0000 7f4b71abb700 1 -- 172.21.15.42:0/4213200478 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c0a4320 con 0x7f4b6c131dd0 2020-04-02T23:39:26.328 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.322+0000 7f4b71abb700 1 --2- 172.21.15.42:0/4213200478 >> v2:172.21.15.84:3300/0 conn(0x7f4b6c131dd0 0x7f4b6c132260 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b64010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.328 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.322+0000 7f4b71abb700 1 --2- 172.21.15.42:0/4213200478 >> v2:172.21.15.84:3300/0 conn(0x7f4b6c131dd0 0x7f4b6c132260 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b64010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.329 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.322+0000 7f4b71abb700 1 --2- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b6c131dd0 0x7f4b6c132260 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b64010350).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:26.329 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.322+0000 7f4b71abb700 1 --2- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b6c131dd0 0x7f4b6c132260 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b64010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.329 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.322+0000 7f4b627fc700 1 -- 172.21.15.42:0/4213200478 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b64010e30 con 0x7f4b6c131dd0 2020-04-02T23:39:26.329 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.322+0000 7f4b71abb700 1 --2- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b6c131dd0 0x7f4b6c132260 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b64010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.329 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.322+0000 7f4b71abb700 1 --2- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b6c131dd0 0x7f4b6c132260 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b64010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.329 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.322+0000 7f4b627fc700 1 -- 172.21.15.42:0/4213200478 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6400f3e0 con 0x7f4b6c131dd0 2020-04-02T23:39:26.329 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.322+0000 7f4b627fc700 1 -- 172.21.15.42:0/4213200478 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6400f780 con 0x7f4b6c131dd0 2020-04-02T23:39:26.330 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.322+0000 7f4b7351e700 1 -- 172.21.15.42:0/4213200478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6c0a45c0 con 0x7f4b6c131dd0 2020-04-02T23:39:26.330 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.322+0000 7f4b7351e700 1 -- 172.21.15.42:0/4213200478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6c0a9460 con 0x7f4b6c131dd0 2020-04-02T23:39:26.330 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.323+0000 7f4b71abb700 1 --2- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b6c131dd0 0x7f4b6c132260 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b64010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.330 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.324+0000 7f4b627fc700 1 -- 172.21.15.42:0/4213200478 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f4b6400f8e0 con 0x7f4b6c131dd0 2020-04-02T23:39:26.330 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.324+0000 7f4b71abb700 1 --2- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b6c131dd0 0x7f4b6c132260 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b64010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.330 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.324+0000 7f4b7351e700 1 -- 172.21.15.42:0/4213200478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b6c056c50 con 0x7f4b6c131dd0 2020-04-02T23:39:26.330 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.324+0000 7f4b627fc700 1 --2- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4b5404d5d0 0x7f4b5404fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:26.330 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.324+0000 7f4b627fc700 1 -- 172.21.15.42:0/4213200478 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4b64083590 con 0x7f4b6c131dd0 2020-04-02T23:39:26.331 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.324+0000 7f4b712ba700 1 --2- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4b5404d5d0 0x7f4b5404fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:26.331 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.324+0000 7f4b712ba700 1 --2- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4b5404d5d0 0x7f4b5404fa90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4b68001be0 tx=0x7f4b6c0aa580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.331 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.324+0000 7f4b712ba700 1 --2- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4b5404d5d0 0x7f4b5404fa90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4b68001be0 tx=0x7f4b6c0aa580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.331 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.324+0000 7f4b712ba700 1 --2- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4b5404d5d0 0x7f4b5404fa90 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f4b68001be0 tx=0x7f4b6c0aa580).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:26.331 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.328+0000 7f4b71abb700 1 --2- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b6c131dd0 0x7f4b6c132260 secure :-1 s=THROTTLE_DONE pgs=138 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b64010350).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.332 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.328+0000 7f4b627fc700 1 -- 172.21.15.42:0/4213200478 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f4b6405edb0 con 0x7f4b6c131dd0 2020-04-02T23:39:26.610 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.607+0000 7f4b7351e700 1 -- 172.21.15.42:0/4213200478 --> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b6c134820 con 0x7f4b5404d5d0 2020-04-02T23:39:26.614 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.611+0000 7f4b712ba700 1 --2- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4b5404d5d0 0x7f4b5404fa90 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f4b68001be0 tx=0x7f4b6c0aa580).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.614 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.611+0000 7f4b627fc700 1 -- 172.21.15.42:0/4213200478 <== mgr.4100 v2:172.21.15.84:6800/23437 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4b6c134820 con 0x7f4b5404d5d0 2020-04-02T23:39:26.632 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.629+0000 7f4b7351e700 1 -- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4b5404d5d0 msgr2=0x7f4b5404fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:26.632 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.630+0000 7f4b7351e700 1 --2- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4b5404d5d0 0x7f4b5404fa90 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f4b68001be0 tx=0x7f4b6c0aa580).stop 2020-04-02T23:39:26.633 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.631+0000 7f4b7351e700 1 -- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b6c131dd0 msgr2=0x7f4b6c132260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:26.634 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.631+0000 7f4b7351e700 1 --2- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b6c131dd0 0x7f4b6c132260 secure :-1 s=READY pgs=138 cs=0 l=1 rx=0x7f4b500054a0 tx=0x7f4b64010350).stop 2020-04-02T23:39:26.639 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.636+0000 7f4b7351e700 1 -- 172.21.15.42:0/4213200478 shutdown_connections 2020-04-02T23:39:26.639 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.636+0000 7f4b7351e700 1 --2- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b6c131dd0 0x7f4b6c132260 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:26.639 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.636+0000 7f4b7351e700 1 --2- 172.21.15.42:0/4213200478 >> v2:172.21.15.42:3300/0 conn(0x7f4b50004db0 0x7f4b6c134b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:26.639 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.636+0000 7f4b7351e700 1 --2- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4b5404d5d0 0x7f4b5404fa90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:26.640 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.636+0000 7f4b7351e700 1 --2- 172.21.15.42:0/4213200478 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4b6c138370 0x7f4b6c135490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:26.640 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.636+0000 7f4b7351e700 1 -- 172.21.15.42:0/4213200478 >> 172.21.15.42:0/4213200478 conn(0x7f4b6c0aedc0 msgr2=0x7f4b6c069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:26.640 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.636+0000 7f4b7351e700 1 -- 172.21.15.42:0/4213200478 shutdown_connections 2020-04-02T23:39:26.640 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.636+0000 7f4b7351e700 1 -- 172.21.15.42:0/4213200478 wait complete. 2020-04-02T23:39:26.643 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 5 to deep-scrub 2020-04-02T23:39:26.657 INFO:tasks.ceph:Scrubbing osd.6 2020-04-02T23:39:26.657 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:26.712 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 config set osd_debug_deep_scrub_sleep 0 2020-04-02T23:39:26.960 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.955+0000 7fa161b6e700 1 Processor -- start 2020-04-02T23:39:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.974+0000 7fa161b6e700 1 -- start start 2020-04-02T23:39:26.978 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.975+0000 7fa161b6e700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa15c0a7170 0x7fa15c140210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:26.978 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.975+0000 7fa161b6e700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa15c140670 0x7fa15c142a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:26.979 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.975+0000 7fa161b6e700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15c066d80 con 0x7fa15c065ab0 2020-04-02T23:39:26.979 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.975+0000 7fa161b6e700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15c0a78f0 con 0x7fa15c140670 2020-04-02T23:39:26.979 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.975+0000 7fa161b6e700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15c0a6300 con 0x7fa15c0a7170 2020-04-02T23:39:26.979 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.975+0000 7fa15affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa15c0a7170 0x7fa15c140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:26.979 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.975+0000 7fa15affd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa15c0a7170 0x7fa15c140210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.42:35122/0 (socket says 172.21.15.42:35122) 2020-04-02T23:39:26.979 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.975+0000 7fa15affd700 1 -- 172.21.15.42:0/3191007161 learned_addr learned my addr 172.21.15.42:0/3191007161 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:39:26.980 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.976+0000 7fa15affd700 1 -- 172.21.15.42:0/3191007161 >> v2:172.21.15.42:3300/0 conn(0x7fa15c140670 msgr2=0x7fa15c142a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:26.981 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.975+0000 7fa15bfff700 1 --2- 172.21.15.42:0/3191007161 >> v2:172.21.15.42:3300/0 conn(0x7fa15c140670 0x7fa15c142a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:26.981 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.979+0000 7fa15affd700 1 --2- 172.21.15.42:0/3191007161 >> v2:172.21.15.42:3300/0 conn(0x7fa15c140670 0x7fa15c142a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:26.981 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.979+0000 7fa15affd700 1 -- 172.21.15.42:0/3191007161 >> v1:172.21.15.42:6789/0 conn(0x7fa15c065ab0 legacy=0x7fa15c0a67a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:39:26.982 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.979+0000 7fa15affd700 1 -- 172.21.15.42:0/3191007161 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15c0a7b90 con 0x7fa15c0a7170 2020-04-02T23:39:26.982 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.979+0000 7fa15affd700 1 --2- 172.21.15.42:0/3191007161 >> v2:172.21.15.84:3300/0 conn(0x7fa15c0a7170 0x7fa15c140210 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa14c002f30 tx=0x7fa14c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.982 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.979+0000 7fa15affd700 1 --2- 172.21.15.42:0/3191007161 >> v2:172.21.15.84:3300/0 conn(0x7fa15c0a7170 0x7fa15c140210 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa14c002f30 tx=0x7fa14c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.982 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.979+0000 7fa15affd700 1 --2- 172.21.15.42:0/3191007161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa15c0a7170 0x7fa15c140210 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7fa14c002f30 tx=0x7fa14c007a40).ready entity=mon.1 client_cookie=6e65b98e775d482d server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:26.983 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.980+0000 7fa15bfff700 1 --2- 172.21.15.42:0/3191007161 >> v2:172.21.15.42:3300/0 conn(0x7fa15c140670 0x7fa15c142a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:39:26.983 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.980+0000 7fa15affd700 1 --2- 172.21.15.42:0/3191007161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa15c0a7170 0x7fa15c140210 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7fa14c002f30 tx=0x7fa14c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.983 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.980+0000 7fa15affd700 1 --2- 172.21.15.42:0/3191007161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa15c0a7170 0x7fa15c140210 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7fa14c002f30 tx=0x7fa14c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.984 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.980+0000 7fa15affd700 1 --2- 172.21.15.42:0/3191007161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa15c0a7170 0x7fa15c140210 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7fa14c002f30 tx=0x7fa14c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.984 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.980+0000 7fa15a7fc700 1 -- 172.21.15.42:0/3191007161 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14c008e20 con 0x7fa15c0a7170 2020-04-02T23:39:26.984 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.980+0000 7fa15a7fc700 1 -- 172.21.15.42:0/3191007161 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c011910 con 0x7fa15c0a7170 2020-04-02T23:39:26.984 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.980+0000 7fa15a7fc700 1 -- 172.21.15.42:0/3191007161 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14c011cf0 con 0x7fa15c0a7170 2020-04-02T23:39:26.984 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.980+0000 7fa161b6e700 1 -- 172.21.15.42:0/3191007161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa15c0a7170 msgr2=0x7fa15c140210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:26.984 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.980+0000 7fa161b6e700 1 --2- 172.21.15.42:0/3191007161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa15c0a7170 0x7fa15c140210 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7fa14c002f30 tx=0x7fa14c007a40).stop 2020-04-02T23:39:26.985 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.981+0000 7fa161b6e700 1 -- 172.21.15.42:0/3191007161 shutdown_connections 2020-04-02T23:39:26.985 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.981+0000 7fa161b6e700 1 --2- 172.21.15.42:0/3191007161 >> v2:172.21.15.42:3300/0 conn(0x7fa15c140670 0x7fa15c142a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:26.985 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.981+0000 7fa161b6e700 1 --2- 172.21.15.42:0/3191007161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa15c0a7170 0x7fa15c140210 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:26.985 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.981+0000 7fa161b6e700 1 -- 172.21.15.42:0/3191007161 >> 172.21.15.42:0/3191007161 conn(0x7fa15c05ac50 msgr2=0x7fa15c05b060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:26.986 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.981+0000 7fa161b6e700 1 -- 172.21.15.42:0/3191007161 shutdown_connections 2020-04-02T23:39:26.986 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.981+0000 7fa161b6e700 1 -- 172.21.15.42:0/3191007161 wait complete. 2020-04-02T23:39:26.986 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.983+0000 7fa161b6e700 1 Processor -- start 2020-04-02T23:39:26.987 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.984+0000 7fa161b6e700 1 -- start start 2020-04-02T23:39:26.989 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.986+0000 7fa161b6e700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c140670 0x7fa15c09bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:26.989 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.986+0000 7fa161b6e700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15c09d4d0 con 0x7fa15c065ab0 2020-04-02T23:39:26.989 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.986+0000 7fa161b6e700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15c09d770 con 0x7fa15c0a7170 2020-04-02T23:39:26.989 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.986+0000 7fa161b6e700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c13ec30 con 0x7fa15c140670 2020-04-02T23:39:26.992 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.989+0000 7fa15bfff700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c140670 0x7fa15c09bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:26.992 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.989+0000 7fa15affd700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa15c0a7170 0x7fa15c13c860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:54442/0 (socket says 172.21.15.42:54442) 2020-04-02T23:39:26.992 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.989+0000 7fa15affd700 1 -- 172.21.15.42:0/1556552013 learned_addr learned my addr 172.21.15.42:0/1556552013 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:26.993 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.990+0000 7fa15bfff700 1 -- 172.21.15.42:0/1556552013 >> v1:172.21.15.84:6789/0 conn(0x7fa15c0a7170 legacy=0x7fa15c13c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:26.993 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.990+0000 7fa15bfff700 1 -- 172.21.15.42:0/1556552013 >> v1:172.21.15.42:6789/0 conn(0x7fa15c065ab0 legacy=0x7fa15c13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:26.993 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.990+0000 7fa15bfff700 1 -- 172.21.15.42:0/1556552013 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15c13cf70 con 0x7fa15c140670 2020-04-02T23:39:26.993 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.990+0000 7fa15bfff700 1 --2- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c140670 0x7fa15c09bf10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa150000fe0 tx=0x7fa154010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.994 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.990+0000 7fa15bfff700 1 --2- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c140670 0x7fa15c09bf10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa150000fe0 tx=0x7fa154010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.994 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.990+0000 7fa15bfff700 1 --2- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c140670 0x7fa15c09bf10 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fa150000fe0 tx=0x7fa154010db0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:26.996 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.993+0000 7fa15bfff700 1 --2- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c140670 0x7fa15c09bf10 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fa150000fe0 tx=0x7fa154010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.997 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.993+0000 7fa15bfff700 1 --2- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c140670 0x7fa15c09bf10 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fa150000fe0 tx=0x7fa154010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.997 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.993+0000 7fa15bfff700 1 --2- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c140670 0x7fa15c09bf10 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fa150000fe0 tx=0x7fa154010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:26.998 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.995+0000 7fa158ff9700 1 -- 172.21.15.42:0/1556552013 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa154012b60 con 0x7fa15c140670 2020-04-02T23:39:26.998 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.995+0000 7fa158ff9700 1 -- 172.21.15.42:0/1556552013 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa154012cc0 con 0x7fa15c140670 2020-04-02T23:39:26.998 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.995+0000 7fa158ff9700 1 -- 172.21.15.42:0/1556552013 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa154012e70 con 0x7fa15c140670 2020-04-02T23:39:26.998 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.995+0000 7fa161b6e700 1 -- 172.21.15.42:0/1556552013 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15c0a3950 con 0x7fa15c140670 2020-04-02T23:39:26.998 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.995+0000 7fa161b6e700 1 -- 172.21.15.42:0/1556552013 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15c0a34a0 con 0x7fa15c140670 2020-04-02T23:39:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.996+0000 7fa161b6e700 1 -- 172.21.15.42:0/1556552013 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa138003580 con 0x7fa15c140670 2020-04-02T23:39:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.996+0000 7fa15bfff700 1 --2- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c140670 0x7fa15c09bf10 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fa150000fe0 tx=0x7fa154010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.997+0000 7fa15bfff700 1 --2- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c140670 0x7fa15c09bf10 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fa150000fe0 tx=0x7fa154010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.997+0000 7fa15bfff700 1 --2- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c140670 0x7fa15c09bf10 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fa150000fe0 tx=0x7fa154010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.997+0000 7fa158ff9700 1 -- 172.21.15.42:0/1556552013 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa154005a40 con 0x7fa15c140670 2020-04-02T23:39:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.998+0000 7fa158ff9700 1 --2- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa14804d5c0 0x7fa14804fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.998+0000 7fa158ff9700 1 -- 172.21.15.42:0/1556552013 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa154061160 con 0x7fa15c140670 2020-04-02T23:39:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.998+0000 7fa158ff9700 1 --2- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:6818/24319,v1:172.21.15.84:6819/24319] conn(0x7fa148054960 0x7fa148056d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.998+0000 7fa158ff9700 1 -- 172.21.15.42:0/1556552013 --> [v2:172.21.15.84:6818/24319,v1:172.21.15.84:6819/24319] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa148057340 con 0x7fa148054960 2020-04-02T23:39:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.998+0000 7fa158ff9700 1 -- 172.21.15.42:0/1556552013 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1540625b0 con 0x7fa15c140670 2020-04-02T23:39:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.998+0000 7fa15b7fe700 1 --2- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa14804d5c0 0x7fa14804fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.999+0000 7fa15b7fe700 1 --2- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa14804d5c0 0x7fa14804fa80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa150000f60 tx=0x7fa150007b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.999+0000 7fa15b7fe700 1 --2- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa14804d5c0 0x7fa14804fa80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa150000f60 tx=0x7fa150007b70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.999+0000 7fa15b7fe700 1 --2- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa14804d5c0 0x7fa14804fa80 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7fa150000f60 tx=0x7fa150007b70).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:27.003 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:26.999+0000 7fa15affd700 1 --2- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:6818/24319,v1:172.21.15.84:6819/24319] conn(0x7fa148054960 0x7fa148056d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:27.003 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.000+0000 7fa15affd700 1 --2- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:6818/24319,v1:172.21.15.84:6819/24319] conn(0x7fa148054960 0x7fa148056d80 crc :-1 s=READY pgs=9 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:27.008 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.003+0000 7fa158ff9700 1 -- 172.21.15.42:0/1556552013 <== osd.6 v2:172.21.15.84:6818/24319 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fa148057340 con 0x7fa148054960 2020-04-02T23:39:27.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.040+0000 7fa161b6e700 1 -- 172.21.15.42:0/1556552013 --> [v2:172.21.15.84:6818/24319,v1:172.21.15.84:6819/24319] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa1380026e0 con 0x7fa148054960 2020-04-02T23:39:27.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.041+0000 7fa158ff9700 1 -- 172.21.15.42:0/1556552013 <== osd.6 v2:172.21.15.84:6818/24319 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa1380026e0 con 0x7fa148054960 2020-04-02T23:39:27.044 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2020-04-02T23:39:27.044 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-04-02T23:39:27.044 INFO:teuthology.orchestra.run.smithi042.stdout:} 2020-04-02T23:39:27.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.042+0000 7fa161b6e700 1 -- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:6818/24319,v1:172.21.15.84:6819/24319] conn(0x7fa148054960 msgr2=0x7fa148056d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:27.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.042+0000 7fa161b6e700 1 --2- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:6818/24319,v1:172.21.15.84:6819/24319] conn(0x7fa148054960 0x7fa148056d80 crc :-1 s=READY pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:27.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.043+0000 7fa161b6e700 1 -- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa14804d5c0 msgr2=0x7fa14804fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:27.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.043+0000 7fa161b6e700 1 --2- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa14804d5c0 0x7fa14804fa80 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7fa150000f60 tx=0x7fa150007b70).stop 2020-04-02T23:39:27.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.043+0000 7fa161b6e700 1 -- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c140670 msgr2=0x7fa15c09bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:27.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.043+0000 7fa161b6e700 1 --2- 172.21.15.42:0/1556552013 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c140670 0x7fa15c09bf10 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fa150000fe0 tx=0x7fa154010db0).stop 2020-04-02T23:39:27.047 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.043+0000 7fa15bfff700 1 -- 172.21.15.42:0/1556552013 reap_dead start 2020-04-02T23:39:27.047 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.044+0000 7fa161b6e700 1 -- 172.21.15.42:0/1556552013 shutdown_connections 2020-04-02T23:39:27.047 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.044+0000 7fa161b6e700 1 -- 172.21.15.42:0/1556552013 >> 172.21.15.42:0/1556552013 conn(0x7fa15c05ac50 msgr2=0x7fa15c069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:27.053 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.051+0000 7fa161b6e700 1 -- 172.21.15.42:0/1556552013 shutdown_connections 2020-04-02T23:39:27.055 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.053+0000 7fa161b6e700 1 -- 172.21.15.42:0/1556552013 wait complete. 2020-04-02T23:39:27.074 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:27.143 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 6 2020-04-02T23:39:27.378 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.375+0000 7ffa517a1700 1 Processor -- start 2020-04-02T23:39:27.387 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.385+0000 7ffa517a1700 1 -- start start 2020-04-02T23:39:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.386+0000 7ffa517a1700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffa4c066060 0x7ffa4c0aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.386+0000 7ffa517a1700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4c0a8930 con 0x7ffa4c0a8d60 2020-04-02T23:39:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.386+0000 7ffa517a1700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4c13c8d0 con 0x7ffa4c13bda0 2020-04-02T23:39:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.386+0000 7ffa517a1700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa4c05c520 con 0x7ffa4c066060 2020-04-02T23:39:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.386+0000 7ffa43fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ffa4c0a8d60 0x7ffa4c0a5fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60072/0 (socket says 172.21.15.42:60072) 2020-04-02T23:39:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.386+0000 7ffa43fff700 1 -- 172.21.15.42:0/2242054806 learned_addr learned my addr 172.21.15.42:0/2242054806 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:27.392 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.386+0000 7ffa4b7fe700 1 -- 172.21.15.42:0/2242054806 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312516368 0 0) 0x7ffa4c0a8930 con 0x7ffa4c0a8d60 2020-04-02T23:39:27.392 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.386+0000 7ffa4b7fe700 1 -- 172.21.15.42:0/2242054806 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa2c003230 con 0x7ffa4c0a8d60 2020-04-02T23:39:27.392 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.386+0000 7ffa4b7fe700 1 -- 172.21.15.42:0/2242054806 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673691749 0 0) 0x7ffa4c13c8d0 con 0x7ffa4c13bda0 2020-04-02T23:39:27.392 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.387+0000 7ffa4b7fe700 1 -- 172.21.15.42:0/2242054806 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa4c0a8930 con 0x7ffa4c13bda0 2020-04-02T23:39:27.393 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.387+0000 7ffa4b7fe700 1 -- 172.21.15.42:0/2242054806 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1053421678 0 0) 0x7ffa2c003230 con 0x7ffa4c0a8d60 2020-04-02T23:39:27.393 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.387+0000 7ffa4b7fe700 1 -- 172.21.15.42:0/2242054806 >> v2:172.21.15.84:3300/0 conn(0x7ffa4c066060 msgr2=0x7ffa4c0aa3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:39:27.393 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.387+0000 7ffa4b7fe700 1 --2- 172.21.15.42:0/2242054806 >> v2:172.21.15.84:3300/0 conn(0x7ffa4c066060 0x7ffa4c0aa3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:27.393 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.387+0000 7ffa4b7fe700 1 -- 172.21.15.42:0/2242054806 >> v1:172.21.15.84:6789/0 conn(0x7ffa4c13bda0 legacy=0x7ffa4c13c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:27.393 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.387+0000 7ffa4b7fe700 1 -- 172.21.15.42:0/2242054806 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c05b1a0 con 0x7ffa4c0a8d60 2020-04-02T23:39:27.393 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.387+0000 7ffa4b7fe700 1 -- 172.21.15.42:0/2242054806 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 203932918 0 0) 0x7ffa340016d0 con 0x7ffa4c0a8d60 2020-04-02T23:39:27.394 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.387+0000 7ffa4b7fe700 1 -- 172.21.15.42:0/2242054806 >> v1:172.21.15.42:6789/0 conn(0x7ffa4c0a8d60 legacy=0x7ffa4c0a5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:27.394 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.387+0000 7ffa4b7fe700 1 --2- 172.21.15.42:0/2242054806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa2c0038b0 0x7ffa2c003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:27.394 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.387+0000 7ffa4b7fe700 1 --2- 172.21.15.42:0/2242054806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c0044d0 0x7ffa2c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:27.394 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.387+0000 7ffa4b7fe700 1 --2- 172.21.15.42:0/2242054806 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffa2c004db0 0x7ffa2c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:27.394 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.387+0000 7ffa4b7fe700 1 -- 172.21.15.42:0/2242054806 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c05c520 con 0x7ffa2c0044d0 2020-04-02T23:39:27.394 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.387+0000 7ffa4b7fe700 1 -- 172.21.15.42:0/2242054806 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c0053a0 con 0x7ffa2c0038b0 2020-04-02T23:39:27.394 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.387+0000 7ffa4b7fe700 1 -- 172.21.15.42:0/2242054806 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c00bc00 con 0x7ffa2c004db0 2020-04-02T23:39:27.395 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.387+0000 7ffa50fa0700 1 --2- 172.21.15.42:0/2242054806 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffa2c004db0 0x7ffa2c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:27.395 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.387+0000 7ffa43fff700 1 --2- 172.21.15.42:0/2242054806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c0044d0 0x7ffa2c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:27.395 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.388+0000 7ffa43fff700 1 -- 172.21.15.42:0/2242054806 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffa2c004db0 msgr2=0x7ffa2c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:27.395 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.388+0000 7ffa43fff700 1 --2- 172.21.15.42:0/2242054806 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffa2c004db0 0x7ffa2c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:27.395 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.388+0000 7ffa43fff700 1 -- 172.21.15.42:0/2242054806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa2c0038b0 msgr2=0x7ffa2c003cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:39:27.395 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.388+0000 7ffa43fff700 1 --2- 172.21.15.42:0/2242054806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa2c0038b0 0x7ffa2c003cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:27.395 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.388+0000 7ffa43fff700 1 -- 172.21.15.42:0/2242054806 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2c003230 con 0x7ffa2c0044d0 2020-04-02T23:39:27.396 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.388+0000 7ffa43fff700 1 --2- 172.21.15.42:0/2242054806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c0044d0 0x7ffa2c004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffa340014a0 tx=0x7ffa34001c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.396 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.388+0000 7ffa43fff700 1 --2- 172.21.15.42:0/2242054806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c0044d0 0x7ffa2c004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffa340014a0 tx=0x7ffa34001c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.396 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.388+0000 7ffa50fa0700 1 -- 172.21.15.42:0/2242054806 reap_dead start 2020-04-02T23:39:27.396 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.388+0000 7ffa43fff700 1 --2- 172.21.15.42:0/2242054806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c0044d0 0x7ffa2c004950 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7ffa340014a0 tx=0x7ffa34001c80).ready entity=mon.0 client_cookie=aeb44e7e444bead0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:27.396 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.391+0000 7ffa43fff700 1 --2- 172.21.15.42:0/2242054806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c0044d0 0x7ffa2c004950 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7ffa340014a0 tx=0x7ffa34001c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.397 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.391+0000 7ffa43fff700 1 --2- 172.21.15.42:0/2242054806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c0044d0 0x7ffa2c004950 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7ffa340014a0 tx=0x7ffa34001c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.397 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.391+0000 7ffa4b7fe700 1 -- 172.21.15.42:0/2242054806 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa3400e160 con 0x7ffa2c0044d0 2020-04-02T23:39:27.397 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.391+0000 7ffa43fff700 1 --2- 172.21.15.42:0/2242054806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c0044d0 0x7ffa2c004950 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7ffa340014a0 tx=0x7ffa34001c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.397 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.391+0000 7ffa4b7fe700 1 -- 172.21.15.42:0/2242054806 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3400e2c0 con 0x7ffa2c0044d0 2020-04-02T23:39:27.397 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.391+0000 7ffa4b7fe700 1 -- 172.21.15.42:0/2242054806 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa340100b0 con 0x7ffa2c0044d0 2020-04-02T23:39:27.398 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.394+0000 7ffa517a1700 1 -- 172.21.15.42:0/2242054806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c0044d0 msgr2=0x7ffa2c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:27.398 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.394+0000 7ffa517a1700 1 --2- 172.21.15.42:0/2242054806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c0044d0 0x7ffa2c004950 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7ffa340014a0 tx=0x7ffa34001c80).stop 2020-04-02T23:39:27.399 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.395+0000 7ffa517a1700 1 -- 172.21.15.42:0/2242054806 shutdown_connections 2020-04-02T23:39:27.399 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.395+0000 7ffa517a1700 1 --2- 172.21.15.42:0/2242054806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa2c0044d0 0x7ffa2c004950 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:27.399 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.395+0000 7ffa517a1700 1 -- 172.21.15.42:0/2242054806 >> 172.21.15.42:0/2242054806 conn(0x7ffa4c0607c0 msgr2=0x7ffa4c0655d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:27.399 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.396+0000 7ffa517a1700 1 -- 172.21.15.42:0/2242054806 shutdown_connections 2020-04-02T23:39:27.399 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.396+0000 7ffa517a1700 1 -- 172.21.15.42:0/2242054806 wait complete. 2020-04-02T23:39:27.400 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.397+0000 7ffa517a1700 1 Processor -- start 2020-04-02T23:39:27.400 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.397+0000 7ffa517a1700 1 -- start start 2020-04-02T23:39:27.401 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.398+0000 7ffa517a1700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ffa2c0044d0 0x7ffa4c132e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:27.401 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.398+0000 7ffa517a1700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffa4c0a3d40 0x7ffa4c1332f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:27.402 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.398+0000 7ffa517a1700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4c0a2ef0 con 0x7ffa4c0aeec0 2020-04-02T23:39:27.402 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.398+0000 7ffa517a1700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa4c136a90 con 0x7ffa2c0044d0 2020-04-02T23:39:27.403 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.398+0000 7ffa517a1700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c0ae6a0 con 0x7ffa4c0a3d40 2020-04-02T23:39:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.399+0000 7ffa50fa0700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffa4c0a3d40 0x7ffa4c1332f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.399+0000 7ffa50fa0700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffa4c0a3d40 0x7ffa4c1332f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.42:60408/0 (socket says 172.21.15.42:60408) 2020-04-02T23:39:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.399+0000 7ffa50fa0700 1 -- 172.21.15.42:0/115454162 learned_addr learned my addr 172.21.15.42:0/115454162 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:39:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.400+0000 7ffa50fa0700 1 -- 172.21.15.42:0/115454162 >> v2:172.21.15.42:3300/0 conn(0x7ffa2c0044d0 msgr2=0x7ffa4c132e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-04-02T23:39:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.400+0000 7ffa50fa0700 1 --2- 172.21.15.42:0/115454162 >> v2:172.21.15.42:3300/0 conn(0x7ffa2c0044d0 0x7ffa4c132e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.400+0000 7ffa50fa0700 1 -- 172.21.15.42:0/115454162 >> v1:172.21.15.42:6789/0 conn(0x7ffa4c0aeec0 legacy=0x7ffa4c0a3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.400+0000 7ffa50fa0700 1 -- 172.21.15.42:0/115454162 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c0a9750 con 0x7ffa4c0a3d40 2020-04-02T23:39:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.400+0000 7ffa50fa0700 1 --2- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffa4c0a3d40 0x7ffa4c1332f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffa4c135c00 tx=0x7ffa44010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.406 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.400+0000 7ffa50fa0700 1 --2- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffa4c0a3d40 0x7ffa4c1332f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffa4c135c00 tx=0x7ffa44010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.406 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.400+0000 7ffa50fa0700 1 --2- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffa4c0a3d40 0x7ffa4c1332f0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7ffa4c135c00 tx=0x7ffa44010f20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:27.406 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.400+0000 7ffa50fa0700 1 --2- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffa4c0a3d40 0x7ffa4c1332f0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7ffa4c135c00 tx=0x7ffa44010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.406 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.400+0000 7ffa50fa0700 1 --2- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffa4c0a3d40 0x7ffa4c1332f0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7ffa4c135c00 tx=0x7ffa44010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.406 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.400+0000 7ffa50fa0700 1 --2- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffa4c0a3d40 0x7ffa4c1332f0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7ffa4c135c00 tx=0x7ffa44010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.406 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.402+0000 7ffa49ffb700 1 -- 172.21.15.42:0/115454162 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa44003540 con 0x7ffa4c0a3d40 2020-04-02T23:39:27.410 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.407+0000 7ffa49ffb700 1 -- 172.21.15.42:0/115454162 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa440036a0 con 0x7ffa4c0a3d40 2020-04-02T23:39:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.407+0000 7ffa517a1700 1 -- 172.21.15.42:0/115454162 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa4c0a9240 con 0x7ffa4c0a3d40 2020-04-02T23:39:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.408+0000 7ffa49ffb700 1 -- 172.21.15.42:0/115454162 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa44003a00 con 0x7ffa4c0a3d40 2020-04-02T23:39:27.411 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.408+0000 7ffa517a1700 1 -- 172.21.15.42:0/115454162 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4c0af890 con 0x7ffa4c0a3d40 2020-04-02T23:39:27.412 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.408+0000 7ffa50fa0700 1 --2- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffa4c0a3d40 0x7ffa4c1332f0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7ffa4c135c00 tx=0x7ffa44010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.412 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.409+0000 7ffa49ffb700 1 -- 172.21.15.42:0/115454162 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ffa44003b60 con 0x7ffa4c0a3d40 2020-04-02T23:39:27.412 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.409+0000 7ffa50fa0700 1 --2- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffa4c0a3d40 0x7ffa4c1332f0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7ffa4c135c00 tx=0x7ffa44010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.413 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.409+0000 7ffa49ffb700 1 --2- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ffa3004d5f0 0x7ffa3004fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:27.413 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.409+0000 7ffa49ffb700 1 -- 172.21.15.42:0/115454162 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ffa440609c0 con 0x7ffa4c0a3d40 2020-04-02T23:39:27.413 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.409+0000 7ffa517a1700 1 -- 172.21.15.42:0/115454162 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa4c0ae8a0 con 0x7ffa4c0a3d40 2020-04-02T23:39:27.414 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.409+0000 7ffa4bfff700 1 --2- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ffa3004d5f0 0x7ffa3004fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:27.414 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.410+0000 7ffa4bfff700 1 --2- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ffa3004d5f0 0x7ffa3004fab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffa3c002f10 tx=0x7ffa3c007880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.414 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.410+0000 7ffa4bfff700 1 --2- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ffa3004d5f0 0x7ffa3004fab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffa3c002f10 tx=0x7ffa3c007880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.414 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.410+0000 7ffa4bfff700 1 --2- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ffa3004d5f0 0x7ffa3004fab0 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7ffa3c002f10 tx=0x7ffa3c007880).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:27.419 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.416+0000 7ffa50fa0700 1 --2- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffa4c0a3d40 0x7ffa4c1332f0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7ffa4c135c00 tx=0x7ffa44010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.421 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.419+0000 7ffa49ffb700 1 -- 172.21.15.42:0/115454162 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7ffa4403c0c0 con 0x7ffa4c0a3d40 2020-04-02T23:39:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.727+0000 7ffa517a1700 1 -- 172.21.15.42:0/115454162 --> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa4c056c50 con 0x7ffa3004d5f0 2020-04-02T23:39:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.727+0000 7ffa4bfff700 1 --2- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ffa3004d5f0 0x7ffa3004fab0 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7ffa3c002f10 tx=0x7ffa3c007880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.727+0000 7ffa49ffb700 1 -- 172.21.15.42:0/115454162 <== mgr.4100 v2:172.21.15.84:6800/23437 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ffa4c056c50 con 0x7ffa3004d5f0 2020-04-02T23:39:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.731+0000 7ffa517a1700 1 -- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ffa3004d5f0 msgr2=0x7ffa3004fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.731+0000 7ffa517a1700 1 --2- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ffa3004d5f0 0x7ffa3004fab0 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7ffa3c002f10 tx=0x7ffa3c007880).stop 2020-04-02T23:39:27.738 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.731+0000 7ffa517a1700 1 -- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffa4c0a3d40 msgr2=0x7ffa4c1332f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.731+0000 7ffa517a1700 1 --2- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffa4c0a3d40 0x7ffa4c1332f0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7ffa4c135c00 tx=0x7ffa44010f20).stop 2020-04-02T23:39:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.731+0000 7ffa517a1700 1 -- 172.21.15.42:0/115454162 shutdown_connections 2020-04-02T23:39:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.731+0000 7ffa517a1700 1 --2- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ffa3004d5f0 0x7ffa3004fab0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.731+0000 7ffa517a1700 1 --2- 172.21.15.42:0/115454162 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ffa4c0a3d40 0x7ffa4c1332f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.731+0000 7ffa517a1700 1 --2- 172.21.15.42:0/115454162 >> v2:172.21.15.42:3300/0 conn(0x7ffa2c0044d0 0x7ffa4c132e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:27.739 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.731+0000 7ffa517a1700 1 -- 172.21.15.42:0/115454162 >> 172.21.15.42:0/115454162 conn(0x7ffa4c0607c0 msgr2=0x7ffa4c069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:27.747 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.739+0000 7ffa517a1700 1 -- 172.21.15.42:0/115454162 shutdown_connections 2020-04-02T23:39:27.747 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:27.739+0000 7ffa517a1700 1 -- 172.21.15.42:0/115454162 wait complete. 2020-04-02T23:39:27.747 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 6 to deep-scrub 2020-04-02T23:39:27.780 INFO:tasks.ceph:Scrubbing osd.7 2020-04-02T23:39:27.780 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:27.866 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 config set osd_debug_deep_scrub_sleep 0 2020-04-02T23:39:28.110 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.105+0000 7fa1608d9700 1 Processor -- start 2020-04-02T23:39:28.110 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.105+0000 7fa1608d9700 1 -- start start 2020-04-02T23:39:28.111 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.106+0000 7fa1608d9700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c0aa1a0 0x7fa15c138720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:28.111 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.106+0000 7fa1608d9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa15c138b80 0x7fa15c05c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:28.111 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.106+0000 7fa1608d9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15c05c960 con 0x7fa15c05c4f0 2020-04-02T23:39:28.111 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.106+0000 7fa1608d9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15c0aacd0 con 0x7fa15c138b80 2020-04-02T23:39:28.111 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.106+0000 7fa1608d9700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c0a2980 con 0x7fa15c0aa1a0 2020-04-02T23:39:28.111 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.106+0000 7fa15a59c700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c0aa1a0 0x7fa15c138720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:28.111 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.106+0000 7fa159d9b700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa15c138b80 0x7fa15c05c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:28.112 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.106+0000 7fa15a59c700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c0aa1a0 0x7fa15c138720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.42:60414/0 (socket says 172.21.15.42:60414) 2020-04-02T23:39:28.112 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.106+0000 7fa15a59c700 1 -- 172.21.15.42:0/2885889503 learned_addr learned my addr 172.21.15.42:0/2885889503 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:39:28.112 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.106+0000 7fa15ad9d700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa15c05c4f0 0x7fa15c09dc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:54468/0 (socket says 172.21.15.42:54468) 2020-04-02T23:39:28.112 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.106+0000 7fa159d9b700 1 --2- 172.21.15.42:0/2885889503 >> v2:172.21.15.84:3300/0 conn(0x7fa15c138b80 0x7fa15c05c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.42:35154/0 (socket says 172.21.15.42:35154) 2020-04-02T23:39:28.112 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.106+0000 7fa15959a700 1 -- 172.21.15.42:0/2885889503 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676733869 0 0) 0x7fa15c05c960 con 0x7fa15c05c4f0 2020-04-02T23:39:28.112 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.106+0000 7fa15959a700 1 -- 172.21.15.42:0/2885889503 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa140003230 con 0x7fa15c05c4f0 2020-04-02T23:39:28.120 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.106+0000 7fa15a59c700 1 -- 172.21.15.42:0/2885889503 >> v2:172.21.15.84:3300/0 conn(0x7fa15c138b80 msgr2=0x7fa15c05c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:28.120 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.106+0000 7fa15a59c700 1 --2- 172.21.15.42:0/2885889503 >> v2:172.21.15.84:3300/0 conn(0x7fa15c138b80 0x7fa15c05c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:28.120 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.106+0000 7fa15a59c700 1 -- 172.21.15.42:0/2885889503 >> v1:172.21.15.84:6789/0 conn(0x7fa15c05c4f0 legacy=0x7fa15c09dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:28.120 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.106+0000 7fa15a59c700 1 -- 172.21.15.42:0/2885889503 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15c13c100 con 0x7fa15c0aa1a0 2020-04-02T23:39:28.120 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.107+0000 7fa15a59c700 1 --2- 172.21.15.42:0/2885889503 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c0aa1a0 0x7fa15c138720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa154001450 tx=0x7fa14c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.121 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.107+0000 7fa15a59c700 1 --2- 172.21.15.42:0/2885889503 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c0aa1a0 0x7fa15c138720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa154001450 tx=0x7fa14c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.121 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.107+0000 7fa15a59c700 1 --2- 172.21.15.42:0/2885889503 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c0aa1a0 0x7fa15c138720 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7fa154001450 tx=0x7fa14c007a40).ready entity=mon.2 client_cookie=f33042d97e2c6af5 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:28.121 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.107+0000 7fa15a59c700 1 --2- 172.21.15.42:0/2885889503 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c0aa1a0 0x7fa15c138720 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fa154001450 tx=0x7fa14c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.121 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.107+0000 7fa15a59c700 1 --2- 172.21.15.42:0/2885889503 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c0aa1a0 0x7fa15c138720 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fa154001450 tx=0x7fa14c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.121 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.107+0000 7fa15a59c700 1 --2- 172.21.15.42:0/2885889503 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c0aa1a0 0x7fa15c138720 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fa154001450 tx=0x7fa14c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.121 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.107+0000 7fa15959a700 1 -- 172.21.15.42:0/2885889503 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14c008e20 con 0x7fa15c0aa1a0 2020-04-02T23:39:28.122 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.107+0000 7fa15959a700 1 -- 172.21.15.42:0/2885889503 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c011770 con 0x7fa15c0aa1a0 2020-04-02T23:39:28.122 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.107+0000 7fa15959a700 1 -- 172.21.15.42:0/2885889503 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14c011b90 con 0x7fa15c0aa1a0 2020-04-02T23:39:28.122 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.107+0000 7fa1608d9700 1 -- 172.21.15.42:0/2885889503 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c0aa1a0 msgr2=0x7fa15c138720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:28.122 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.107+0000 7fa1608d9700 1 --2- 172.21.15.42:0/2885889503 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c0aa1a0 0x7fa15c138720 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7fa154001450 tx=0x7fa14c007a40).stop 2020-04-02T23:39:28.122 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.116+0000 7fa1608d9700 1 -- 172.21.15.42:0/2885889503 shutdown_connections 2020-04-02T23:39:28.122 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.116+0000 7fa1608d9700 1 --2- 172.21.15.42:0/2885889503 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fa15c0aa1a0 0x7fa15c138720 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:28.123 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.117+0000 7fa1608d9700 1 --2- 172.21.15.42:0/2885889503 >> v2:172.21.15.84:3300/0 conn(0x7fa15c138b80 0x7fa15c05c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:28.123 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.117+0000 7fa1608d9700 1 -- 172.21.15.42:0/2885889503 >> 172.21.15.42:0/2885889503 conn(0x7fa15c0aedc0 msgr2=0x7fa15c0af1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:28.135 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.132+0000 7fa1608d9700 1 -- 172.21.15.42:0/2885889503 shutdown_connections 2020-04-02T23:39:28.135 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.132+0000 7fa1608d9700 1 -- 172.21.15.42:0/2885889503 wait complete. 2020-04-02T23:39:28.136 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.133+0000 7fa1608d9700 1 Processor -- start 2020-04-02T23:39:28.136 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.134+0000 7fa1608d9700 1 -- start start 2020-04-02T23:39:28.138 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.135+0000 7fa1608d9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa15c05c4f0 0x7fa15c134d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:28.138 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.135+0000 7fa1608d9700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa15c138b80 0x7fa15c132080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:28.138 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.135+0000 7fa1608d9700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15c0a2440 con 0x7fa15c0aa1a0 2020-04-02T23:39:28.138 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.135+0000 7fa1608d9700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15c134350 con 0x7fa15c138b80 2020-04-02T23:39:28.138 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.135+0000 7fa1608d9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15c133720 con 0x7fa15c05c4f0 2020-04-02T23:39:28.139 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.135+0000 7fa159d9b700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa15c0aa1a0 0x7fa15c135800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60094/0 (socket says 172.21.15.42:60094) 2020-04-02T23:39:28.139 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.135+0000 7fa15ad9d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa15c138b80 0x7fa15c132080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:28.139 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.135+0000 7fa159d9b700 1 -- 172.21.15.42:0/278417885 learned_addr learned my addr 172.21.15.42:0/278417885 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:28.139 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.135+0000 7fa15a59c700 1 --2- 172.21.15.42:0/278417885 >> v2:172.21.15.84:3300/0 conn(0x7fa15c05c4f0 0x7fa15c134d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:28.140 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.135+0000 7fa15a59c700 1 -- 172.21.15.42:0/278417885 >> v2:172.21.15.42:3300/0 conn(0x7fa15c138b80 msgr2=0x7fa15c132080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:28.140 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.135+0000 7fa15a59c700 1 --2- 172.21.15.42:0/278417885 >> v2:172.21.15.42:3300/0 conn(0x7fa15c138b80 0x7fa15c132080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:28.141 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.135+0000 7fa15a59c700 1 -- 172.21.15.42:0/278417885 >> v1:172.21.15.42:6789/0 conn(0x7fa15c0aa1a0 legacy=0x7fa15c135800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:28.141 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.135+0000 7fa15a59c700 1 -- 172.21.15.42:0/278417885 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15c1353b0 con 0x7fa15c05c4f0 2020-04-02T23:39:28.141 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.135+0000 7fa15ad9d700 1 --2- 172.21.15.42:0/278417885 >> v2:172.21.15.42:3300/0 conn(0x7fa15c138b80 0x7fa15c132080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:39:28.141 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.135+0000 7fa15a59c700 1 --2- 172.21.15.42:0/278417885 >> v2:172.21.15.84:3300/0 conn(0x7fa15c05c4f0 0x7fa15c134d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa150002f30 tx=0x7fa14c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.141 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.135+0000 7fa15a59c700 1 --2- 172.21.15.42:0/278417885 >> v2:172.21.15.84:3300/0 conn(0x7fa15c05c4f0 0x7fa15c134d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa150002f30 tx=0x7fa14c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.141 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.135+0000 7fa15a59c700 1 --2- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa15c05c4f0 0x7fa15c134d60 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7fa150002f30 tx=0x7fa14c007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:28.141 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.136+0000 7fa15a59c700 1 --2- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa15c05c4f0 0x7fa15c134d60 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fa150002f30 tx=0x7fa14c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.136+0000 7fa15a59c700 1 --2- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa15c05c4f0 0x7fa15c134d60 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fa150002f30 tx=0x7fa14c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.136+0000 7fa15a59c700 1 --2- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa15c05c4f0 0x7fa15c134d60 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fa150002f30 tx=0x7fa14c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.136+0000 7fa14b7fe700 1 -- 172.21.15.42:0/278417885 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14c011ea0 con 0x7fa15c05c4f0 2020-04-02T23:39:28.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.136+0000 7fa14b7fe700 1 -- 172.21.15.42:0/278417885 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c008e20 con 0x7fa15c05c4f0 2020-04-02T23:39:28.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.136+0000 7fa1608d9700 1 -- 172.21.15.42:0/278417885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15c1398d0 con 0x7fa15c05c4f0 2020-04-02T23:39:28.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.136+0000 7fa1608d9700 1 -- 172.21.15.42:0/278417885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15c0a9140 con 0x7fa15c05c4f0 2020-04-02T23:39:28.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.136+0000 7fa14b7fe700 1 -- 172.21.15.42:0/278417885 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14c0058b0 con 0x7fa15c05c4f0 2020-04-02T23:39:28.142 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.137+0000 7fa15a59c700 1 --2- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa15c05c4f0 0x7fa15c134d60 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fa150002f30 tx=0x7fa14c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.138+0000 7fa15a59c700 1 --2- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa15c05c4f0 0x7fa15c134d60 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fa150002f30 tx=0x7fa14c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.143 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.138+0000 7fa14b7fe700 1 -- 172.21.15.42:0/278417885 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fa14c005a10 con 0x7fa15c05c4f0 2020-04-02T23:39:28.144 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.138+0000 7fa1608d9700 1 -- 172.21.15.42:0/278417885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa15c135540 con 0x7fa15c05c4f0 2020-04-02T23:39:28.144 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.138+0000 7fa14b7fe700 1 --2- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa14004d970 0x7fa14004fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:28.144 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.138+0000 7fa14b7fe700 1 -- 172.21.15.42:0/278417885 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa14c061070 con 0x7fa15c05c4f0 2020-04-02T23:39:28.144 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.139+0000 7fa14b7fe700 1 --2- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:6826/24349,v1:172.21.15.84:6827/24349] conn(0x7fa140054c10 0x7fa140057030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:28.144 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.139+0000 7fa14b7fe700 1 -- 172.21.15.42:0/278417885 --> [v2:172.21.15.84:6826/24349,v1:172.21.15.84:6827/24349] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa1400575f0 con 0x7fa140054c10 2020-04-02T23:39:28.144 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.139+0000 7fa159d9b700 1 --2- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa14004d970 0x7fa14004fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:28.144 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.139+0000 7fa15ad9d700 1 --2- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:6826/24349,v1:172.21.15.84:6827/24349] conn(0x7fa140054c10 0x7fa140057030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:28.145 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.139+0000 7fa15a59c700 1 --2- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa15c05c4f0 0x7fa15c134d60 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fa150002f30 tx=0x7fa14c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.145 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.139+0000 7fa14b7fe700 1 -- 172.21.15.42:0/278417885 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa14c060e20 con 0x7fa15c05c4f0 2020-04-02T23:39:28.152 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.146+0000 7fa15ad9d700 1 --2- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:6826/24349,v1:172.21.15.84:6827/24349] conn(0x7fa140054c10 0x7fa140057030 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:28.153 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.147+0000 7fa14b7fe700 1 -- 172.21.15.42:0/278417885 <== osd.7 v2:172.21.15.84:6826/24349 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fa1400575f0 con 0x7fa140054c10 2020-04-02T23:39:28.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.150+0000 7fa159d9b700 1 --2- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa14004d970 0x7fa14004fe30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa150007fa0 tx=0x7fa1500081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.150+0000 7fa159d9b700 1 --2- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa14004d970 0x7fa14004fe30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa150007fa0 tx=0x7fa1500081e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.157 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.150+0000 7fa159d9b700 1 --2- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa14004d970 0x7fa14004fe30 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7fa150007fa0 tx=0x7fa1500081e0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:28.193 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.190+0000 7fa1608d9700 1 -- 172.21.15.42:0/278417885 --> [v2:172.21.15.84:6826/24349,v1:172.21.15.84:6827/24349] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa15c056c50 con 0x7fa140054c10 2020-04-02T23:39:28.193 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.190+0000 7fa14b7fe700 1 -- 172.21.15.42:0/278417885 <== osd.7 v2:172.21.15.84:6826/24349 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa15c056c50 con 0x7fa140054c10 2020-04-02T23:39:28.193 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2020-04-02T23:39:28.193 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-04-02T23:39:28.194 INFO:teuthology.orchestra.run.smithi042.stdout:} 2020-04-02T23:39:28.195 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.191+0000 7fa1608d9700 1 -- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:6826/24349,v1:172.21.15.84:6827/24349] conn(0x7fa140054c10 msgr2=0x7fa140057030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:28.195 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.191+0000 7fa1608d9700 1 --2- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:6826/24349,v1:172.21.15.84:6827/24349] conn(0x7fa140054c10 0x7fa140057030 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:28.195 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.191+0000 7fa1608d9700 1 -- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa14004d970 msgr2=0x7fa14004fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:28.195 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.191+0000 7fa1608d9700 1 --2- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fa14004d970 0x7fa14004fe30 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7fa150007fa0 tx=0x7fa1500081e0).stop 2020-04-02T23:39:28.195 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.191+0000 7fa1608d9700 1 -- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa15c05c4f0 msgr2=0x7fa15c134d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:28.195 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.191+0000 7fa1608d9700 1 --2- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa15c05c4f0 0x7fa15c134d60 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7fa150002f30 tx=0x7fa14c007a40).stop 2020-04-02T23:39:28.196 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.191+0000 7fa15ad9d700 1 -- 172.21.15.42:0/278417885 reap_dead start 2020-04-02T23:39:28.196 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.191+0000 7fa1608d9700 1 -- 172.21.15.42:0/278417885 shutdown_connections 2020-04-02T23:39:28.196 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.191+0000 7fa1608d9700 1 --2- 172.21.15.42:0/278417885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa15c05c4f0 0x7fa15c134d60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:28.196 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.191+0000 7fa1608d9700 1 -- 172.21.15.42:0/278417885 >> 172.21.15.42:0/278417885 conn(0x7fa15c0aedc0 msgr2=0x7fa15c065f20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:28.196 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.191+0000 7fa1608d9700 1 -- 172.21.15.42:0/278417885 shutdown_connections 2020-04-02T23:39:28.196 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.191+0000 7fa1608d9700 1 -- 172.21.15.42:0/278417885 wait complete. 2020-04-02T23:39:28.212 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:28.260 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 7 2020-04-02T23:39:28.537 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.534+0000 7fc8c1583700 1 Processor -- start 2020-04-02T23:39:28.541 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.538+0000 7fc8c1583700 1 -- start start 2020-04-02T23:39:28.541 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.538+0000 7fc8c1583700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc8bc0ad620 0x7fc8bc0a83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:28.541 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.538+0000 7fc8c1583700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8bc13ab30 con 0x7fc8bc0a69c0 2020-04-02T23:39:28.541 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.538+0000 7fc8c1583700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8bc0a8a40 con 0x7fc8bc0a6530 2020-04-02T23:39:28.542 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.538+0000 7fc8c1583700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8bc0a5af0 con 0x7fc8bc0ad620 2020-04-02T23:39:28.542 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.539+0000 7fc8bb7fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc8bc0a69c0 0x7fc8bc13a420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60104/0 (socket says 172.21.15.42:60104) 2020-04-02T23:39:28.542 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.539+0000 7fc8bb7fe700 1 -- 172.21.15.42:0/1687445983 learned_addr learned my addr 172.21.15.42:0/1687445983 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:28.544 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.541+0000 7fc8baffd700 1 --2- 172.21.15.42:0/1687445983 >> v2:172.21.15.42:3300/0 conn(0x7fc8bc0ad620 0x7fc8bc0a83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:28.548 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.541+0000 7fc8ba7fc700 1 -- 172.21.15.42:0/1687445983 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612856658 0 0) 0x7fc8bc0a8a40 con 0x7fc8bc0a6530 2020-04-02T23:39:28.548 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.541+0000 7fc8ba7fc700 1 -- 172.21.15.42:0/1687445983 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc89c003230 con 0x7fc8bc0a6530 2020-04-02T23:39:28.548 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.541+0000 7fc8ba7fc700 1 -- 172.21.15.42:0/1687445983 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404075551 0 0) 0x7fc8bc13ab30 con 0x7fc8bc0a69c0 2020-04-02T23:39:28.549 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.541+0000 7fc8ba7fc700 1 -- 172.21.15.42:0/1687445983 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8bc0a8a40 con 0x7fc8bc0a69c0 2020-04-02T23:39:28.549 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.542+0000 7fc8baffd700 1 -- 172.21.15.42:0/1687445983 >> v1:172.21.15.84:6789/0 conn(0x7fc8bc0a6530 legacy=0x7fc8bc139d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:28.549 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.542+0000 7fc8baffd700 1 -- 172.21.15.42:0/1687445983 >> v1:172.21.15.42:6789/0 conn(0x7fc8bc0a69c0 legacy=0x7fc8bc13a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:28.549 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.542+0000 7fc8baffd700 1 -- 172.21.15.42:0/1687445983 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc0a5d90 con 0x7fc8bc0ad620 2020-04-02T23:39:28.549 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.542+0000 7fc8baffd700 1 --2- 172.21.15.42:0/1687445983 >> v2:172.21.15.42:3300/0 conn(0x7fc8bc0ad620 0x7fc8bc0a83e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc8b4001450 tx=0x7fc8a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.549 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.543+0000 7fc8baffd700 1 --2- 172.21.15.42:0/1687445983 >> v2:172.21.15.42:3300/0 conn(0x7fc8bc0ad620 0x7fc8bc0a83e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc8b4001450 tx=0x7fc8a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.549 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.543+0000 7fc8baffd700 1 --2- 172.21.15.42:0/1687445983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8bc0ad620 0x7fc8bc0a83e0 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7fc8b4001450 tx=0x7fc8a4007a40).ready entity=mon.0 client_cookie=35c7fb41e162218b server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:28.549 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.543+0000 7fc8baffd700 1 --2- 172.21.15.42:0/1687445983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8bc0ad620 0x7fc8bc0a83e0 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7fc8b4001450 tx=0x7fc8a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.550 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.543+0000 7fc8baffd700 1 --2- 172.21.15.42:0/1687445983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8bc0ad620 0x7fc8bc0a83e0 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7fc8b4001450 tx=0x7fc8a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.550 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.543+0000 7fc8baffd700 1 --2- 172.21.15.42:0/1687445983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8bc0ad620 0x7fc8bc0a83e0 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7fc8b4001450 tx=0x7fc8a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.550 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.544+0000 7fc8ba7fc700 1 -- 172.21.15.42:0/1687445983 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8a4011480 con 0x7fc8bc0ad620 2020-04-02T23:39:28.550 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.544+0000 7fc8ba7fc700 1 -- 172.21.15.42:0/1687445983 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a40115e0 con 0x7fc8bc0ad620 2020-04-02T23:39:28.550 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.544+0000 7fc8ba7fc700 1 -- 172.21.15.42:0/1687445983 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8a4011a00 con 0x7fc8bc0ad620 2020-04-02T23:39:28.550 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.545+0000 7fc8c1583700 1 -- 172.21.15.42:0/1687445983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8bc0ad620 msgr2=0x7fc8bc0a83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:28.550 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.545+0000 7fc8c1583700 1 --2- 172.21.15.42:0/1687445983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8bc0ad620 0x7fc8bc0a83e0 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7fc8b4001450 tx=0x7fc8a4007a40).stop 2020-04-02T23:39:28.551 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.545+0000 7fc8c1583700 1 -- 172.21.15.42:0/1687445983 shutdown_connections 2020-04-02T23:39:28.551 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.545+0000 7fc8c1583700 1 --2- 172.21.15.42:0/1687445983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8bc0ad620 0x7fc8bc0a83e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:28.551 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.545+0000 7fc8c1583700 1 -- 172.21.15.42:0/1687445983 >> 172.21.15.42:0/1687445983 conn(0x7fc8bc062930 msgr2=0x7fc8bc0acb90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:28.552 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.546+0000 7fc8c1583700 1 -- 172.21.15.42:0/1687445983 shutdown_connections 2020-04-02T23:39:28.552 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.546+0000 7fc8c1583700 1 -- 172.21.15.42:0/1687445983 wait complete. 2020-04-02T23:39:28.552 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.547+0000 7fc8c1583700 1 Processor -- start 2020-04-02T23:39:28.552 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.547+0000 7fc8c1583700 1 -- start start 2020-04-02T23:39:28.558 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.550+0000 7fc8c1583700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc8bc0a6530 0x7fc8bc14df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:28.558 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.550+0000 7fc8c1583700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc8bc0a69c0 0x7fc8bc14e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:28.558 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8c1583700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8bc137930 con 0x7fc8bc0ad620 2020-04-02T23:39:28.558 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8c1583700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8bc0a2640 con 0x7fc8bc0a69c0 2020-04-02T23:39:28.558 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8c1583700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc0a3230 con 0x7fc8bc0a6530 2020-04-02T23:39:28.558 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8b3fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc8bc0a69c0 0x7fc8bc14e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:28.558 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8b3fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc8bc0a69c0 0x7fc8bc14e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40684/0 (socket says 172.21.15.42:40684) 2020-04-02T23:39:28.559 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8b3fff700 1 -- 172.21.15.42:0/724453028 learned_addr learned my addr 172.21.15.42:0/724453028 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:39:28.559 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8baffd700 1 --2- 172.21.15.42:0/724453028 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc8bc0a6530 0x7fc8bc14df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:28.559 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8b3fff700 1 -- 172.21.15.42:0/724453028 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc8bc0a6530 msgr2=0x7fc8bc14df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:28.559 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8b3fff700 1 --2- 172.21.15.42:0/724453028 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc8bc0a6530 0x7fc8bc14df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:28.559 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8b3fff700 1 -- 172.21.15.42:0/724453028 >> v1:172.21.15.42:6789/0 conn(0x7fc8bc0ad620 legacy=0x7fc8bc09f790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-04-02T23:39:28.559 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8b3fff700 1 -- 172.21.15.42:0/724453028 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc0a3440 con 0x7fc8bc0a69c0 2020-04-02T23:39:28.559 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8b3fff700 1 --2- 172.21.15.42:0/724453028 >> v2:172.21.15.42:3300/0 conn(0x7fc8bc0a69c0 0x7fc8bc14e370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc8bc138b00 tx=0x7fc8ac001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.560 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8b3fff700 1 --2- 172.21.15.42:0/724453028 >> v2:172.21.15.42:3300/0 conn(0x7fc8bc0a69c0 0x7fc8bc14e370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc8bc138b00 tx=0x7fc8ac001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.560 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8b3fff700 1 --2- 172.21.15.42:0/724453028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8bc0a69c0 0x7fc8bc14e370 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7fc8bc138b00 tx=0x7fc8ac001e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:28.560 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8b3fff700 1 --2- 172.21.15.42:0/724453028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8bc0a69c0 0x7fc8bc14e370 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fc8bc138b00 tx=0x7fc8ac001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.560 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8b3fff700 1 --2- 172.21.15.42:0/724453028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8bc0a69c0 0x7fc8bc14e370 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fc8bc138b00 tx=0x7fc8ac001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.560 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8b3fff700 1 --2- 172.21.15.42:0/724453028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8bc0a69c0 0x7fc8bc14e370 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fc8bc138b00 tx=0x7fc8ac001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.560 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8b8ff9700 1 -- 172.21.15.42:0/724453028 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8ac001ea0 con 0x7fc8bc0a69c0 2020-04-02T23:39:28.560 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8b8ff9700 1 -- 172.21.15.42:0/724453028 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac00cbf0 con 0x7fc8bc0a69c0 2020-04-02T23:39:28.560 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8b8ff9700 1 -- 172.21.15.42:0/724453028 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8ac00ce20 con 0x7fc8bc0a69c0 2020-04-02T23:39:28.561 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.551+0000 7fc8c1583700 1 -- 172.21.15.42:0/724453028 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8bc0a0fa0 con 0x7fc8bc0a69c0 2020-04-02T23:39:28.561 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.552+0000 7fc8c1583700 1 -- 172.21.15.42:0/724453028 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc0a1a30 con 0x7fc8bc0a69c0 2020-04-02T23:39:28.561 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.554+0000 7fc8b3fff700 1 --2- 172.21.15.42:0/724453028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8bc0a69c0 0x7fc8bc14e370 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fc8bc138b00 tx=0x7fc8ac001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.561 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.554+0000 7fc8b3fff700 1 --2- 172.21.15.42:0/724453028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8bc0a69c0 0x7fc8bc14e370 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fc8bc138b00 tx=0x7fc8ac001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.561 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.554+0000 7fc8b8ff9700 1 -- 172.21.15.42:0/724453028 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fc8ac0064e0 con 0x7fc8bc0a69c0 2020-04-02T23:39:28.561 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.555+0000 7fc8c1583700 1 -- 172.21.15.42:0/724453028 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8bc0a3a30 con 0x7fc8bc0a69c0 2020-04-02T23:39:28.562 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.555+0000 7fc8b8ff9700 1 --2- 172.21.15.42:0/724453028 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc8a006f6c0 0x7fc8a0071b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:28.562 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.555+0000 7fc8b8ff9700 1 -- 172.21.15.42:0/724453028 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc8ac060bb0 con 0x7fc8bc0a69c0 2020-04-02T23:39:28.562 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.556+0000 7fc8baffd700 1 --2- 172.21.15.42:0/724453028 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc8a006f6c0 0x7fc8a0071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:28.562 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.556+0000 7fc8baffd700 1 --2- 172.21.15.42:0/724453028 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc8a006f6c0 0x7fc8a0071b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc8b4001450 tx=0x7fc8a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.563 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.556+0000 7fc8baffd700 1 --2- 172.21.15.42:0/724453028 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc8a006f6c0 0x7fc8a0071b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc8b4001450 tx=0x7fc8a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.563 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.556+0000 7fc8baffd700 1 --2- 172.21.15.42:0/724453028 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc8a006f6c0 0x7fc8a0071b80 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7fc8b4001450 tx=0x7fc8a4007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:28.575 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.564+0000 7fc8b3fff700 1 --2- 172.21.15.42:0/724453028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8bc0a69c0 0x7fc8bc14e370 secure :-1 s=THROTTLE_DONE pgs=226 cs=0 l=1 rx=0x7fc8bc138b00 tx=0x7fc8ac001e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.575 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.564+0000 7fc8b8ff9700 1 -- 172.21.15.42:0/724453028 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fc8ac03c210 con 0x7fc8bc0a69c0 2020-04-02T23:39:28.842 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.839+0000 7fc8c1583700 1 -- 172.21.15.42:0/724453028 --> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8bc14d9b0 con 0x7fc8a006f6c0 2020-04-02T23:39:28.842 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.839+0000 7fc8baffd700 1 --2- 172.21.15.42:0/724453028 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc8a006f6c0 0x7fc8a0071b80 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7fc8b4001450 tx=0x7fc8a4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:28.842 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.839+0000 7fc8b8ff9700 1 -- 172.21.15.42:0/724453028 <== mgr.4100 v2:172.21.15.84:6800/23437 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc8a4008660 con 0x7fc8a006f6c0 2020-04-02T23:39:28.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.853+0000 7fc8c1583700 1 -- 172.21.15.42:0/724453028 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc8a006f6c0 msgr2=0x7fc8a0071b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:28.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.853+0000 7fc8c1583700 1 --2- 172.21.15.42:0/724453028 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc8a006f6c0 0x7fc8a0071b80 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7fc8b4001450 tx=0x7fc8a4007a40).stop 2020-04-02T23:39:28.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.853+0000 7fc8c1583700 1 -- 172.21.15.42:0/724453028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8bc0a69c0 msgr2=0x7fc8bc14e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:28.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.853+0000 7fc8c1583700 1 --2- 172.21.15.42:0/724453028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8bc0a69c0 0x7fc8bc14e370 secure :-1 s=READY pgs=226 cs=0 l=1 rx=0x7fc8bc138b00 tx=0x7fc8ac001e30).stop 2020-04-02T23:39:28.862 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.858+0000 7fc8c1583700 1 -- 172.21.15.42:0/724453028 shutdown_connections 2020-04-02T23:39:28.862 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.859+0000 7fc8c1583700 1 --2- 172.21.15.42:0/724453028 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc8a006f6c0 0x7fc8a0071b80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:28.862 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.859+0000 7fc8c1583700 1 --2- 172.21.15.42:0/724453028 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc8bc0a6530 0x7fc8bc14df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:28.862 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.859+0000 7fc8c1583700 1 --2- 172.21.15.42:0/724453028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8bc0a69c0 0x7fc8bc14e370 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:28.862 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.859+0000 7fc8c1583700 1 -- 172.21.15.42:0/724453028 >> 172.21.15.42:0/724453028 conn(0x7fc8bc062930 msgr2=0x7fc8bc069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:28.863 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.859+0000 7fc8c1583700 1 -- 172.21.15.42:0/724453028 shutdown_connections 2020-04-02T23:39:28.863 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:28.859+0000 7fc8c1583700 1 -- 172.21.15.42:0/724453028 wait complete. 2020-04-02T23:39:28.870 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 7 to deep-scrub 2020-04-02T23:39:28.885 INFO:tasks.ceph:Scrubbing osd.0 2020-04-02T23:39:28.886 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:28.933 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 config set osd_debug_deep_scrub_sleep 0 2020-04-02T23:39:29.207 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.204+0000 7fc3f28ef700 1 Processor -- start 2020-04-02T23:39:29.212 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.209+0000 7fc3f28ef700 1 -- start start 2020-04-02T23:39:29.214 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.210+0000 7fc3f28ef700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc3ec0a20b0 0x7fc3ec13d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:29.214 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.210+0000 7fc3f28ef700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec13d640 0x7fc3ec13fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:29.214 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.210+0000 7fc3f28ef700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ec0a25f0 con 0x7fc3ec0a1cd0 2020-04-02T23:39:29.214 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.210+0000 7fc3f28ef700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ec09a8f0 con 0x7fc3ec0a20b0 2020-04-02T23:39:29.214 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.210+0000 7fc3f28ef700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec09ab90 con 0x7fc3ec13d640 2020-04-02T23:39:29.216 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.212+0000 7fc3f0e8c700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec13d640 0x7fc3ec13fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:29.216 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.212+0000 7fc3f0e8c700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec13d640 0x7fc3ec13fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.42:60442/0 (socket says 172.21.15.42:60442) 2020-04-02T23:39:29.216 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.212+0000 7fc3f0e8c700 1 -- 172.21.15.42:0/2120058506 learned_addr learned my addr 172.21.15.42:0/2120058506 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:39:29.216 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.213+0000 7fc3f0e8c700 1 -- 172.21.15.42:0/2120058506 >> v2:172.21.15.42:3300/0 conn(0x7fc3ec0a20b0 msgr2=0x7fc3ec13d1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:39:29.216 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.213+0000 7fc3f0e8c700 1 --2- 172.21.15.42:0/2120058506 >> v2:172.21.15.42:3300/0 conn(0x7fc3ec0a20b0 0x7fc3ec13d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:29.216 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.213+0000 7fc3f0e8c700 1 -- 172.21.15.42:0/2120058506 >> v1:172.21.15.42:6789/0 conn(0x7fc3ec0a1cd0 legacy=0x7fc3ec0a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:29.217 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.213+0000 7fc3f0e8c700 1 -- 172.21.15.42:0/2120058506 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec09ae30 con 0x7fc3ec13d640 2020-04-02T23:39:29.218 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.213+0000 7fc3f0e8c700 1 --2- 172.21.15.42:0/2120058506 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec13d640 0x7fc3ec13fa30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc3dc0010d0 tx=0x7fc3e4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.218 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.213+0000 7fc3f0e8c700 1 --2- 172.21.15.42:0/2120058506 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec13d640 0x7fc3ec13fa30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc3dc0010d0 tx=0x7fc3e4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.218 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.214+0000 7fc3f0e8c700 1 --2- 172.21.15.42:0/2120058506 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec13d640 0x7fc3ec13fa30 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7fc3dc0010d0 tx=0x7fc3e4007dc0).ready entity=mon.2 client_cookie=694db799356c117c server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:29.218 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.215+0000 7fc3f0e8c700 1 --2- 172.21.15.42:0/2120058506 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec13d640 0x7fc3ec13fa30 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7fc3dc0010d0 tx=0x7fc3e4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.218 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.215+0000 7fc3f0e8c700 1 --2- 172.21.15.42:0/2120058506 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec13d640 0x7fc3ec13fa30 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7fc3dc0010d0 tx=0x7fc3e4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.218 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.215+0000 7fc3f0e8c700 1 --2- 172.21.15.42:0/2120058506 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec13d640 0x7fc3ec13fa30 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7fc3dc0010d0 tx=0x7fc3e4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.222 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.219+0000 7fc3eaffd700 1 -- 172.21.15.42:0/2120058506 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3e4010e20 con 0x7fc3ec13d640 2020-04-02T23:39:29.222 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.219+0000 7fc3eaffd700 1 -- 172.21.15.42:0/2120058506 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e40110c0 con 0x7fc3ec13d640 2020-04-02T23:39:29.222 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.219+0000 7fc3eaffd700 1 -- 172.21.15.42:0/2120058506 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3e40114a0 con 0x7fc3ec13d640 2020-04-02T23:39:29.222 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.219+0000 7fc3f28ef700 1 -- 172.21.15.42:0/2120058506 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec13d640 msgr2=0x7fc3ec13fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:29.222 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.219+0000 7fc3f28ef700 1 --2- 172.21.15.42:0/2120058506 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec13d640 0x7fc3ec13fa30 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7fc3dc0010d0 tx=0x7fc3e4007dc0).stop 2020-04-02T23:39:29.231 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.229+0000 7fc3f28ef700 1 -- 172.21.15.42:0/2120058506 shutdown_connections 2020-04-02T23:39:29.231 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.229+0000 7fc3f28ef700 1 --2- 172.21.15.42:0/2120058506 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec13d640 0x7fc3ec13fa30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:29.232 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.229+0000 7fc3f28ef700 1 --2- 172.21.15.42:0/2120058506 >> v2:172.21.15.42:3300/0 conn(0x7fc3ec0a20b0 0x7fc3ec13d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:29.232 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.229+0000 7fc3f28ef700 1 -- 172.21.15.42:0/2120058506 >> 172.21.15.42:0/2120058506 conn(0x7fc3ec05b720 msgr2=0x7fc3ec0aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:29.234 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.232+0000 7fc3f28ef700 1 -- 172.21.15.42:0/2120058506 shutdown_connections 2020-04-02T23:39:29.240 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.234+0000 7fc3f28ef700 1 -- 172.21.15.42:0/2120058506 wait complete. 2020-04-02T23:39:29.240 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.236+0000 7fc3f28ef700 1 Processor -- start 2020-04-02T23:39:29.247 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.243+0000 7fc3f28ef700 1 -- start start 2020-04-02T23:39:29.248 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.244+0000 7fc3f28ef700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec0a1cd0 0x7fc3ec09cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:29.248 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.244+0000 7fc3f28ef700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc3ec13d640 0x7fc3ec09d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:29.248 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.244+0000 7fc3f28ef700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ec09b9a0 con 0x7fc3ec0a20b0 2020-04-02T23:39:29.248 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.244+0000 7fc3f28ef700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ec09b260 con 0x7fc3ec13d640 2020-04-02T23:39:29.248 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.244+0000 7fc3f28ef700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec09b500 con 0x7fc3ec0a1cd0 2020-04-02T23:39:29.248 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.244+0000 7fc3ebfff700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec0a1cd0 0x7fc3ec09cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:29.249 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.244+0000 7fc3ebfff700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec0a1cd0 0x7fc3ec09cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.42:60448/0 (socket says 172.21.15.42:60448) 2020-04-02T23:39:29.249 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.244+0000 7fc3ebfff700 1 -- 172.21.15.42:0/2644915640 learned_addr learned my addr 172.21.15.42:0/2644915640 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:39:29.249 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.244+0000 7fc3f0e8c700 1 --2- 172.21.15.42:0/2644915640 >> v2:172.21.15.42:3300/0 conn(0x7fc3ec13d640 0x7fc3ec09d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:29.249 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.245+0000 7fc3e97fa700 1 -- 172.21.15.42:0/2644915640 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165371404 0 0) 0x7fc3ec09b9a0 con 0x7fc3ec0a20b0 2020-04-02T23:39:29.249 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.245+0000 7fc3e97fa700 1 -- 172.21.15.42:0/2644915640 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3cc002fe0 con 0x7fc3ec0a20b0 2020-04-02T23:39:29.250 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.245+0000 7fc3ebfff700 1 -- 172.21.15.42:0/2644915640 >> v2:172.21.15.42:3300/0 conn(0x7fc3ec13d640 msgr2=0x7fc3ec09d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:29.250 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.245+0000 7fc3ebfff700 1 --2- 172.21.15.42:0/2644915640 >> v2:172.21.15.42:3300/0 conn(0x7fc3ec13d640 0x7fc3ec09d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:29.250 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.245+0000 7fc3ebfff700 1 -- 172.21.15.42:0/2644915640 >> v1:172.21.15.84:6789/0 conn(0x7fc3ec0a20b0 legacy=0x7fc3ec1385d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:29.250 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.245+0000 7fc3ebfff700 1 -- 172.21.15.42:0/2644915640 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec138ce0 con 0x7fc3ec0a1cd0 2020-04-02T23:39:29.251 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.245+0000 7fc3ebfff700 1 --2- 172.21.15.42:0/2644915640 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec0a1cd0 0x7fc3ec09cda0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc3e0002860 tx=0x7fc3dc00c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.251 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.245+0000 7fc3ebfff700 1 --2- 172.21.15.42:0/2644915640 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec0a1cd0 0x7fc3ec09cda0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc3e0002860 tx=0x7fc3dc00c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.251 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.245+0000 7fc3ebfff700 1 --2- 172.21.15.42:0/2644915640 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec0a1cd0 0x7fc3ec09cda0 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7fc3e0002860 tx=0x7fc3dc00c4e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:29.251 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.245+0000 7fc3ebfff700 1 --2- 172.21.15.42:0/2644915640 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec0a1cd0 0x7fc3ec09cda0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fc3e0002860 tx=0x7fc3dc00c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.251 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.245+0000 7fc3ebfff700 1 --2- 172.21.15.42:0/2644915640 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec0a1cd0 0x7fc3ec09cda0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fc3e0002860 tx=0x7fc3dc00c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.251 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.245+0000 7fc3ebfff700 1 --2- 172.21.15.42:0/2644915640 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec0a1cd0 0x7fc3ec09cda0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fc3e0002860 tx=0x7fc3dc00c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.251 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.245+0000 7fc3e97fa700 1 -- 172.21.15.42:0/2644915640 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3dc001ea0 con 0x7fc3ec0a1cd0 2020-04-02T23:39:29.252 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.245+0000 7fc3f28ef700 1 -- 172.21.15.42:0/2644915640 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ec09dd10 con 0x7fc3ec0a1cd0 2020-04-02T23:39:29.252 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.245+0000 7fc3e97fa700 1 -- 172.21.15.42:0/2644915640 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc00ec40 con 0x7fc3ec0a1cd0 2020-04-02T23:39:29.252 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.246+0000 7fc3e97fa700 1 -- 172.21.15.42:0/2644915640 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3e00026c0 con 0x7fc3ec0a1cd0 2020-04-02T23:39:29.252 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.246+0000 7fc3f28ef700 1 -- 172.21.15.42:0/2644915640 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ec0a9a30 con 0x7fc3ec0a1cd0 2020-04-02T23:39:29.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.246+0000 7fc3ebfff700 1 --2- 172.21.15.42:0/2644915640 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec0a1cd0 0x7fc3ec09cda0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fc3e0002860 tx=0x7fc3dc00c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.247+0000 7fc3e97fa700 1 -- 172.21.15.42:0/2644915640 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fc3dc0064e0 con 0x7fc3ec0a1cd0 2020-04-02T23:39:29.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.247+0000 7fc3ebfff700 1 --2- 172.21.15.42:0/2644915640 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec0a1cd0 0x7fc3ec09cda0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fc3e0002860 tx=0x7fc3dc00c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.247+0000 7fc3f28ef700 1 -- 172.21.15.42:0/2644915640 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc3ec09b700 con 0x7fc3ec0a1cd0 2020-04-02T23:39:29.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.248+0000 7fc3e97fa700 1 --2- 172.21.15.42:0/2644915640 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc3cc04d9c0 0x7fc3cc04fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:29.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.248+0000 7fc3e97fa700 1 -- 172.21.15.42:0/2644915640 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc3dc062830 con 0x7fc3ec0a1cd0 2020-04-02T23:39:29.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.248+0000 7fc3e97fa700 1 --2- 172.21.15.42:0/2644915640 >> [v2:172.21.15.42:6800/24836,v1:172.21.15.42:6801/24836] conn(0x7fc3cc054af0 0x7fc3cc056f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:29.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.248+0000 7fc3e97fa700 1 -- 172.21.15.42:0/2644915640 --> [v2:172.21.15.42:6800/24836,v1:172.21.15.42:6801/24836] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc3cc0574d0 con 0x7fc3cc054af0 2020-04-02T23:39:29.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.249+0000 7fc3eb7fe700 1 --2- 172.21.15.42:0/2644915640 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc3cc04d9c0 0x7fc3cc04fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:29.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.249+0000 7fc3eb7fe700 1 --2- 172.21.15.42:0/2644915640 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc3cc04d9c0 0x7fc3cc04fe80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc3e0002490 tx=0x7fc3e000cec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.249+0000 7fc3eb7fe700 1 --2- 172.21.15.42:0/2644915640 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc3cc04d9c0 0x7fc3cc04fe80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc3e0002490 tx=0x7fc3e000cec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.249+0000 7fc3eb7fe700 1 --2- 172.21.15.42:0/2644915640 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc3cc04d9c0 0x7fc3cc04fe80 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7fc3e0002490 tx=0x7fc3e000cec0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:29.255 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.250+0000 7fc3ebfff700 1 --2- 172.21.15.42:0/2644915640 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec0a1cd0 0x7fc3ec09cda0 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fc3e0002860 tx=0x7fc3dc00c4e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.255 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.250+0000 7fc3e97fa700 1 -- 172.21.15.42:0/2644915640 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3dc03df90 con 0x7fc3ec0a1cd0 2020-04-02T23:39:29.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.253+0000 7fc3f0e8c700 1 --2- 172.21.15.42:0/2644915640 >> [v2:172.21.15.42:6800/24836,v1:172.21.15.42:6801/24836] conn(0x7fc3cc054af0 0x7fc3cc056f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:29.256 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.254+0000 7fc3f0e8c700 1 --2- 172.21.15.42:0/2644915640 >> [v2:172.21.15.42:6800/24836,v1:172.21.15.42:6801/24836] conn(0x7fc3cc054af0 0x7fc3cc056f10 crc :-1 s=READY pgs=9 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:29.257 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.255+0000 7fc3e97fa700 1 -- 172.21.15.42:0/2644915640 <== osd.0 v2:172.21.15.42:6800/24836 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fc3cc0574d0 con 0x7fc3cc054af0 2020-04-02T23:39:29.311 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.308+0000 7fc3f28ef700 1 -- 172.21.15.42:0/2644915640 --> [v2:172.21.15.42:6800/24836,v1:172.21.15.42:6801/24836] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc3ec0a8a30 con 0x7fc3cc054af0 2020-04-02T23:39:29.311 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.308+0000 7fc3e97fa700 1 -- 172.21.15.42:0/2644915640 <== osd.0 v2:172.21.15.42:6800/24836 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc3ec0a8a30 con 0x7fc3cc054af0 2020-04-02T23:39:29.311 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2020-04-02T23:39:29.312 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-04-02T23:39:29.312 INFO:teuthology.orchestra.run.smithi042.stdout:} 2020-04-02T23:39:29.313 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.310+0000 7fc3f28ef700 1 -- 172.21.15.42:0/2644915640 >> [v2:172.21.15.42:6800/24836,v1:172.21.15.42:6801/24836] conn(0x7fc3cc054af0 msgr2=0x7fc3cc056f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:29.313 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.310+0000 7fc3f28ef700 1 --2- 172.21.15.42:0/2644915640 >> [v2:172.21.15.42:6800/24836,v1:172.21.15.42:6801/24836] conn(0x7fc3cc054af0 0x7fc3cc056f10 crc :-1 s=READY pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:29.314 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.310+0000 7fc3f28ef700 1 -- 172.21.15.42:0/2644915640 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc3cc04d9c0 msgr2=0x7fc3cc04fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:29.314 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.310+0000 7fc3f28ef700 1 --2- 172.21.15.42:0/2644915640 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fc3cc04d9c0 0x7fc3cc04fe80 secure :-1 s=READY pgs=116 cs=0 l=1 rx=0x7fc3e0002490 tx=0x7fc3e000cec0).stop 2020-04-02T23:39:29.314 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.310+0000 7fc3f28ef700 1 -- 172.21.15.42:0/2644915640 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec0a1cd0 msgr2=0x7fc3ec09cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:29.314 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.310+0000 7fc3f28ef700 1 --2- 172.21.15.42:0/2644915640 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fc3ec0a1cd0 0x7fc3ec09cda0 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7fc3e0002860 tx=0x7fc3dc00c4e0).stop 2020-04-02T23:39:29.314 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.310+0000 7fc3f0e8c700 1 -- 172.21.15.42:0/2644915640 reap_dead start 2020-04-02T23:39:29.318 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.315+0000 7fc3f28ef700 1 -- 172.21.15.42:0/2644915640 shutdown_connections 2020-04-02T23:39:29.318 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.315+0000 7fc3f28ef700 1 -- 172.21.15.42:0/2644915640 >> 172.21.15.42:0/2644915640 conn(0x7fc3ec05b720 msgr2=0x7fc3ec0a7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:29.318 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.315+0000 7fc3f28ef700 1 -- 172.21.15.42:0/2644915640 shutdown_connections 2020-04-02T23:39:29.319 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.315+0000 7fc3f28ef700 1 -- 172.21.15.42:0/2644915640 wait complete. 2020-04-02T23:39:29.341 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:29.424 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 0 2020-04-02T23:39:29.698 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.695+0000 7ff4d85bd700 1 Processor -- start 2020-04-02T23:39:29.699 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.696+0000 7ff4d85bd700 1 -- start start 2020-04-02T23:39:29.700 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.697+0000 7ff4d85bd700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4d00a9aa0 0x7ff4d01324a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:29.700 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.697+0000 7ff4d85bd700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff4d0132900 0x7ff4d0142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:29.700 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.697+0000 7ff4d85bd700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d00a9f20 con 0x7ff4d00ac310 2020-04-02T23:39:29.700 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.697+0000 7ff4d85bd700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d00ab660 con 0x7ff4d0132900 2020-04-02T23:39:29.700 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.697+0000 7ff4d85bd700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d00a6180 con 0x7ff4d00a9aa0 2020-04-02T23:39:29.701 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.697+0000 7ff4d5b58700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4d00a9aa0 0x7ff4d01324a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:29.701 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.697+0000 7ff4d5b58700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4d00a9aa0 0x7ff4d01324a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.42:60460/0 (socket says 172.21.15.42:60460) 2020-04-02T23:39:29.701 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.697+0000 7ff4d5b58700 1 -- 172.21.15.42:0/1035855989 learned_addr learned my addr 172.21.15.42:0/1035855989 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:39:29.701 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.697+0000 7ff4d6b5a700 1 --2- 172.21.15.42:0/1035855989 >> v2:172.21.15.84:3300/0 conn(0x7ff4d0132900 0x7ff4d0142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:29.702 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.698+0000 7ff4d6b5a700 1 -- 172.21.15.42:0/1035855989 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4d00a9aa0 msgr2=0x7ff4d01324a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:29.702 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.698+0000 7ff4d6b5a700 1 --2- 172.21.15.42:0/1035855989 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4d00a9aa0 0x7ff4d01324a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:29.702 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.698+0000 7ff4d6b5a700 1 -- 172.21.15.42:0/1035855989 >> v1:172.21.15.84:6789/0 conn(0x7ff4d00ac310 legacy=0x7ff4d0138680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:29.702 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.698+0000 7ff4d6b5a700 1 -- 172.21.15.42:0/1035855989 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d00a6420 con 0x7ff4d0132900 2020-04-02T23:39:29.702 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.698+0000 7ff4d6b5a700 1 --2- 172.21.15.42:0/1035855989 >> v2:172.21.15.84:3300/0 conn(0x7ff4d0132900 0x7ff4d0142fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff4c0002f30 tx=0x7ff4c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.703 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.698+0000 7ff4d6b5a700 1 --2- 172.21.15.42:0/1035855989 >> v2:172.21.15.84:3300/0 conn(0x7ff4d0132900 0x7ff4d0142fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff4c0002f30 tx=0x7ff4c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.703 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.698+0000 7ff4d6b5a700 1 --2- 172.21.15.42:0/1035855989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4d0132900 0x7ff4d0142fd0 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7ff4c0002f30 tx=0x7ff4c0007a40).ready entity=mon.1 client_cookie=65e69b7f763ce220 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:29.703 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.698+0000 7ff4d6b5a700 1 --2- 172.21.15.42:0/1035855989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4d0132900 0x7ff4d0142fd0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7ff4c0002f30 tx=0x7ff4c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.703 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.698+0000 7ff4d6b5a700 1 --2- 172.21.15.42:0/1035855989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4d0132900 0x7ff4d0142fd0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7ff4c0002f30 tx=0x7ff4c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.703 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.698+0000 7ff4d6b5a700 1 --2- 172.21.15.42:0/1035855989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4d0132900 0x7ff4d0142fd0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7ff4c0002f30 tx=0x7ff4c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.703 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.698+0000 7ff4d5357700 1 -- 172.21.15.42:0/1035855989 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4c00115b0 con 0x7ff4d0132900 2020-04-02T23:39:29.703 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.698+0000 7ff4d5357700 1 -- 172.21.15.42:0/1035855989 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c0011710 con 0x7ff4d0132900 2020-04-02T23:39:29.703 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.698+0000 7ff4d5357700 1 -- 172.21.15.42:0/1035855989 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4c0011af0 con 0x7ff4d0132900 2020-04-02T23:39:29.704 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.698+0000 7ff4d85bd700 1 -- 172.21.15.42:0/1035855989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4d0132900 msgr2=0x7ff4d0142fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:29.704 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.698+0000 7ff4d85bd700 1 --2- 172.21.15.42:0/1035855989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4d0132900 0x7ff4d0142fd0 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7ff4c0002f30 tx=0x7ff4c0007a40).stop 2020-04-02T23:39:29.704 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.700+0000 7ff4d85bd700 1 -- 172.21.15.42:0/1035855989 shutdown_connections 2020-04-02T23:39:29.704 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.700+0000 7ff4d85bd700 1 --2- 172.21.15.42:0/1035855989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4d0132900 0x7ff4d0142fd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:29.704 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.700+0000 7ff4d85bd700 1 --2- 172.21.15.42:0/1035855989 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4d00a9aa0 0x7ff4d01324a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:29.704 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.700+0000 7ff4d85bd700 1 -- 172.21.15.42:0/1035855989 >> 172.21.15.42:0/1035855989 conn(0x7ff4d0060980 msgr2=0x7ff4d00ab880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:29.705 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.703+0000 7ff4d85bd700 1 -- 172.21.15.42:0/1035855989 shutdown_connections 2020-04-02T23:39:29.710 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.704+0000 7ff4d85bd700 1 -- 172.21.15.42:0/1035855989 wait complete. 2020-04-02T23:39:29.710 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.705+0000 7ff4d85bd700 1 Processor -- start 2020-04-02T23:39:29.711 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.706+0000 7ff4d85bd700 1 -- start start 2020-04-02T23:39:29.711 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.707+0000 7ff4d85bd700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4d00a9aa0 0x7ff4d0134280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:29.711 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.707+0000 7ff4d85bd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff4d0132900 0x7ff4d0128550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:29.711 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.707+0000 7ff4d85bd700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d012d6d0 con 0x7ff4d00ac310 2020-04-02T23:39:29.711 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.707+0000 7ff4d85bd700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d01289b0 con 0x7ff4d0132900 2020-04-02T23:39:29.711 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.707+0000 7ff4d85bd700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d012d970 con 0x7ff4d00a9aa0 2020-04-02T23:39:29.711 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.707+0000 7ff4d6b5a700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff4d0132900 0x7ff4d0128550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:29.712 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.707+0000 7ff4d6b5a700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff4d0132900 0x7ff4d0128550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40714/0 (socket says 172.21.15.42:40714) 2020-04-02T23:39:29.712 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.707+0000 7ff4d6b5a700 1 -- 172.21.15.42:0/3025669925 learned_addr learned my addr 172.21.15.42:0/3025669925 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:39:29.712 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.707+0000 7ff4d5b58700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff4d00ac310 0x7ff4d0127e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:54514/0 (socket says 172.21.15.42:54514) 2020-04-02T23:39:29.712 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.707+0000 7ff4d6359700 1 --2- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4d00a9aa0 0x7ff4d0134280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:29.712 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.707+0000 7ff4bf7fe700 1 -- 172.21.15.42:0/3025669925 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929702500 0 0) 0x7ff4d012d6d0 con 0x7ff4d00ac310 2020-04-02T23:39:29.712 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.707+0000 7ff4bf7fe700 1 -- 172.21.15.42:0/3025669925 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4b0002fe0 con 0x7ff4d00ac310 2020-04-02T23:39:29.712 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.707+0000 7ff4d6359700 1 -- 172.21.15.42:0/3025669925 >> v2:172.21.15.42:3300/0 conn(0x7ff4d0132900 msgr2=0x7ff4d0128550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:29.713 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.707+0000 7ff4d6359700 1 --2- 172.21.15.42:0/3025669925 >> v2:172.21.15.42:3300/0 conn(0x7ff4d0132900 0x7ff4d0128550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:29.713 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.707+0000 7ff4d6359700 1 -- 172.21.15.42:0/3025669925 >> v1:172.21.15.84:6789/0 conn(0x7ff4d00ac310 legacy=0x7ff4d0127e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:29.713 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.708+0000 7ff4d6359700 1 -- 172.21.15.42:0/3025669925 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d012c720 con 0x7ff4d00a9aa0 2020-04-02T23:39:29.713 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.708+0000 7ff4d6b5a700 1 --2- 172.21.15.42:0/3025669925 >> v2:172.21.15.42:3300/0 conn(0x7ff4d0132900 0x7ff4d0128550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:39:29.713 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.708+0000 7ff4d6359700 1 --2- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4d00a9aa0 0x7ff4d0134280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4d00ab230 tx=0x7ff4c8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.714 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.708+0000 7ff4d6359700 1 --2- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4d00a9aa0 0x7ff4d0134280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4d00ab230 tx=0x7ff4c8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.714 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.708+0000 7ff4d6359700 1 --2- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4d00a9aa0 0x7ff4d0134280 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7ff4d00ab230 tx=0x7ff4c8010c20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:29.714 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.708+0000 7ff4d6359700 1 --2- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4d00a9aa0 0x7ff4d0134280 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7ff4d00ab230 tx=0x7ff4c8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.715 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.708+0000 7ff4d6359700 1 --2- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4d00a9aa0 0x7ff4d0134280 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7ff4d00ab230 tx=0x7ff4c8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.715 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.708+0000 7ff4d6359700 1 --2- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4d00a9aa0 0x7ff4d0134280 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7ff4d00ab230 tx=0x7ff4c8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.715 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.708+0000 7ff4bf7fe700 1 -- 172.21.15.42:0/3025669925 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4c8002240 con 0x7ff4d00a9aa0 2020-04-02T23:39:29.715 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.708+0000 7ff4bf7fe700 1 -- 172.21.15.42:0/3025669925 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c80023e0 con 0x7ff4d00a9aa0 2020-04-02T23:39:29.715 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.708+0000 7ff4bf7fe700 1 -- 172.21.15.42:0/3025669925 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4c8002800 con 0x7ff4d00a9aa0 2020-04-02T23:39:29.715 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.708+0000 7ff4d85bd700 1 -- 172.21.15.42:0/3025669925 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d00aef80 con 0x7ff4d00a9aa0 2020-04-02T23:39:29.715 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.708+0000 7ff4d85bd700 1 -- 172.21.15.42:0/3025669925 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d012c380 con 0x7ff4d00a9aa0 2020-04-02T23:39:29.716 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.710+0000 7ff4d6359700 1 --2- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4d00a9aa0 0x7ff4d0134280 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7ff4d00ab230 tx=0x7ff4c8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.716 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.711+0000 7ff4d6359700 1 --2- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4d00a9aa0 0x7ff4d0134280 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7ff4d00ab230 tx=0x7ff4c8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.716 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.711+0000 7ff4bf7fe700 1 -- 172.21.15.42:0/3025669925 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7ff4c8002960 con 0x7ff4d00a9aa0 2020-04-02T23:39:29.716 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.711+0000 7ff4bf7fe700 1 --2- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ff4b004d9d0 0x7ff4b004fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:29.716 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.711+0000 7ff4bf7fe700 1 -- 172.21.15.42:0/3025669925 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff4c8061470 con 0x7ff4d00a9aa0 2020-04-02T23:39:29.716 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.711+0000 7ff4d85bd700 1 -- 172.21.15.42:0/3025669925 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ac003340 con 0x7ff4d00a9aa0 2020-04-02T23:39:29.717 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.712+0000 7ff4d5b58700 1 --2- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ff4b004d9d0 0x7ff4b004fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:29.717 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.712+0000 7ff4d5b58700 1 --2- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ff4b004d9d0 0x7ff4b004fe90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff4cc002ef0 tx=0x7ff4cc0098b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.717 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.712+0000 7ff4d5b58700 1 --2- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ff4b004d9d0 0x7ff4b004fe90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff4cc002ef0 tx=0x7ff4cc0098b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.717 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.712+0000 7ff4d5b58700 1 --2- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ff4b004d9d0 0x7ff4b004fe90 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7ff4cc002ef0 tx=0x7ff4cc0098b0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:29.721 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.717+0000 7ff4d6359700 1 --2- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4d00a9aa0 0x7ff4d0134280 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7ff4d00ab230 tx=0x7ff4c8010c20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:29.722 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:29.717+0000 7ff4bf7fe700 1 -- 172.21.15.42:0/3025669925 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7ff4c803cb30 con 0x7ff4d00a9aa0 2020-04-02T23:39:30.008 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.005+0000 7ff4d85bd700 1 -- 172.21.15.42:0/3025669925 --> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4ac002150 con 0x7ff4b004d9d0 2020-04-02T23:39:30.009 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.006+0000 7ff4d5b58700 1 --2- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ff4b004d9d0 0x7ff4b004fe90 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7ff4cc002ef0 tx=0x7ff4cc0098b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.009 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.006+0000 7ff4bf7fe700 1 -- 172.21.15.42:0/3025669925 <== mgr.4100 v2:172.21.15.84:6800/23437 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff4ac002150 con 0x7ff4b004d9d0 2020-04-02T23:39:30.018 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.015+0000 7ff4d85bd700 1 -- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ff4b004d9d0 msgr2=0x7ff4b004fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:30.018 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.015+0000 7ff4d85bd700 1 --2- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ff4b004d9d0 0x7ff4b004fe90 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7ff4cc002ef0 tx=0x7ff4cc0098b0).stop 2020-04-02T23:39:30.018 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.015+0000 7ff4d85bd700 1 -- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4d00a9aa0 msgr2=0x7ff4d0134280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:30.019 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.015+0000 7ff4d85bd700 1 --2- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4d00a9aa0 0x7ff4d0134280 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7ff4d00ab230 tx=0x7ff4c8010c20).stop 2020-04-02T23:39:30.019 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.015+0000 7ff4d85bd700 1 -- 172.21.15.42:0/3025669925 shutdown_connections 2020-04-02T23:39:30.019 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.015+0000 7ff4d85bd700 1 --2- 172.21.15.42:0/3025669925 >> v2:172.21.15.42:3300/0 conn(0x7ff4d0132900 0x7ff4d0128550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:30.019 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.015+0000 7ff4d85bd700 1 --2- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7ff4b004d9d0 0x7ff4b004fe90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:30.019 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.015+0000 7ff4d85bd700 1 --2- 172.21.15.42:0/3025669925 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7ff4d00a9aa0 0x7ff4d0134280 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:30.019 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.015+0000 7ff4d85bd700 1 -- 172.21.15.42:0/3025669925 >> 172.21.15.42:0/3025669925 conn(0x7ff4d0060980 msgr2=0x7ff4d0131940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:30.020 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.015+0000 7ff4d85bd700 1 -- 172.21.15.42:0/3025669925 shutdown_connections 2020-04-02T23:39:30.020 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.015+0000 7ff4d85bd700 1 -- 172.21.15.42:0/3025669925 wait complete. 2020-04-02T23:39:30.020 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 0 to deep-scrub 2020-04-02T23:39:30.043 INFO:tasks.ceph:Scrubbing osd.1 2020-04-02T23:39:30.043 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:30.115 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 config set osd_debug_deep_scrub_sleep 0 2020-04-02T23:39:30.398 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.382+0000 7f0274462700 1 Processor -- start 2020-04-02T23:39:30.398 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.382+0000 7f0274462700 1 -- start start 2020-04-02T23:39:30.398 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.384+0000 7f0274462700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f026c0802f0 0x7f026c09a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:30.399 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.384+0000 7f0274462700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f026c09a6e0 0x7f026c09ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:30.399 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.384+0000 7f0274462700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026c0a35b0 con 0x7f026c0a2190 2020-04-02T23:39:30.399 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.384+0000 7f0274462700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026c0a68d0 con 0x7f026c09a6e0 2020-04-02T23:39:30.399 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.384+0000 7f0274462700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026c0a72f0 con 0x7f026c0802f0 2020-04-02T23:39:30.399 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.384+0000 7f02729ff700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f026c09a6e0 0x7f026c09ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:30.399 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.384+0000 7f02721fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f026c0a2190 0x7f026c0a5250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:54522/0 (socket says 172.21.15.42:54522) 2020-04-02T23:39:30.399 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.384+0000 7f02721fe700 1 -- 172.21.15.42:0/3666717682 learned_addr learned my addr 172.21.15.42:0/3666717682 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:30.400 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.384+0000 7f02719fd700 1 --2- 172.21.15.42:0/3666717682 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f026c0802f0 0x7f026c09a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:30.400 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.394+0000 7f02719fd700 1 -- 172.21.15.42:0/3666717682 >> v2:172.21.15.84:3300/0 conn(0x7f026c09a6e0 msgr2=0x7f026c09ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:30.400 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.394+0000 7f02719fd700 1 --2- 172.21.15.42:0/3666717682 >> v2:172.21.15.84:3300/0 conn(0x7f026c09a6e0 0x7f026c09ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:30.400 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.394+0000 7f02719fd700 1 -- 172.21.15.42:0/3666717682 >> v1:172.21.15.84:6789/0 conn(0x7f026c0a2190 legacy=0x7f026c0a5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:30.400 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.394+0000 7f02719fd700 1 -- 172.21.15.42:0/3666717682 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026c0a7590 con 0x7f026c0802f0 2020-04-02T23:39:30.400 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.394+0000 7f02719fd700 1 --2- 172.21.15.42:0/3666717682 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f026c0802f0 0x7f026c09a280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f025c002f30 tx=0x7f025c009dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.400 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.394+0000 7f02719fd700 1 --2- 172.21.15.42:0/3666717682 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f026c0802f0 0x7f026c09a280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f025c002f30 tx=0x7f025c009dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.394+0000 7f02719fd700 1 --2- 172.21.15.42:0/3666717682 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f026c0802f0 0x7f026c09a280 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f025c002f30 tx=0x7f025c009dd0).ready entity=mon.2 client_cookie=908e160f7e5eaecd server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.395+0000 7f02719fd700 1 --2- 172.21.15.42:0/3666717682 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f026c0802f0 0x7f026c09a280 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f025c002f30 tx=0x7f025c009dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.395+0000 7f02719fd700 1 --2- 172.21.15.42:0/3666717682 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f026c0802f0 0x7f026c09a280 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f025c002f30 tx=0x7f025c009dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.395+0000 7f02719fd700 1 --2- 172.21.15.42:0/3666717682 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f026c0802f0 0x7f026c09a280 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f025c002f30 tx=0x7f025c009dd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.384+0000 7f02711fc700 1 -- 172.21.15.42:0/3666717682 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097759936 0 0) 0x7f026c0a35b0 con 0x7f026c0a2190 2020-04-02T23:39:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.396+0000 7f02711fc700 1 -- 172.21.15.42:0/3666717682 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f025c00b910 con 0x7f026c0802f0 2020-04-02T23:39:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.396+0000 7f02711fc700 1 -- 172.21.15.42:0/3666717682 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c00c0c0 con 0x7f026c0802f0 2020-04-02T23:39:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.396+0000 7f02711fc700 1 -- 172.21.15.42:0/3666717682 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f025c00bc60 con 0x7f026c0802f0 2020-04-02T23:39:30.408 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.400+0000 7f0274462700 1 -- 172.21.15.42:0/3666717682 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f026c0802f0 msgr2=0x7f026c09a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:30.408 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.400+0000 7f0274462700 1 --2- 172.21.15.42:0/3666717682 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f026c0802f0 0x7f026c09a280 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f025c002f30 tx=0x7f025c009dd0).stop 2020-04-02T23:39:30.408 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.400+0000 7f0274462700 1 -- 172.21.15.42:0/3666717682 shutdown_connections 2020-04-02T23:39:30.408 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.400+0000 7f0274462700 1 --2- 172.21.15.42:0/3666717682 >> v2:172.21.15.84:3300/0 conn(0x7f026c09a6e0 0x7f026c09ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:30.408 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.400+0000 7f0274462700 1 --2- 172.21.15.42:0/3666717682 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f026c0802f0 0x7f026c09a280 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:30.408 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.400+0000 7f0274462700 1 -- 172.21.15.42:0/3666717682 >> 172.21.15.42:0/3666717682 conn(0x7f026c05ac50 msgr2=0x7f026c05b060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:30.409 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.405+0000 7f0274462700 1 -- 172.21.15.42:0/3666717682 shutdown_connections 2020-04-02T23:39:30.409 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.405+0000 7f0274462700 1 -- 172.21.15.42:0/3666717682 wait complete. 2020-04-02T23:39:30.410 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.407+0000 7f0274462700 1 Processor -- start 2020-04-02T23:39:30.410 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.407+0000 7f0274462700 1 -- start start 2020-04-02T23:39:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.408+0000 7f0274462700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f026c062890 0x7f026c0610f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.408+0000 7f0274462700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026c067300 con 0x7f026c09a6e0 2020-04-02T23:39:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.408+0000 7f0274462700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026c061900 con 0x7f026c0802f0 2020-04-02T23:39:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.408+0000 7f0274462700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026c07f8f0 con 0x7f026c062890 2020-04-02T23:39:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.408+0000 7f02719fd700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f026c09a6e0 0x7f026c152950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60152/0 (socket says 172.21.15.42:60152) 2020-04-02T23:39:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.408+0000 7f02719fd700 1 -- 172.21.15.42:0/2087791032 learned_addr learned my addr 172.21.15.42:0/2087791032 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:30.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.408+0000 7f02729ff700 1 --2- 172.21.15.42:0/2087791032 >> v2:172.21.15.84:3300/0 conn(0x7f026c062890 0x7f026c0610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:30.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.408+0000 7f02729ff700 1 -- 172.21.15.42:0/2087791032 >> v1:172.21.15.84:6789/0 conn(0x7f026c0802f0 legacy=0x7f026c066bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:30.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.408+0000 7f02729ff700 1 -- 172.21.15.42:0/2087791032 >> v1:172.21.15.42:6789/0 conn(0x7f026c09a6e0 legacy=0x7f026c152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:30.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.408+0000 7f02729ff700 1 -- 172.21.15.42:0/2087791032 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026c09a490 con 0x7f026c062890 2020-04-02T23:39:30.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.408+0000 7f02729ff700 1 --2- 172.21.15.42:0/2087791032 >> v2:172.21.15.84:3300/0 conn(0x7f026c062890 0x7f026c0610f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f026c0ab500 tx=0x7f0264010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.409+0000 7f02729ff700 1 --2- 172.21.15.42:0/2087791032 >> v2:172.21.15.84:3300/0 conn(0x7f026c062890 0x7f026c0610f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f026c0ab500 tx=0x7f0264010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.415 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.409+0000 7f02729ff700 1 --2- 172.21.15.42:0/2087791032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c062890 0x7f026c0610f0 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7f026c0ab500 tx=0x7f0264010f20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:30.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.409+0000 7f02729ff700 1 --2- 172.21.15.42:0/2087791032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c062890 0x7f026c0610f0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f026c0ab500 tx=0x7f0264010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.409+0000 7f02637fe700 1 -- 172.21.15.42:0/2087791032 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0264011620 con 0x7f026c062890 2020-04-02T23:39:30.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.409+0000 7f02729ff700 1 --2- 172.21.15.42:0/2087791032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c062890 0x7f026c0610f0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f026c0ab500 tx=0x7f0264010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.409+0000 7f0274462700 1 -- 172.21.15.42:0/2087791032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026c064250 con 0x7f026c062890 2020-04-02T23:39:30.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.409+0000 7f02729ff700 1 --2- 172.21.15.42:0/2087791032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c062890 0x7f026c0610f0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f026c0ab500 tx=0x7f0264010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.409+0000 7f02637fe700 1 -- 172.21.15.42:0/2087791032 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0264011780 con 0x7f026c062890 2020-04-02T23:39:30.416 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.409+0000 7f0274462700 1 -- 172.21.15.42:0/2087791032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026c061550 con 0x7f026c062890 2020-04-02T23:39:30.417 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.409+0000 7f02637fe700 1 -- 172.21.15.42:0/2087791032 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0264011ae0 con 0x7f026c062890 2020-04-02T23:39:30.418 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.410+0000 7f02729ff700 1 --2- 172.21.15.42:0/2087791032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c062890 0x7f026c0610f0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f026c0ab500 tx=0x7f0264010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.419 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.410+0000 7f02729ff700 1 --2- 172.21.15.42:0/2087791032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c062890 0x7f026c0610f0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f026c0ab500 tx=0x7f0264010f20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.419 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.410+0000 7f02637fe700 1 -- 172.21.15.42:0/2087791032 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f0264011c40 con 0x7f026c062890 2020-04-02T23:39:30.419 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.411+0000 7f02637fe700 1 --2- 172.21.15.42:0/2087791032 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f025404d600 0x7f025404fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:30.419 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.411+0000 7f02637fe700 1 -- 172.21.15.42:0/2087791032 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f02640610d0 con 0x7f026c062890 2020-04-02T23:39:30.423 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.412+0000 7f02721fe700 1 --2- 172.21.15.42:0/2087791032 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f025404d600 0x7f025404fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:30.423 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.412+0000 7f02721fe700 1 --2- 172.21.15.42:0/2087791032 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f025404d600 0x7f025404fac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0268000f50 tx=0x7f0268001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.423 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.413+0000 7f02721fe700 1 --2- 172.21.15.42:0/2087791032 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f025404d600 0x7f025404fac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0268000f50 tx=0x7f0268001590).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.423 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.413+0000 7f02721fe700 1 --2- 172.21.15.42:0/2087791032 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f025404d600 0x7f025404fac0 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f0268000f50 tx=0x7f0268001590).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:30.433 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.427+0000 7f0274462700 1 --2- 172.21.15.42:0/2087791032 >> [v2:172.21.15.42:6808/24881,v1:172.21.15.42:6809/24881] conn(0x7f02480015d0 0x7f0248003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:30.433 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.427+0000 7f0274462700 1 -- 172.21.15.42:0/2087791032 --> [v2:172.21.15.42:6808/24881,v1:172.21.15.42:6809/24881] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f02480066e0 con 0x7f02480015d0 2020-04-02T23:39:30.433 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.430+0000 7f02719fd700 1 --2- 172.21.15.42:0/2087791032 >> [v2:172.21.15.42:6808/24881,v1:172.21.15.42:6809/24881] conn(0x7f02480015d0 0x7f0248003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:30.433 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.430+0000 7f02719fd700 1 --2- 172.21.15.42:0/2087791032 >> [v2:172.21.15.42:6808/24881,v1:172.21.15.42:6809/24881] conn(0x7f02480015d0 0x7f0248003a90 crc :-1 s=READY pgs=9 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:30.436 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.433+0000 7f02637fe700 1 -- 172.21.15.42:0/2087791032 <== osd.1 v2:172.21.15.42:6808/24881 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f02480066e0 con 0x7f02480015d0 2020-04-02T23:39:30.457 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.454+0000 7f0274462700 1 -- 172.21.15.42:0/2087791032 --> [v2:172.21.15.42:6808/24881,v1:172.21.15.42:6809/24881] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f02480057b0 con 0x7f02480015d0 2020-04-02T23:39:30.466 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.459+0000 7f02637fe700 1 -- 172.21.15.42:0/2087791032 <== osd.1 v2:172.21.15.42:6808/24881 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f02480057b0 con 0x7f02480015d0 2020-04-02T23:39:30.466 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2020-04-02T23:39:30.467 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-04-02T23:39:30.467 INFO:teuthology.orchestra.run.smithi042.stdout:} 2020-04-02T23:39:30.473 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.470+0000 7f0274462700 1 -- 172.21.15.42:0/2087791032 >> [v2:172.21.15.42:6808/24881,v1:172.21.15.42:6809/24881] conn(0x7f02480015d0 msgr2=0x7f0248003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:30.473 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.471+0000 7f0274462700 1 --2- 172.21.15.42:0/2087791032 >> [v2:172.21.15.42:6808/24881,v1:172.21.15.42:6809/24881] conn(0x7f02480015d0 0x7f0248003a90 crc :-1 s=READY pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:30.474 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.471+0000 7f0274462700 1 -- 172.21.15.42:0/2087791032 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f025404d600 msgr2=0x7f025404fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:30.474 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.471+0000 7f0274462700 1 --2- 172.21.15.42:0/2087791032 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f025404d600 0x7f025404fac0 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7f0268000f50 tx=0x7f0268001590).stop 2020-04-02T23:39:30.475 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.471+0000 7f0274462700 1 -- 172.21.15.42:0/2087791032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c062890 msgr2=0x7f026c0610f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:30.475 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.471+0000 7f0274462700 1 --2- 172.21.15.42:0/2087791032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c062890 0x7f026c0610f0 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7f026c0ab500 tx=0x7f0264010f20).stop 2020-04-02T23:39:30.475 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.471+0000 7f02729ff700 1 -- 172.21.15.42:0/2087791032 reap_dead start 2020-04-02T23:39:30.484 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.481+0000 7f0274462700 1 -- 172.21.15.42:0/2087791032 shutdown_connections 2020-04-02T23:39:30.484 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.481+0000 7f0274462700 1 --2- 172.21.15.42:0/2087791032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c062890 0x7f026c0610f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:30.485 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.481+0000 7f0274462700 1 -- 172.21.15.42:0/2087791032 >> 172.21.15.42:0/2087791032 conn(0x7f026c05ac50 msgr2=0x7f026c0a3970 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:30.485 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.482+0000 7f0274462700 1 -- 172.21.15.42:0/2087791032 shutdown_connections 2020-04-02T23:39:30.487 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.484+0000 7f0274462700 1 -- 172.21.15.42:0/2087791032 wait complete. 2020-04-02T23:39:30.515 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:30.574 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 1 2020-04-02T23:39:30.851 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.848+0000 7f322ae0c700 1 Processor -- start 2020-04-02T23:39:30.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.853+0000 7f322ae0c700 1 -- start start 2020-04-02T23:39:30.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.854+0000 7f322ae0c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f32240ac310 0x7f32240a9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:30.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.854+0000 7f322ae0c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3224132bb0 0x7f3224138b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:30.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.854+0000 7f322ae0c700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3224138f90 con 0x7f3224138680 2020-04-02T23:39:30.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.854+0000 7f322ae0c700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32240ab660 con 0x7f3224132bb0 2020-04-02T23:39:30.857 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.854+0000 7f322ae0c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32240a6180 con 0x7f32240ac310 2020-04-02T23:39:30.862 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.854+0000 7f3223fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f3224138680 0x7f32241324a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60160/0 (socket says 172.21.15.42:60160) 2020-04-02T23:39:30.862 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.854+0000 7f3223fff700 1 -- 172.21.15.42:0/1159304278 learned_addr learned my addr 172.21.15.42:0/1159304278 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:30.863 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.855+0000 7f32293a9700 1 --2- 172.21.15.42:0/1159304278 >> v2:172.21.15.42:3300/0 conn(0x7f3224132bb0 0x7f3224138b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:30.863 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.855+0000 7f32293a9700 1 -- 172.21.15.42:0/1159304278 >> v2:172.21.15.84:3300/0 conn(0x7f32240ac310 msgr2=0x7f32240a9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:30.863 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.855+0000 7f32293a9700 1 --2- 172.21.15.42:0/1159304278 >> v2:172.21.15.84:3300/0 conn(0x7f32240ac310 0x7f32240a9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:30.863 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.855+0000 7f32293a9700 1 -- 172.21.15.42:0/1159304278 >> v1:172.21.15.42:6789/0 conn(0x7f3224138680 legacy=0x7f32241324a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:30.863 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.855+0000 7f32293a9700 1 -- 172.21.15.42:0/1159304278 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32240a6420 con 0x7f3224132bb0 2020-04-02T23:39:30.863 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.855+0000 7f32293a9700 1 --2- 172.21.15.42:0/1159304278 >> v2:172.21.15.42:3300/0 conn(0x7f3224132bb0 0x7f3224138b30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f321c0032b0 tx=0x7f321c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.863 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.855+0000 7f32293a9700 1 --2- 172.21.15.42:0/1159304278 >> v2:172.21.15.42:3300/0 conn(0x7f3224132bb0 0x7f3224138b30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f321c0032b0 tx=0x7f321c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.864 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.855+0000 7f32293a9700 1 --2- 172.21.15.42:0/1159304278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3224132bb0 0x7f3224138b30 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7f321c0032b0 tx=0x7f321c007dc0).ready entity=mon.0 client_cookie=f32b5ec57c0c4128 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:30.864 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.855+0000 7f32293a9700 1 --2- 172.21.15.42:0/1159304278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3224132bb0 0x7f3224138b30 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f321c0032b0 tx=0x7f321c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.864 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.856+0000 7f32293a9700 1 --2- 172.21.15.42:0/1159304278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3224132bb0 0x7f3224138b30 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f321c0032b0 tx=0x7f321c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.864 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.856+0000 7f32293a9700 1 --2- 172.21.15.42:0/1159304278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3224132bb0 0x7f3224138b30 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7f321c0032b0 tx=0x7f321c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.864 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.856+0000 7f32237fe700 1 -- 172.21.15.42:0/1159304278 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f321c00a160 con 0x7f3224132bb0 2020-04-02T23:39:30.864 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.856+0000 7f32237fe700 1 -- 172.21.15.42:0/1159304278 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321c00a2c0 con 0x7f3224132bb0 2020-04-02T23:39:30.864 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.856+0000 7f322ae0c700 1 -- 172.21.15.42:0/1159304278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3224132bb0 msgr2=0x7f3224138b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:30.865 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.856+0000 7f322ae0c700 1 --2- 172.21.15.42:0/1159304278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3224132bb0 0x7f3224138b30 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7f321c0032b0 tx=0x7f321c007dc0).stop 2020-04-02T23:39:30.872 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.869+0000 7f322ae0c700 1 -- 172.21.15.42:0/1159304278 shutdown_connections 2020-04-02T23:39:30.872 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.869+0000 7f322ae0c700 1 --2- 172.21.15.42:0/1159304278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3224132bb0 0x7f3224138b30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:30.872 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.869+0000 7f322ae0c700 1 --2- 172.21.15.42:0/1159304278 >> v2:172.21.15.84:3300/0 conn(0x7f32240ac310 0x7f32240a9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:30.872 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.869+0000 7f322ae0c700 1 -- 172.21.15.42:0/1159304278 >> 172.21.15.42:0/1159304278 conn(0x7f3224060980 msgr2=0x7f32240ab880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:30.873 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.870+0000 7f322ae0c700 1 -- 172.21.15.42:0/1159304278 shutdown_connections 2020-04-02T23:39:30.873 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.870+0000 7f322ae0c700 1 -- 172.21.15.42:0/1159304278 wait complete. 2020-04-02T23:39:30.874 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.871+0000 7f322ae0c700 1 Processor -- start 2020-04-02T23:39:30.874 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.872+0000 7f322ae0c700 1 -- start start 2020-04-02T23:39:30.875 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.872+0000 7f322ae0c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3224132bb0 0x7f3224145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:30.875 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.872+0000 7f322ae0c700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32241331c0 con 0x7f32240ac310 2020-04-02T23:39:30.875 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.872+0000 7f322ae0c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3224133460 con 0x7f3224138680 2020-04-02T23:39:30.875 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.872+0000 7f322ae0c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3224146250 con 0x7f3224132bb0 2020-04-02T23:39:30.876 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.873+0000 7f3228ba8700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f32240ac310 0x7f32241358e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60166/0 (socket says 172.21.15.42:60166) 2020-04-02T23:39:30.876 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.873+0000 7f3228ba8700 1 -- 172.21.15.42:0/2075840243 learned_addr learned my addr 172.21.15.42:0/2075840243 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:30.877 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.873+0000 7f3223fff700 1 --2- 172.21.15.42:0/2075840243 >> v2:172.21.15.84:3300/0 conn(0x7f3224132bb0 0x7f3224145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:30.877 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.873+0000 7f3223fff700 1 -- 172.21.15.42:0/2075840243 >> v1:172.21.15.84:6789/0 conn(0x7f3224138680 legacy=0x7f322413bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:30.877 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.873+0000 7f3223fff700 1 -- 172.21.15.42:0/2075840243 >> v1:172.21.15.42:6789/0 conn(0x7f32240ac310 legacy=0x7f32241358e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:30.877 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.873+0000 7f3223fff700 1 -- 172.21.15.42:0/2075840243 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3224133a80 con 0x7f3224132bb0 2020-04-02T23:39:30.877 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.873+0000 7f3223fff700 1 --2- 172.21.15.42:0/2075840243 >> v2:172.21.15.84:3300/0 conn(0x7f3224132bb0 0x7f3224145df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f32241383c0 tx=0x7f3218010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.877 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.873+0000 7f3223fff700 1 --2- 172.21.15.42:0/2075840243 >> v2:172.21.15.84:3300/0 conn(0x7f3224132bb0 0x7f3224145df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f32241383c0 tx=0x7f3218010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.878 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.873+0000 7f3223fff700 1 --2- 172.21.15.42:0/2075840243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3224132bb0 0x7f3224145df0 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f32241383c0 tx=0x7f3218010940).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:30.878 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.874+0000 7f3223fff700 1 --2- 172.21.15.42:0/2075840243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3224132bb0 0x7f3224145df0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f32241383c0 tx=0x7f3218010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.878 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.874+0000 7f3223fff700 1 --2- 172.21.15.42:0/2075840243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3224132bb0 0x7f3224145df0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f32241383c0 tx=0x7f3218010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.878 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.874+0000 7f3223fff700 1 --2- 172.21.15.42:0/2075840243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3224132bb0 0x7f3224145df0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f32241383c0 tx=0x7f3218010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.879 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.875+0000 7f3221ffb700 1 -- 172.21.15.42:0/2075840243 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3218005d90 con 0x7f3224132bb0 2020-04-02T23:39:30.879 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.875+0000 7f3221ffb700 1 -- 172.21.15.42:0/2075840243 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32180060c0 con 0x7f3224132bb0 2020-04-02T23:39:30.879 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.875+0000 7f322ae0c700 1 -- 172.21.15.42:0/2075840243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3224137e10 con 0x7f3224132bb0 2020-04-02T23:39:30.879 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.875+0000 7f322ae0c700 1 -- 172.21.15.42:0/2075840243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322413c3f0 con 0x7f3224132bb0 2020-04-02T23:39:30.879 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.875+0000 7f3221ffb700 1 -- 172.21.15.42:0/2075840243 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32180064e0 con 0x7f3224132bb0 2020-04-02T23:39:30.880 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.876+0000 7f3223fff700 1 --2- 172.21.15.42:0/2075840243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3224132bb0 0x7f3224145df0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f32241383c0 tx=0x7f3218010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.880 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.877+0000 7f3223fff700 1 --2- 172.21.15.42:0/2075840243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3224132bb0 0x7f3224145df0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f32241383c0 tx=0x7f3218010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.885 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.880+0000 7f3221ffb700 1 -- 172.21.15.42:0/2075840243 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f3218006640 con 0x7f3224132bb0 2020-04-02T23:39:30.886 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.880+0000 7f3221ffb700 1 --2- 172.21.15.42:0/2075840243 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f320404d6c0 0x7f320404fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:30.886 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.880+0000 7f3221ffb700 1 -- 172.21.15.42:0/2075840243 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f3218060f00 con 0x7f3224132bb0 2020-04-02T23:39:30.886 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.881+0000 7f3228ba8700 1 --2- 172.21.15.42:0/2075840243 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f320404d6c0 0x7f320404fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:30.886 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.881+0000 7f322ae0c700 1 -- 172.21.15.42:0/2075840243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3200003340 con 0x7f3224132bb0 2020-04-02T23:39:30.886 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.881+0000 7f3228ba8700 1 --2- 172.21.15.42:0/2075840243 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f320404d6c0 0x7f320404fb80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3214002f30 tx=0x7f3214002450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.886 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.882+0000 7f3228ba8700 1 --2- 172.21.15.42:0/2075840243 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f320404d6c0 0x7f320404fb80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3214002f30 tx=0x7f3214002450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.886 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.882+0000 7f3228ba8700 1 --2- 172.21.15.42:0/2075840243 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f320404d6c0 0x7f320404fb80 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7f3214002f30 tx=0x7f3214002450).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:30.897 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.894+0000 7f3223fff700 1 --2- 172.21.15.42:0/2075840243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3224132bb0 0x7f3224145df0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7f32241383c0 tx=0x7f3218010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:30.904 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:30.899+0000 7f3221ffb700 1 -- 172.21.15.42:0/2075840243 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f321803c5c0 con 0x7f3224132bb0 2020-04-02T23:39:31.237 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.234+0000 7f322ae0c700 1 -- 172.21.15.42:0/2075840243 --> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3200002150 con 0x7f320404d6c0 2020-04-02T23:39:31.238 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.234+0000 7f3228ba8700 1 --2- 172.21.15.42:0/2075840243 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f320404d6c0 0x7f320404fb80 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f3214002f30 tx=0x7f3214002450).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:31.238 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.234+0000 7f3221ffb700 1 -- 172.21.15.42:0/2075840243 <== mgr.4100 v2:172.21.15.84:6800/23437 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3200002150 con 0x7f320404d6c0 2020-04-02T23:39:31.239 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.236+0000 7f322ae0c700 1 -- 172.21.15.42:0/2075840243 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f320404d6c0 msgr2=0x7f320404fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:31.239 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.236+0000 7f322ae0c700 1 --2- 172.21.15.42:0/2075840243 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f320404d6c0 0x7f320404fb80 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7f3214002f30 tx=0x7f3214002450).stop 2020-04-02T23:39:31.240 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.236+0000 7f322ae0c700 1 -- 172.21.15.42:0/2075840243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3224132bb0 msgr2=0x7f3224145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:31.240 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.236+0000 7f322ae0c700 1 --2- 172.21.15.42:0/2075840243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3224132bb0 0x7f3224145df0 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7f32241383c0 tx=0x7f3218010940).stop 2020-04-02T23:39:31.248 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.245+0000 7f322ae0c700 1 -- 172.21.15.42:0/2075840243 shutdown_connections 2020-04-02T23:39:31.248 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.245+0000 7f322ae0c700 1 --2- 172.21.15.42:0/2075840243 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f320404d6c0 0x7f320404fb80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:31.249 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.246+0000 7f322ae0c700 1 --2- 172.21.15.42:0/2075840243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3224132bb0 0x7f3224145df0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:31.249 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.246+0000 7f322ae0c700 1 -- 172.21.15.42:0/2075840243 >> 172.21.15.42:0/2075840243 conn(0x7f3224060980 msgr2=0x7f32240ab7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:31.253 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.248+0000 7f322ae0c700 1 -- 172.21.15.42:0/2075840243 shutdown_connections 2020-04-02T23:39:31.254 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.248+0000 7f322ae0c700 1 -- 172.21.15.42:0/2075840243 wait complete. 2020-04-02T23:39:31.256 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 1 to deep-scrub 2020-04-02T23:39:31.270 INFO:tasks.ceph:Scrubbing osd.2 2020-04-02T23:39:31.271 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:31.325 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 config set osd_debug_deep_scrub_sleep 0 2020-04-02T23:39:31.577 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.574+0000 7f5923426700 1 Processor -- start 2020-04-02T23:39:31.577 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.574+0000 7f5923426700 1 -- start start 2020-04-02T23:39:31.580 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.575+0000 7f5923426700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f591c0a1cd0 0x7f591c0a6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:31.580 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.575+0000 7f5923426700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f591c0a20b0 0x7f591c0a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:31.580 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.575+0000 7f5923426700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f591c0a5250 0x7f591c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:31.580 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.575+0000 7f5923426700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f591c0a2680 con 0x7f591c0a5250 2020-04-02T23:39:31.580 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.575+0000 7f5923426700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f591c09a8f0 con 0x7f591c0a1cd0 2020-04-02T23:39:31.580 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.575+0000 7f5923426700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c09ab90 con 0x7f591c0a20b0 2020-04-02T23:39:31.581 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.575+0000 7f59211c2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f591c0a1cd0 0x7f591c0a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:31.581 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.575+0000 7f59211c2700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f591c0a1cd0 0x7f591c0a6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.42:35240/0 (socket says 172.21.15.42:35240) 2020-04-02T23:39:31.581 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.575+0000 7f59211c2700 1 -- 172.21.15.42:0/2385526327 learned_addr learned my addr 172.21.15.42:0/2385526327 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:39:31.581 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.575+0000 7f59219c3700 1 --2- 172.21.15.42:0/2385526327 >> v2:172.21.15.42:3300/0 conn(0x7f591c0a5250 0x7f591c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:31.581 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.575+0000 7f59209c1700 1 --2- 172.21.15.42:0/2385526327 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f591c0a20b0 0x7f591c0a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:31.581 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.575+0000 7f59219c3700 1 -- 172.21.15.42:0/2385526327 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f591c0a20b0 msgr2=0x7f591c0a67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:31.581 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.575+0000 7f59219c3700 1 --2- 172.21.15.42:0/2385526327 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f591c0a20b0 0x7f591c0a67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:31.582 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.575+0000 7f59219c3700 1 -- 172.21.15.42:0/2385526327 >> v2:172.21.15.84:3300/0 conn(0x7f591c0a1cd0 msgr2=0x7f591c0a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:31.582 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.575+0000 7f59219c3700 1 --2- 172.21.15.42:0/2385526327 >> v2:172.21.15.84:3300/0 conn(0x7f591c0a1cd0 0x7f591c0a6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:31.582 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.575+0000 7f59219c3700 1 -- 172.21.15.42:0/2385526327 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c09ae30 con 0x7f591c0a5250 2020-04-02T23:39:31.582 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.575+0000 7f59211c2700 1 --2- 172.21.15.42:0/2385526327 >> v2:172.21.15.84:3300/0 conn(0x7f591c0a1cd0 0x7f591c0a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:39:31.582 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.575+0000 7f59219c3700 1 --2- 172.21.15.42:0/2385526327 >> v2:172.21.15.42:3300/0 conn(0x7f591c0a5250 0x7f591c0a5700 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f590c002f30 tx=0x7f590c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:31.582 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.576+0000 7f59219c3700 1 --2- 172.21.15.42:0/2385526327 >> v2:172.21.15.42:3300/0 conn(0x7f591c0a5250 0x7f591c0a5700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f590c002f30 tx=0x7f590c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:31.582 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.576+0000 7f59219c3700 1 --2- 172.21.15.42:0/2385526327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f591c0a5250 0x7f591c0a5700 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7f590c002f30 tx=0x7f590c007a40).ready entity=mon.0 client_cookie=9208b9b72d90b53c server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:31.582 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.576+0000 7f59219c3700 1 --2- 172.21.15.42:0/2385526327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f591c0a5250 0x7f591c0a5700 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7f590c002f30 tx=0x7f590c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:31.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.576+0000 7f59219c3700 1 --2- 172.21.15.42:0/2385526327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f591c0a5250 0x7f591c0a5700 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7f590c002f30 tx=0x7f590c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:31.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.576+0000 7f59219c3700 1 --2- 172.21.15.42:0/2385526327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f591c0a5250 0x7f591c0a5700 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7f590c002f30 tx=0x7f590c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:31.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.576+0000 7f590bfff700 1 -- 172.21.15.42:0/2385526327 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f590c012420 con 0x7f591c0a5250 2020-04-02T23:39:31.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.576+0000 7f590bfff700 1 -- 172.21.15.42:0/2385526327 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590c012580 con 0x7f591c0a5250 2020-04-02T23:39:31.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.576+0000 7f590bfff700 1 -- 172.21.15.42:0/2385526327 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f590c012960 con 0x7f591c0a5250 2020-04-02T23:39:31.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.577+0000 7f5923426700 1 -- 172.21.15.42:0/2385526327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f591c0a5250 msgr2=0x7f591c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:31.583 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.577+0000 7f5923426700 1 --2- 172.21.15.42:0/2385526327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f591c0a5250 0x7f591c0a5700 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7f590c002f30 tx=0x7f590c007a40).stop 2020-04-02T23:39:31.584 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.577+0000 7f5923426700 1 -- 172.21.15.42:0/2385526327 shutdown_connections 2020-04-02T23:39:31.585 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.577+0000 7f5923426700 1 --2- 172.21.15.42:0/2385526327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f591c0a5250 0x7f591c0a5700 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:31.585 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.577+0000 7f5923426700 1 --2- 172.21.15.42:0/2385526327 >> v2:172.21.15.84:3300/0 conn(0x7f591c0a1cd0 0x7f591c0a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:31.585 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.577+0000 7f5923426700 1 --2- 172.21.15.42:0/2385526327 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f591c0a20b0 0x7f591c0a67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:31.585 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.577+0000 7f5923426700 1 -- 172.21.15.42:0/2385526327 >> 172.21.15.42:0/2385526327 conn(0x7f591c05b720 msgr2=0x7f591c0aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:31.586 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.577+0000 7f5923426700 1 -- 172.21.15.42:0/2385526327 shutdown_connections 2020-04-02T23:39:31.586 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.577+0000 7f5923426700 1 -- 172.21.15.42:0/2385526327 wait complete. 2020-04-02T23:39:31.586 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.579+0000 7f5923426700 1 Processor -- start 2020-04-02T23:39:31.586 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.581+0000 7f5923426700 1 -- start start 2020-04-02T23:39:31.587 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.582+0000 7f5923426700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f591c0a5250 0x7f591c156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:31.587 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.582+0000 7f5923426700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591c05f220 con 0x7f591c0a20b0 2020-04-02T23:39:31.587 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.582+0000 7f5923426700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591c1560b0 con 0x7f591c0a1cd0 2020-04-02T23:39:31.587 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.582+0000 7f5923426700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f591c09dd40 con 0x7f591c0a5250 2020-04-02T23:39:31.587 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.582+0000 7f59211c2700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f591c0a1cd0 0x7f591c1476d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:54558/0 (socket says 172.21.15.42:54558) 2020-04-02T23:39:31.587 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.582+0000 7f59211c2700 1 -- 172.21.15.42:0/3496816208 learned_addr learned my addr 172.21.15.42:0/3496816208 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:31.588 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.584+0000 7f59219c3700 1 --2- 172.21.15.42:0/3496816208 >> v2:172.21.15.42:3300/0 conn(0x7f591c0a5250 0x7f591c156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:31.588 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.585+0000 7f59219c3700 1 -- 172.21.15.42:0/3496816208 >> v1:172.21.15.84:6789/0 conn(0x7f591c0a1cd0 legacy=0x7f591c1476d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:31.589 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.585+0000 7f59219c3700 1 -- 172.21.15.42:0/3496816208 >> v1:172.21.15.42:6789/0 conn(0x7f591c0a20b0 legacy=0x7f591c15b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:31.589 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.585+0000 7f59219c3700 1 -- 172.21.15.42:0/3496816208 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c156350 con 0x7f591c0a5250 2020-04-02T23:39:31.589 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.585+0000 7f59219c3700 1 --2- 172.21.15.42:0/3496816208 >> v2:172.21.15.42:3300/0 conn(0x7f591c0a5250 0x7f591c156a90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f59140032b0 tx=0x7f590c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:31.589 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.585+0000 7f59219c3700 1 --2- 172.21.15.42:0/3496816208 >> v2:172.21.15.42:3300/0 conn(0x7f591c0a5250 0x7f591c156a90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f59140032b0 tx=0x7f590c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:31.589 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.585+0000 7f59219c3700 1 --2- 172.21.15.42:0/3496816208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f591c0a5250 0x7f591c156a90 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7f59140032b0 tx=0x7f590c007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:31.590 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.585+0000 7f59219c3700 1 --2- 172.21.15.42:0/3496816208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f591c0a5250 0x7f591c156a90 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7f59140032b0 tx=0x7f590c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:31.590 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.585+0000 7f59219c3700 1 --2- 172.21.15.42:0/3496816208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f591c0a5250 0x7f591c156a90 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7f59140032b0 tx=0x7f590c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:31.590 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.585+0000 7f59219c3700 1 --2- 172.21.15.42:0/3496816208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f591c0a5250 0x7f591c156a90 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7f59140032b0 tx=0x7f590c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:31.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.588+0000 7f590a7fc700 1 -- 172.21.15.42:0/3496816208 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f590c012bc0 con 0x7f591c0a5250 2020-04-02T23:39:31.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.588+0000 7f590a7fc700 1 -- 172.21.15.42:0/3496816208 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590c012d20 con 0x7f591c0a5250 2020-04-02T23:39:31.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.588+0000 7f5923426700 1 -- 172.21.15.42:0/3496816208 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f591c1565f0 con 0x7f591c0a5250 2020-04-02T23:39:31.591 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.588+0000 7f590a7fc700 1 -- 172.21.15.42:0/3496816208 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f590c012e90 con 0x7f591c0a5250 2020-04-02T23:39:31.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.588+0000 7f5923426700 1 -- 172.21.15.42:0/3496816208 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591c147de0 con 0x7f591c0a5250 2020-04-02T23:39:31.592 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.590+0000 7f59219c3700 1 --2- 172.21.15.42:0/3496816208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f591c0a5250 0x7f591c156a90 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7f59140032b0 tx=0x7f590c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:31.593 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.590+0000 7f590a7fc700 1 -- 172.21.15.42:0/3496816208 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f590c007340 con 0x7f591c0a5250 2020-04-02T23:39:31.594 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.590+0000 7f59219c3700 1 --2- 172.21.15.42:0/3496816208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f591c0a5250 0x7f591c156a90 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7f59140032b0 tx=0x7f590c007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:31.594 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.591+0000 7f590a7fc700 1 --2- 172.21.15.42:0/3496816208 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f58fc04d6b0 0x7f58fc04fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:31.594 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.591+0000 7f590a7fc700 1 -- 172.21.15.42:0/3496816208 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f590c063be0 con 0x7f591c0a5250 2020-04-02T23:39:31.594 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.591+0000 7f59211c2700 1 --2- 172.21.15.42:0/3496816208 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f58fc04d6b0 0x7f58fc04fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:31.595 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.591+0000 7f59211c2700 1 --2- 172.21.15.42:0/3496816208 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f58fc04d6b0 0x7f58fc04fb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5914007e00 tx=0x7f5914009790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:31.606 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.594+0000 7f5923426700 1 --2- 172.21.15.42:0/3496816208 >> [v2:172.21.15.42:6816/24917,v1:172.21.15.42:6817/24917] conn(0x7f591c09b030 0x7f591c14a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:31.606 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.594+0000 7f5923426700 1 -- 172.21.15.42:0/3496816208 --> [v2:172.21.15.42:6816/24917,v1:172.21.15.42:6817/24917] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f591c056c50 con 0x7f591c09b030 2020-04-02T23:39:31.607 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.595+0000 7f59211c2700 1 --2- 172.21.15.42:0/3496816208 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f58fc04d6b0 0x7f58fc04fb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5914007e00 tx=0x7f5914009790).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:31.607 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.595+0000 7f59211c2700 1 --2- 172.21.15.42:0/3496816208 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f58fc04d6b0 0x7f58fc04fb70 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f5914007e00 tx=0x7f5914009790).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:31.607 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.596+0000 7f59209c1700 1 --2- 172.21.15.42:0/3496816208 >> [v2:172.21.15.42:6816/24917,v1:172.21.15.42:6817/24917] conn(0x7f591c09b030 0x7f591c14a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:31.607 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.596+0000 7f59209c1700 1 --2- 172.21.15.42:0/3496816208 >> [v2:172.21.15.42:6816/24917,v1:172.21.15.42:6817/24917] conn(0x7f591c09b030 0x7f591c14a590 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:31.607 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.597+0000 7f590a7fc700 1 -- 172.21.15.42:0/3496816208 <== osd.2 v2:172.21.15.42:6816/24917 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f591c056c50 con 0x7f591c09b030 2020-04-02T23:39:31.646 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.643+0000 7f5923426700 1 -- 172.21.15.42:0/3496816208 --> [v2:172.21.15.42:6816/24917,v1:172.21.15.42:6817/24917] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f591c05cda0 con 0x7f591c09b030 2020-04-02T23:39:31.646 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.643+0000 7f590a7fc700 1 -- 172.21.15.42:0/3496816208 <== osd.2 v2:172.21.15.42:6816/24917 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f591c05cda0 con 0x7f591c09b030 2020-04-02T23:39:31.647 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.644+0000 7f5923426700 1 -- 172.21.15.42:0/3496816208 >> [v2:172.21.15.42:6816/24917,v1:172.21.15.42:6817/24917] conn(0x7f591c09b030 msgr2=0x7f591c14a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:31.647 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.644+0000 7f5923426700 1 --2- 172.21.15.42:0/3496816208 >> [v2:172.21.15.42:6816/24917,v1:172.21.15.42:6817/24917] conn(0x7f591c09b030 0x7f591c14a590 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:31.647 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2020-04-02T23:39:31.648 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-04-02T23:39:31.648 INFO:teuthology.orchestra.run.smithi042.stdout:} 2020-04-02T23:39:31.648 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.644+0000 7f5923426700 1 -- 172.21.15.42:0/3496816208 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f58fc04d6b0 msgr2=0x7f58fc04fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:31.648 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.644+0000 7f5923426700 1 --2- 172.21.15.42:0/3496816208 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f58fc04d6b0 0x7f58fc04fb70 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7f5914007e00 tx=0x7f5914009790).stop 2020-04-02T23:39:31.648 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.644+0000 7f5923426700 1 -- 172.21.15.42:0/3496816208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f591c0a5250 msgr2=0x7f591c156a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:31.649 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.644+0000 7f5923426700 1 --2- 172.21.15.42:0/3496816208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f591c0a5250 0x7f591c156a90 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7f59140032b0 tx=0x7f590c007a40).stop 2020-04-02T23:39:31.653 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.650+0000 7f59219c3700 1 -- 172.21.15.42:0/3496816208 reap_dead start 2020-04-02T23:39:31.653 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.650+0000 7f5923426700 1 -- 172.21.15.42:0/3496816208 shutdown_connections 2020-04-02T23:39:31.653 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.650+0000 7f5923426700 1 --2- 172.21.15.42:0/3496816208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f591c0a5250 0x7f591c156a90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:31.653 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.650+0000 7f5923426700 1 -- 172.21.15.42:0/3496816208 >> 172.21.15.42:0/3496816208 conn(0x7f591c05b720 msgr2=0x7f591c0a9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:31.658 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.655+0000 7f5923426700 1 -- 172.21.15.42:0/3496816208 shutdown_connections 2020-04-02T23:39:31.662 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:31.659+0000 7f5923426700 1 -- 172.21.15.42:0/3496816208 wait complete. 2020-04-02T23:39:31.690 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:31.758 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 2 2020-04-02T23:39:32.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.035+0000 7f1741414700 1 Processor -- start 2020-04-02T23:39:32.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.035+0000 7f1741414700 1 -- start start 2020-04-02T23:39:32.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.036+0000 7f1741414700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f173c0802f0 0x7f173c09a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:32.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.036+0000 7f1741414700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f173c09a6e0 0x7f173c09ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:32.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.036+0000 7f1741414700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f173c0a35b0 con 0x7f173c0a2190 2020-04-02T23:39:32.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.036+0000 7f1741414700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f173c0a68d0 con 0x7f173c09a6e0 2020-04-02T23:39:32.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.036+0000 7f1741414700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173c0a72f0 con 0x7f173c0802f0 2020-04-02T23:39:32.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.036+0000 7f173affd700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f173c0a2190 0x7f173c0a5250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60190/0 (socket says 172.21.15.42:60190) 2020-04-02T23:39:32.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.036+0000 7f173affd700 1 -- 172.21.15.42:0/119233267 learned_addr learned my addr 172.21.15.42:0/119233267 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:32.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.036+0000 7f173a7fc700 1 --2- 172.21.15.42:0/119233267 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f173c0802f0 0x7f173c09a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:32.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.039+0000 7f173a7fc700 1 -- 172.21.15.42:0/119233267 >> v2:172.21.15.42:3300/0 conn(0x7f173c09a6e0 msgr2=0x7f173c09ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.037+0000 7f1739ffb700 1 -- 172.21.15.42:0/119233267 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 139202347 0 0) 0x7f173c0a35b0 con 0x7f173c0a2190 2020-04-02T23:39:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.037+0000 7f173b7fe700 1 --2- 172.21.15.42:0/119233267 >> v2:172.21.15.42:3300/0 conn(0x7f173c09a6e0 0x7f173c09ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.040+0000 7f173a7fc700 1 --2- 172.21.15.42:0/119233267 >> v2:172.21.15.42:3300/0 conn(0x7f173c09a6e0 0x7f173c09ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.040+0000 7f173a7fc700 1 -- 172.21.15.42:0/119233267 >> v1:172.21.15.42:6789/0 conn(0x7f173c0a2190 legacy=0x7f173c0a5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.040+0000 7f173a7fc700 1 -- 172.21.15.42:0/119233267 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c0a7590 con 0x7f173c0802f0 2020-04-02T23:39:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.040+0000 7f173a7fc700 1 --2- 172.21.15.42:0/119233267 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f173c0802f0 0x7f173c09a280 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f17340032b0 tx=0x7f1734007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.040+0000 7f173b7fe700 1 --2- 172.21.15.42:0/119233267 >> v2:172.21.15.42:3300/0 conn(0x7f173c09a6e0 0x7f173c09ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-04-02T23:39:32.047 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.041+0000 7f173a7fc700 1 --2- 172.21.15.42:0/119233267 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f173c0802f0 0x7f173c09a280 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f17340032b0 tx=0x7f1734007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.041+0000 7f173a7fc700 1 --2- 172.21.15.42:0/119233267 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f173c0802f0 0x7f173c09a280 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f17340032b0 tx=0x7f1734007dc0).ready entity=mon.2 client_cookie=cf8503ae8d58c14b server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.041+0000 7f173a7fc700 1 --2- 172.21.15.42:0/119233267 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f173c0802f0 0x7f173c09a280 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f17340032b0 tx=0x7f1734007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.041+0000 7f173a7fc700 1 --2- 172.21.15.42:0/119233267 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f173c0802f0 0x7f173c09a280 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f17340032b0 tx=0x7f1734007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.041+0000 7f1739ffb700 1 -- 172.21.15.42:0/119233267 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1734010d80 con 0x7f173c0802f0 2020-04-02T23:39:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.041+0000 7f173a7fc700 1 --2- 172.21.15.42:0/119233267 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f173c0802f0 0x7f173c09a280 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f17340032b0 tx=0x7f1734007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.041+0000 7f1739ffb700 1 -- 172.21.15.42:0/119233267 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17340142d0 con 0x7f173c0802f0 2020-04-02T23:39:32.048 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.041+0000 7f1739ffb700 1 -- 172.21.15.42:0/119233267 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17340146b0 con 0x7f173c0802f0 2020-04-02T23:39:32.049 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.041+0000 7f1741414700 1 -- 172.21.15.42:0/119233267 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f173c0802f0 msgr2=0x7f173c09a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:32.049 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.041+0000 7f1741414700 1 --2- 172.21.15.42:0/119233267 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f173c0802f0 0x7f173c09a280 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f17340032b0 tx=0x7f1734007dc0).stop 2020-04-02T23:39:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.043+0000 7f1741414700 1 -- 172.21.15.42:0/119233267 shutdown_connections 2020-04-02T23:39:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.043+0000 7f1741414700 1 --2- 172.21.15.42:0/119233267 >> v2:172.21.15.42:3300/0 conn(0x7f173c09a6e0 0x7f173c09ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.043+0000 7f1741414700 1 --2- 172.21.15.42:0/119233267 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f173c0802f0 0x7f173c09a280 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.043+0000 7f1741414700 1 -- 172.21.15.42:0/119233267 >> 172.21.15.42:0/119233267 conn(0x7f173c05ac50 msgr2=0x7f173c05b060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.043+0000 7f1741414700 1 -- 172.21.15.42:0/119233267 shutdown_connections 2020-04-02T23:39:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.043+0000 7f1741414700 1 -- 172.21.15.42:0/119233267 wait complete. 2020-04-02T23:39:32.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.044+0000 7f1741414700 1 Processor -- start 2020-04-02T23:39:32.062 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.045+0000 7f1741414700 1 -- start start 2020-04-02T23:39:32.062 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.046+0000 7f1741414700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f173c0802f0 0x7f173c154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:32.062 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.046+0000 7f1741414700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f173c0a2190 0x7f173c155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:32.062 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.046+0000 7f1741414700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f173c0a0350 con 0x7f173c09a6e0 2020-04-02T23:39:32.062 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.046+0000 7f1741414700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f173c159040 con 0x7f173c0802f0 2020-04-02T23:39:32.062 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.046+0000 7f1741414700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f173c0a05f0 con 0x7f173c0a2190 2020-04-02T23:39:32.063 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.047+0000 7f173b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f173c0a2190 0x7f173c155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:32.063 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.047+0000 7f173b7fe700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f173c0a2190 0x7f173c155170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.42:35264/0 (socket says 172.21.15.42:35264) 2020-04-02T23:39:32.063 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.047+0000 7f173b7fe700 1 -- 172.21.15.42:0/703201087 learned_addr learned my addr 172.21.15.42:0/703201087 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:39:32.063 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.047+0000 7f173b7fe700 1 -- 172.21.15.42:0/703201087 >> v2:172.21.15.42:3300/0 conn(0x7f173c0802f0 msgr2=0x7f173c154d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-04-02T23:39:32.063 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.047+0000 7f173b7fe700 1 --2- 172.21.15.42:0/703201087 >> v2:172.21.15.42:3300/0 conn(0x7f173c0802f0 0x7f173c154d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:32.063 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.047+0000 7f173b7fe700 1 -- 172.21.15.42:0/703201087 >> v1:172.21.15.84:6789/0 conn(0x7f173c09a6e0 legacy=0x7f173c1638e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2020-04-02T23:39:32.063 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.047+0000 7f173b7fe700 1 -- 172.21.15.42:0/703201087 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c0a0890 con 0x7f173c0a2190 2020-04-02T23:39:32.064 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.047+0000 7f173b7fe700 1 --2- 172.21.15.42:0/703201087 >> v2:172.21.15.84:3300/0 conn(0x7f173c0a2190 0x7f173c155170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f173c09cec0 tx=0x7f1730010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.064 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.047+0000 7f173b7fe700 1 --2- 172.21.15.42:0/703201087 >> v2:172.21.15.84:3300/0 conn(0x7f173c0a2190 0x7f173c155170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f173c09cec0 tx=0x7f1730010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.064 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.047+0000 7f173b7fe700 1 --2- 172.21.15.42:0/703201087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f173c0a2190 0x7f173c155170 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f173c09cec0 tx=0x7f1730010af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:32.064 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.047+0000 7f173b7fe700 1 --2- 172.21.15.42:0/703201087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f173c0a2190 0x7f173c155170 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f173c09cec0 tx=0x7f1730010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.064 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.047+0000 7f172bfff700 1 -- 172.21.15.42:0/703201087 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1730005e90 con 0x7f173c0a2190 2020-04-02T23:39:32.064 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.048+0000 7f173b7fe700 1 --2- 172.21.15.42:0/703201087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f173c0a2190 0x7f173c155170 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f173c09cec0 tx=0x7f1730010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.064 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.048+0000 7f173b7fe700 1 --2- 172.21.15.42:0/703201087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f173c0a2190 0x7f173c155170 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f173c09cec0 tx=0x7f1730010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.064 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.048+0000 7f172bfff700 1 -- 172.21.15.42:0/703201087 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1730008aa0 con 0x7f173c0a2190 2020-04-02T23:39:32.065 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.048+0000 7f172bfff700 1 -- 172.21.15.42:0/703201087 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1730008e80 con 0x7f173c0a2190 2020-04-02T23:39:32.065 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.049+0000 7f1741414700 1 -- 172.21.15.42:0/703201087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f173c09d000 con 0x7f173c0a2190 2020-04-02T23:39:32.065 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.049+0000 7f1741414700 1 -- 172.21.15.42:0/703201087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173c1641b0 con 0x7f173c0a2190 2020-04-02T23:39:32.065 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.052+0000 7f173b7fe700 1 --2- 172.21.15.42:0/703201087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f173c0a2190 0x7f173c155170 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f173c09cec0 tx=0x7f1730010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.065 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.053+0000 7f173b7fe700 1 --2- 172.21.15.42:0/703201087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f173c0a2190 0x7f173c155170 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f173c09cec0 tx=0x7f1730010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.065 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.054+0000 7f172bfff700 1 -- 172.21.15.42:0/703201087 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f1730007160 con 0x7f173c0a2190 2020-04-02T23:39:32.065 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.055+0000 7f172bfff700 1 --2- 172.21.15.42:0/703201087 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f172004d6b0 0x7f172004fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:32.066 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.055+0000 7f172bfff700 1 -- 172.21.15.42:0/703201087 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1730060e90 con 0x7f173c0a2190 2020-04-02T23:39:32.066 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.057+0000 7f173affd700 1 --2- 172.21.15.42:0/703201087 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f172004d6b0 0x7f172004fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:32.066 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.057+0000 7f173affd700 1 --2- 172.21.15.42:0/703201087 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f172004d6b0 0x7f172004fb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f172c000b80 tx=0x7f172c0013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.066 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.057+0000 7f173affd700 1 --2- 172.21.15.42:0/703201087 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f172004d6b0 0x7f172004fb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f172c000b80 tx=0x7f172c0013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.066 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.057+0000 7f173affd700 1 --2- 172.21.15.42:0/703201087 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f172004d6b0 0x7f172004fb70 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f172c000b80 tx=0x7f172c0013a0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:32.080 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.062+0000 7f1741414700 1 -- 172.21.15.42:0/703201087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f173c056c50 con 0x7f173c0a2190 2020-04-02T23:39:32.081 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.073+0000 7f173b7fe700 1 --2- 172.21.15.42:0/703201087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f173c0a2190 0x7f173c155170 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f173c09cec0 tx=0x7f1730010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.081 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.073+0000 7f172bfff700 1 -- 172.21.15.42:0/703201087 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f173003c4f0 con 0x7f173c0a2190 2020-04-02T23:39:32.343 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.340+0000 7f1741414700 1 -- 172.21.15.42:0/703201087 --> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f173c05cda0 con 0x7f172004d6b0 2020-04-02T23:39:32.343 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.340+0000 7f173affd700 1 --2- 172.21.15.42:0/703201087 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f172004d6b0 0x7f172004fb70 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f172c000b80 tx=0x7f172c0013a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.343 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.340+0000 7f172bfff700 1 -- 172.21.15.42:0/703201087 <== mgr.4100 v2:172.21.15.84:6800/23437 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f173c05cda0 con 0x7f172004d6b0 2020-04-02T23:39:32.346 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.343+0000 7f1741414700 1 -- 172.21.15.42:0/703201087 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f172004d6b0 msgr2=0x7f172004fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:32.346 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.343+0000 7f1741414700 1 --2- 172.21.15.42:0/703201087 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f172004d6b0 0x7f172004fb70 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f172c000b80 tx=0x7f172c0013a0).stop 2020-04-02T23:39:32.346 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.343+0000 7f1741414700 1 -- 172.21.15.42:0/703201087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f173c0a2190 msgr2=0x7f173c155170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:32.347 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.343+0000 7f1741414700 1 --2- 172.21.15.42:0/703201087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f173c0a2190 0x7f173c155170 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f173c09cec0 tx=0x7f1730010af0).stop 2020-04-02T23:39:32.353 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.350+0000 7f1741414700 1 -- 172.21.15.42:0/703201087 shutdown_connections 2020-04-02T23:39:32.353 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.350+0000 7f1741414700 1 --2- 172.21.15.42:0/703201087 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f172004d6b0 0x7f172004fb70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:32.353 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.350+0000 7f1741414700 1 --2- 172.21.15.42:0/703201087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f173c0a2190 0x7f173c155170 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:32.353 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.350+0000 7f1741414700 1 --2- 172.21.15.42:0/703201087 >> v2:172.21.15.42:3300/0 conn(0x7f173c0802f0 0x7f173c154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:32.353 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.350+0000 7f1741414700 1 -- 172.21.15.42:0/703201087 >> 172.21.15.42:0/703201087 conn(0x7f173c05ac50 msgr2=0x7f173c0a3970 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:32.357 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.354+0000 7f1741414700 1 -- 172.21.15.42:0/703201087 shutdown_connections 2020-04-02T23:39:32.357 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.354+0000 7f1741414700 1 -- 172.21.15.42:0/703201087 wait complete. 2020-04-02T23:39:32.367 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 2 to deep-scrub 2020-04-02T23:39:32.382 INFO:tasks.ceph:Scrubbing osd.3 2020-04-02T23:39:32.382 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:32.430 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 config set osd_debug_deep_scrub_sleep 0 2020-04-02T23:39:32.701 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.693+0000 7fdce89ec700 1 Processor -- start 2020-04-02T23:39:32.701 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.693+0000 7fdce89ec700 1 -- start start 2020-04-02T23:39:32.702 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.694+0000 7fdce89ec700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdce40ab230 0x7fdce413c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:32.702 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.694+0000 7fdce89ec700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fdce413cca0 0x7fdce4140150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:32.702 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.694+0000 7fdce89ec700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce40a2ac0 con 0x7fdce41405b0 2020-04-02T23:39:32.702 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.694+0000 7fdce89ec700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce413d7e0 con 0x7fdce413cca0 2020-04-02T23:39:32.702 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.694+0000 7fdce89ec700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce413d2a0 con 0x7fdce40ab230 2020-04-02T23:39:32.703 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.694+0000 7fdce3fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdce41405b0 0x7fdce40a41a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:54580/0 (socket says 172.21.15.42:54580) 2020-04-02T23:39:32.703 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.694+0000 7fdce3fff700 1 -- 172.21.15.42:0/2565767911 learned_addr learned my addr 172.21.15.42:0/2565767911 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:32.703 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.696+0000 7fdce37fe700 1 --2- 172.21.15.42:0/2565767911 >> v2:172.21.15.84:3300/0 conn(0x7fdce40ab230 0x7fdce413c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:32.703 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.696+0000 7fdce2ffd700 1 --2- 172.21.15.42:0/2565767911 >> v2:172.21.15.42:3300/0 conn(0x7fdce413cca0 0x7fdce4140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:32.703 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.697+0000 7fdce2ffd700 1 -- 172.21.15.42:0/2565767911 >> v2:172.21.15.84:3300/0 conn(0x7fdce40ab230 msgr2=0x7fdce413c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:32.703 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.697+0000 7fdce2ffd700 1 --2- 172.21.15.42:0/2565767911 >> v2:172.21.15.84:3300/0 conn(0x7fdce40ab230 0x7fdce413c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:32.703 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.697+0000 7fdce2ffd700 1 -- 172.21.15.42:0/2565767911 >> v1:172.21.15.84:6789/0 conn(0x7fdce41405b0 legacy=0x7fdce40a41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:32.704 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.697+0000 7fdce2ffd700 1 -- 172.21.15.42:0/2565767911 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce413d540 con 0x7fdce413cca0 2020-04-02T23:39:32.704 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.697+0000 7fdce2ffd700 1 --2- 172.21.15.42:0/2565767911 >> v2:172.21.15.42:3300/0 conn(0x7fdce413cca0 0x7fdce4140150 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdcdc001450 tx=0x7fdcd8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.704 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.697+0000 7fdce2ffd700 1 --2- 172.21.15.42:0/2565767911 >> v2:172.21.15.42:3300/0 conn(0x7fdce413cca0 0x7fdce4140150 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdcdc001450 tx=0x7fdcd8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.704 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.697+0000 7fdce2ffd700 1 --2- 172.21.15.42:0/2565767911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdce413cca0 0x7fdce4140150 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7fdcdc001450 tx=0x7fdcd8007a40).ready entity=mon.0 client_cookie=59b47508460e9092 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:32.704 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.697+0000 7fdce2ffd700 1 --2- 172.21.15.42:0/2565767911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdce413cca0 0x7fdce4140150 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7fdcdc001450 tx=0x7fdcd8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.704 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.697+0000 7fdce2ffd700 1 --2- 172.21.15.42:0/2565767911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdce413cca0 0x7fdce4140150 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7fdcdc001450 tx=0x7fdcd8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.704 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.697+0000 7fdce2ffd700 1 --2- 172.21.15.42:0/2565767911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdce413cca0 0x7fdce4140150 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7fdcdc001450 tx=0x7fdcd8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.713 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.702+0000 7fdce27fc700 1 -- 172.21.15.42:0/2565767911 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcd8008d30 con 0x7fdce413cca0 2020-04-02T23:39:32.713 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.702+0000 7fdce27fc700 1 -- 172.21.15.42:0/2565767911 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd8008e90 con 0x7fdce413cca0 2020-04-02T23:39:32.714 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.702+0000 7fdce27fc700 1 -- 172.21.15.42:0/2565767911 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcd80119d0 con 0x7fdce413cca0 2020-04-02T23:39:32.714 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.706+0000 7fdce89ec700 1 -- 172.21.15.42:0/2565767911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdce413cca0 msgr2=0x7fdce4140150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:32.714 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.706+0000 7fdce89ec700 1 --2- 172.21.15.42:0/2565767911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdce413cca0 0x7fdce4140150 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7fdcdc001450 tx=0x7fdcd8007a40).stop 2020-04-02T23:39:32.718 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.714+0000 7fdce89ec700 1 -- 172.21.15.42:0/2565767911 shutdown_connections 2020-04-02T23:39:32.718 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.714+0000 7fdce89ec700 1 --2- 172.21.15.42:0/2565767911 >> v2:172.21.15.84:3300/0 conn(0x7fdce40ab230 0x7fdce413c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:32.718 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.714+0000 7fdce89ec700 1 --2- 172.21.15.42:0/2565767911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdce413cca0 0x7fdce4140150 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:32.718 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.714+0000 7fdce89ec700 1 -- 172.21.15.42:0/2565767911 >> 172.21.15.42:0/2565767911 conn(0x7fdce409dc40 msgr2=0x7fdce40aa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:32.719 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.716+0000 7fdce89ec700 1 -- 172.21.15.42:0/2565767911 shutdown_connections 2020-04-02T23:39:32.719 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.716+0000 7fdce89ec700 1 -- 172.21.15.42:0/2565767911 wait complete. 2020-04-02T23:39:32.725 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.717+0000 7fdce89ec700 1 Processor -- start 2020-04-02T23:39:32.725 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.717+0000 7fdce89ec700 1 -- start start 2020-04-02T23:39:32.726 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.718+0000 7fdce89ec700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdce40ab230 0x7fdce40a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:32.726 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.718+0000 7fdce89ec700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce413d9d0 con 0x7fdce413cca0 2020-04-02T23:39:32.726 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.718+0000 7fdce89ec700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce409e710 con 0x7fdce41405b0 2020-04-02T23:39:32.726 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.718+0000 7fdce89ec700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce4134580 con 0x7fdce40ab230 2020-04-02T23:39:32.726 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.718+0000 7fdce37fe700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdce40ab230 0x7fdce40a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:32.726 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.718+0000 7fdce3fff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdce41405b0 0x7fdce4133e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:54588/0 (socket says 172.21.15.42:54588) 2020-04-02T23:39:32.726 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.718+0000 7fdce3fff700 1 -- 172.21.15.42:0/2265362904 learned_addr learned my addr 172.21.15.42:0/2265362904 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:32.727 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.719+0000 7fdce37fe700 1 -- 172.21.15.42:0/2265362904 >> v1:172.21.15.84:6789/0 conn(0x7fdce41405b0 legacy=0x7fdce4133e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:32.727 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.719+0000 7fdce37fe700 1 -- 172.21.15.42:0/2265362904 >> v1:172.21.15.42:6789/0 conn(0x7fdce413cca0 legacy=0x7fdce4133760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-04-02T23:39:32.727 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.721+0000 7fdce37fe700 1 -- 172.21.15.42:0/2265362904 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce409f8d0 con 0x7fdce40ab230 2020-04-02T23:39:32.727 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.721+0000 7fdce37fe700 1 --2- 172.21.15.42:0/2265362904 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdce40ab230 0x7fdce40a0080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdce413c760 tx=0x7fdce40680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.727 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.721+0000 7fdce37fe700 1 --2- 172.21.15.42:0/2265362904 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdce40ab230 0x7fdce40a0080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdce413c760 tx=0x7fdce40680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.727 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.721+0000 7fdce37fe700 1 --2- 172.21.15.42:0/2265362904 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdce40ab230 0x7fdce40a0080 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7fdce413c760 tx=0x7fdce40680a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:32.727 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.721+0000 7fdce37fe700 1 --2- 172.21.15.42:0/2265362904 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdce40ab230 0x7fdce40a0080 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fdce413c760 tx=0x7fdce40680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.728 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.721+0000 7fdce37fe700 1 --2- 172.21.15.42:0/2265362904 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdce40ab230 0x7fdce40a0080 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fdce413c760 tx=0x7fdce40680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.728 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.721+0000 7fdce37fe700 1 --2- 172.21.15.42:0/2265362904 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdce40ab230 0x7fdce40a0080 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fdce413c760 tx=0x7fdce40680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.730 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.727+0000 7fdce0ff9700 1 -- 172.21.15.42:0/2265362904 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcd40120c0 con 0x7fdce40ab230 2020-04-02T23:39:32.731 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.727+0000 7fdce0ff9700 1 -- 172.21.15.42:0/2265362904 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd4013060 con 0x7fdce40ab230 2020-04-02T23:39:32.731 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.727+0000 7fdce0ff9700 1 -- 172.21.15.42:0/2265362904 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcd40056c0 con 0x7fdce40ab230 2020-04-02T23:39:32.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.728+0000 7fdce89ec700 1 -- 172.21.15.42:0/2265362904 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce409fb70 con 0x7fdce40ab230 2020-04-02T23:39:32.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.728+0000 7fdce89ec700 1 -- 172.21.15.42:0/2265362904 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce4138ee0 con 0x7fdce40ab230 2020-04-02T23:39:32.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.729+0000 7fdce89ec700 1 -- 172.21.15.42:0/2265362904 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdce409eb40 con 0x7fdce40ab230 2020-04-02T23:39:32.740 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.737+0000 7fdce37fe700 1 --2- 172.21.15.42:0/2265362904 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdce40ab230 0x7fdce40a0080 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fdce413c760 tx=0x7fdce40680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.741 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.738+0000 7fdce37fe700 1 --2- 172.21.15.42:0/2265362904 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdce40ab230 0x7fdce40a0080 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fdce413c760 tx=0x7fdce40680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.741 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.738+0000 7fdce37fe700 1 --2- 172.21.15.42:0/2265362904 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdce40ab230 0x7fdce40a0080 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fdce413c760 tx=0x7fdce40680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.741 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.738+0000 7fdce0ff9700 1 -- 172.21.15.42:0/2265362904 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fdcd4005820 con 0x7fdce40ab230 2020-04-02T23:39:32.742 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.739+0000 7fdce0ff9700 1 --2- 172.21.15.42:0/2265362904 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fdcc404d6b0 0x7fdcc404fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:32.742 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.739+0000 7fdce0ff9700 1 -- 172.21.15.42:0/2265362904 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fdcd4060ee0 con 0x7fdce40ab230 2020-04-02T23:39:32.742 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.739+0000 7fdce0ff9700 1 --2- 172.21.15.42:0/2265362904 >> [v2:172.21.15.42:6824/24940,v1:172.21.15.42:6825/24940] conn(0x7fdcc40549d0 0x7fdcc4056df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:32.743 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.739+0000 7fdce0ff9700 1 -- 172.21.15.42:0/2265362904 --> [v2:172.21.15.42:6824/24940,v1:172.21.15.42:6825/24940] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdcc40573b0 con 0x7fdcc40549d0 2020-04-02T23:39:32.743 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.739+0000 7fdce0ff9700 1 -- 172.21.15.42:0/2265362904 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcd4061240 con 0x7fdce40ab230 2020-04-02T23:39:32.746 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.743+0000 7fdce2ffd700 1 --2- 172.21.15.42:0/2265362904 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fdcc404d6b0 0x7fdcc404fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:32.746 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.744+0000 7fdce2ffd700 1 --2- 172.21.15.42:0/2265362904 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fdcc404d6b0 0x7fdcc404fb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdcdc001450 tx=0x7fdcd8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.747 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.744+0000 7fdce2ffd700 1 --2- 172.21.15.42:0/2265362904 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fdcc404d6b0 0x7fdcc404fb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdcdc001450 tx=0x7fdcd8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:32.747 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.744+0000 7fdce2ffd700 1 --2- 172.21.15.42:0/2265362904 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fdcc404d6b0 0x7fdcc404fb70 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7fdcdc001450 tx=0x7fdcd8007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:32.753 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.744+0000 7fdce3fff700 1 --2- 172.21.15.42:0/2265362904 >> [v2:172.21.15.42:6824/24940,v1:172.21.15.42:6825/24940] conn(0x7fdcc40549d0 0x7fdcc4056df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:32.754 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.751+0000 7fdce3fff700 1 --2- 172.21.15.42:0/2265362904 >> [v2:172.21.15.42:6824/24940,v1:172.21.15.42:6825/24940] conn(0x7fdcc40549d0 0x7fdcc4056df0 crc :-1 s=READY pgs=11 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:32.754 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.752+0000 7fdce0ff9700 1 -- 172.21.15.42:0/2265362904 <== osd.3 v2:172.21.15.42:6824/24940 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fdcc40573b0 con 0x7fdcc40549d0 2020-04-02T23:39:32.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.776+0000 7fdce89ec700 1 -- 172.21.15.42:0/2265362904 --> [v2:172.21.15.42:6824/24940,v1:172.21.15.42:6825/24940] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdce4056c50 con 0x7fdcc40549d0 2020-04-02T23:39:32.792 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.790+0000 7fdce0ff9700 1 -- 172.21.15.42:0/2265362904 <== osd.3 v2:172.21.15.42:6824/24940 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fdce4056c50 con 0x7fdcc40549d0 2020-04-02T23:39:32.795 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2020-04-02T23:39:32.796 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-04-02T23:39:32.796 INFO:teuthology.orchestra.run.smithi042.stdout:} 2020-04-02T23:39:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.814+0000 7fdce89ec700 1 -- 172.21.15.42:0/2265362904 >> [v2:172.21.15.42:6824/24940,v1:172.21.15.42:6825/24940] conn(0x7fdcc40549d0 msgr2=0x7fdcc4056df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.814+0000 7fdce89ec700 1 --2- 172.21.15.42:0/2265362904 >> [v2:172.21.15.42:6824/24940,v1:172.21.15.42:6825/24940] conn(0x7fdcc40549d0 0x7fdcc4056df0 crc :-1 s=READY pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.815+0000 7fdce89ec700 1 -- 172.21.15.42:0/2265362904 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fdcc404d6b0 msgr2=0x7fdcc404fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.815+0000 7fdce89ec700 1 --2- 172.21.15.42:0/2265362904 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fdcc404d6b0 0x7fdcc404fb70 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7fdcdc001450 tx=0x7fdcd8007a40).stop 2020-04-02T23:39:32.822 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.815+0000 7fdce89ec700 1 -- 172.21.15.42:0/2265362904 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdce40ab230 msgr2=0x7fdce40a0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:32.822 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.815+0000 7fdce89ec700 1 --2- 172.21.15.42:0/2265362904 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fdce40ab230 0x7fdce40a0080 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7fdce413c760 tx=0x7fdce40680a0).stop 2020-04-02T23:39:32.822 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.819+0000 7fdce3fff700 1 -- 172.21.15.42:0/2265362904 reap_dead start 2020-04-02T23:39:32.822 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.819+0000 7fdce89ec700 1 -- 172.21.15.42:0/2265362904 shutdown_connections 2020-04-02T23:39:32.823 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.819+0000 7fdce89ec700 1 -- 172.21.15.42:0/2265362904 >> 172.21.15.42:0/2265362904 conn(0x7fdce409dc40 msgr2=0x7fdce4069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:32.823 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.821+0000 7fdce89ec700 1 -- 172.21.15.42:0/2265362904 shutdown_connections 2020-04-02T23:39:32.829 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:32.821+0000 7fdce89ec700 1 -- 172.21.15.42:0/2265362904 wait complete. 2020-04-02T23:39:32.850 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:32.921 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 3 2020-04-02T23:39:33.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.152+0000 7f8fbc332700 1 Processor -- start 2020-04-02T23:39:33.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.152+0000 7f8fbc332700 1 -- start start 2020-04-02T23:39:33.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.153+0000 7f8fbc332700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8fb40ac310 0x7f8fb413cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:33.162 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.153+0000 7f8fbc332700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8fb40a8870 0x7f8fb40a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:33.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.153+0000 7f8fbc332700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb40aa5e0 con 0x7f8fb40aafc0 2020-04-02T23:39:33.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.153+0000 7f8fbc332700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb40aa880 con 0x7f8fb40a8870 2020-04-02T23:39:33.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.153+0000 7f8fbc332700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb40aab20 con 0x7f8fb40ac310 2020-04-02T23:39:33.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.153+0000 7f8fba8cf700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8fb40a8870 0x7f8fb40a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:33.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.153+0000 7f8fba8cf700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8fb40a8870 0x7f8fb40a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40794/0 (socket says 172.21.15.42:40794) 2020-04-02T23:39:33.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.153+0000 7f8fba8cf700 1 -- 172.21.15.42:0/1552897833 learned_addr learned my addr 172.21.15.42:0/1552897833 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:39:33.163 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.155+0000 7f8fba8cf700 1 -- 172.21.15.42:0/1552897833 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8fb40ac310 msgr2=0x7f8fb413cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-04-02T23:39:33.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.155+0000 7f8fba8cf700 1 --2- 172.21.15.42:0/1552897833 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8fb40ac310 0x7f8fb413cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:33.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.155+0000 7f8fba8cf700 1 -- 172.21.15.42:0/1552897833 >> v1:172.21.15.42:6789/0 conn(0x7f8fb40aafc0 legacy=0x7f8fb40a8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:33.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.155+0000 7f8fba8cf700 1 -- 172.21.15.42:0/1552897833 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb413cf40 con 0x7f8fb40a8870 2020-04-02T23:39:33.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.155+0000 7f8fba8cf700 1 --2- 172.21.15.42:0/1552897833 >> v2:172.21.15.42:3300/0 conn(0x7f8fb40a8870 0x7f8fb40a98e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8fb40ab710 tx=0x7f8fb0010140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.155+0000 7f8fba8cf700 1 --2- 172.21.15.42:0/1552897833 >> v2:172.21.15.42:3300/0 conn(0x7f8fb40a8870 0x7f8fb40a98e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8fb40ab710 tx=0x7f8fb0010140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.155+0000 7f8fba8cf700 1 --2- 172.21.15.42:0/1552897833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fb40a8870 0x7f8fb40a98e0 secure :-1 s=READY pgs=238 cs=0 l=1 rx=0x7f8fb40ab710 tx=0x7f8fb0010140).ready entity=mon.0 client_cookie=3cce0ea70510730 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:33.164 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.155+0000 7f8fba8cf700 1 --2- 172.21.15.42:0/1552897833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fb40a8870 0x7f8fb40a98e0 secure :-1 s=THROTTLE_DONE pgs=238 cs=0 l=1 rx=0x7f8fb40ab710 tx=0x7f8fb0010140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.155+0000 7f8fba8cf700 1 --2- 172.21.15.42:0/1552897833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fb40a8870 0x7f8fb40a98e0 secure :-1 s=THROTTLE_DONE pgs=238 cs=0 l=1 rx=0x7f8fb40ab710 tx=0x7f8fb0010140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.155+0000 7f8fba8cf700 1 --2- 172.21.15.42:0/1552897833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fb40a8870 0x7f8fb40a98e0 secure :-1 s=THROTTLE_DONE pgs=238 cs=0 l=1 rx=0x7f8fb40ab710 tx=0x7f8fb0010140).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.155+0000 7f8fb90cc700 1 -- 172.21.15.42:0/1552897833 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fb0011720 con 0x7f8fb40a8870 2020-04-02T23:39:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.155+0000 7f8fb90cc700 1 -- 172.21.15.42:0/1552897833 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb0011880 con 0x7f8fb40a8870 2020-04-02T23:39:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.155+0000 7f8fb90cc700 1 -- 172.21.15.42:0/1552897833 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fb0011ca0 con 0x7f8fb40a8870 2020-04-02T23:39:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.157+0000 7f8fbc332700 1 -- 172.21.15.42:0/1552897833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fb40a8870 msgr2=0x7f8fb40a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.157+0000 7f8fbc332700 1 --2- 172.21.15.42:0/1552897833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fb40a8870 0x7f8fb40a98e0 secure :-1 s=READY pgs=238 cs=0 l=1 rx=0x7f8fb40ab710 tx=0x7f8fb0010140).stop 2020-04-02T23:39:33.176 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.174+0000 7f8fbc332700 1 -- 172.21.15.42:0/1552897833 shutdown_connections 2020-04-02T23:39:33.177 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.174+0000 7f8fbc332700 1 --2- 172.21.15.42:0/1552897833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fb40a8870 0x7f8fb40a98e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:33.177 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.174+0000 7f8fbc332700 1 --2- 172.21.15.42:0/1552897833 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8fb40ac310 0x7f8fb413cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:33.177 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.174+0000 7f8fbc332700 1 -- 172.21.15.42:0/1552897833 >> 172.21.15.42:0/1552897833 conn(0x7f8fb4060980 msgr2=0x7f8fb40ab880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:33.186 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.183+0000 7f8fbc332700 1 -- 172.21.15.42:0/1552897833 shutdown_connections 2020-04-02T23:39:33.186 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.183+0000 7f8fbc332700 1 -- 172.21.15.42:0/1552897833 wait complete. 2020-04-02T23:39:33.187 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.184+0000 7f8fbc332700 1 Processor -- start 2020-04-02T23:39:33.188 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.185+0000 7f8fbc332700 1 -- start start 2020-04-02T23:39:33.189 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.185+0000 7f8fbc332700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8fb40a8870 0x7f8fb409f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:33.190 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.185+0000 7f8fbc332700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8fb40aafc0 0x7f8fb41380a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:33.190 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.185+0000 7f8fbc332700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb409fab0 con 0x7f8fb40ac310 2020-04-02T23:39:33.190 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.185+0000 7f8fbc332700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb409fca0 con 0x7f8fb40aafc0 2020-04-02T23:39:33.190 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.185+0000 7f8fbc332700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb409fef0 con 0x7f8fb40a8870 2020-04-02T23:39:33.190 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.186+0000 7f8fba8cf700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f8fb40ac310 0x7f8fb40a08d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60226/0 (socket says 172.21.15.42:60226) 2020-04-02T23:39:33.190 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.186+0000 7f8fba8cf700 1 -- 172.21.15.42:0/1849969958 learned_addr learned my addr 172.21.15.42:0/1849969958 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:33.191 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.186+0000 7f8fb98cd700 1 --2- 172.21.15.42:0/1849969958 >> v2:172.21.15.84:3300/0 conn(0x7f8fb40aafc0 0x7f8fb41380a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:33.191 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.186+0000 7f8fba0ce700 1 --2- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8fb40a8870 0x7f8fb409f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:33.191 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.186+0000 7f8fb98cd700 1 -- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8fb40a8870 msgr2=0x7f8fb409f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:33.191 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.186+0000 7f8fb98cd700 1 --2- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8fb40a8870 0x7f8fb409f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:33.191 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.186+0000 7f8fb98cd700 1 -- 172.21.15.42:0/1849969958 >> v1:172.21.15.42:6789/0 conn(0x7f8fb40ac310 legacy=0x7f8fb40a08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:33.191 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.186+0000 7f8fb98cd700 1 -- 172.21.15.42:0/1849969958 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40a0190 con 0x7f8fb40aafc0 2020-04-02T23:39:33.191 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.186+0000 7f8fb98cd700 1 --2- 172.21.15.42:0/1849969958 >> v2:172.21.15.84:3300/0 conn(0x7f8fb40aafc0 0x7f8fb41380a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8fb00082e0 tx=0x7f8fa4010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.192 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.186+0000 7f8fb98cd700 1 --2- 172.21.15.42:0/1849969958 >> v2:172.21.15.84:3300/0 conn(0x7f8fb40aafc0 0x7f8fb41380a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8fb00082e0 tx=0x7f8fa4010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.192 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.186+0000 7f8fb98cd700 1 --2- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb40aafc0 0x7f8fb41380a0 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7f8fb00082e0 tx=0x7f8fa4010850).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:33.192 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.187+0000 7f8fb98cd700 1 --2- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb40aafc0 0x7f8fb41380a0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f8fb00082e0 tx=0x7f8fa4010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.192 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.187+0000 7f8fb98cd700 1 --2- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb40aafc0 0x7f8fb41380a0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f8fb00082e0 tx=0x7f8fa4010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.192 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.187+0000 7f8fb98cd700 1 --2- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb40aafc0 0x7f8fb41380a0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f8fb00082e0 tx=0x7f8fa4010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.194 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.191+0000 7f8fab7fe700 1 -- 172.21.15.42:0/1849969958 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fa4006ba0 con 0x7f8fb40aafc0 2020-04-02T23:39:33.195 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.192+0000 7f8fab7fe700 1 -- 172.21.15.42:0/1849969958 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa4006d40 con 0x7f8fb40aafc0 2020-04-02T23:39:33.195 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.192+0000 7f8fbc332700 1 -- 172.21.15.42:0/1849969958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb40a0430 con 0x7f8fb40aafc0 2020-04-02T23:39:33.195 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.192+0000 7f8fab7fe700 1 -- 172.21.15.42:0/1849969958 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fa4010f30 con 0x7f8fb40aafc0 2020-04-02T23:39:33.196 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.192+0000 7f8fbc332700 1 -- 172.21.15.42:0/1849969958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb409dc40 con 0x7f8fb40aafc0 2020-04-02T23:39:33.196 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.193+0000 7f8fb98cd700 1 --2- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb40aafc0 0x7f8fb41380a0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f8fb00082e0 tx=0x7f8fa4010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.196 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.193+0000 7f8fb98cd700 1 --2- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb40aafc0 0x7f8fb41380a0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f8fb00082e0 tx=0x7f8fa4010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.197 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.194+0000 7f8fab7fe700 1 -- 172.21.15.42:0/1849969958 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f8fa4011090 con 0x7f8fb40aafc0 2020-04-02T23:39:33.197 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.195+0000 7f8fab7fe700 1 --2- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8f9c04d5c0 0x7f8f9c04fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:33.198 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.195+0000 7f8fab7fe700 1 -- 172.21.15.42:0/1849969958 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8fa4060f90 con 0x7f8fb40aafc0 2020-04-02T23:39:33.198 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.195+0000 7f8fba0ce700 1 --2- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8f9c04d5c0 0x7f8f9c04fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:33.198 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.195+0000 7f8fba0ce700 1 --2- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8f9c04d5c0 0x7f8f9c04fa80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8fac0032e0 tx=0x7f8fac0082e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.196+0000 7f8fbc332700 1 -- 172.21.15.42:0/1849969958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f90003340 con 0x7f8fb40aafc0 2020-04-02T23:39:33.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.196+0000 7f8fba0ce700 1 --2- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8f9c04d5c0 0x7f8f9c04fa80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8fac0032e0 tx=0x7f8fac0082e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.199 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.196+0000 7f8fba0ce700 1 --2- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8f9c04d5c0 0x7f8f9c04fa80 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f8fac0032e0 tx=0x7f8fac0082e0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.202+0000 7f8fb98cd700 1 --2- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb40aafc0 0x7f8fb41380a0 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f8fb00082e0 tx=0x7f8fa4010850).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.202+0000 7f8fab7fe700 1 -- 172.21.15.42:0/1849969958 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f8fa403c5f0 con 0x7f8fb40aafc0 2020-04-02T23:39:33.474 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.471+0000 7f8fbc332700 1 -- 172.21.15.42:0/1849969958 --> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f90002150 con 0x7f8f9c04d5c0 2020-04-02T23:39:33.475 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.472+0000 7f8fba0ce700 1 --2- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8f9c04d5c0 0x7f8f9c04fa80 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f8fac0032e0 tx=0x7f8fac0082e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.475 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.472+0000 7f8fab7fe700 1 -- 172.21.15.42:0/1849969958 <== mgr.4100 v2:172.21.15.84:6800/23437 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8f90002150 con 0x7f8f9c04d5c0 2020-04-02T23:39:33.491 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.488+0000 7f8fbc332700 1 -- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8f9c04d5c0 msgr2=0x7f8f9c04fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:33.491 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.488+0000 7f8fbc332700 1 --2- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8f9c04d5c0 0x7f8f9c04fa80 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f8fac0032e0 tx=0x7f8fac0082e0).stop 2020-04-02T23:39:33.491 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.488+0000 7f8fbc332700 1 -- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb40aafc0 msgr2=0x7f8fb41380a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:33.491 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.488+0000 7f8fbc332700 1 --2- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb40aafc0 0x7f8fb41380a0 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7f8fb00082e0 tx=0x7f8fa4010850).stop 2020-04-02T23:39:33.496 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.493+0000 7f8fbc332700 1 -- 172.21.15.42:0/1849969958 shutdown_connections 2020-04-02T23:39:33.496 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.493+0000 7f8fbc332700 1 --2- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f8f9c04d5c0 0x7f8f9c04fa80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:33.496 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.493+0000 7f8fbc332700 1 --2- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f8fb40a8870 0x7f8fb409f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:33.496 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.493+0000 7f8fbc332700 1 --2- 172.21.15.42:0/1849969958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fb40aafc0 0x7f8fb41380a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:33.496 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.493+0000 7f8fbc332700 1 -- 172.21.15.42:0/1849969958 >> 172.21.15.42:0/1849969958 conn(0x7f8fb4060980 msgr2=0x7f8fb40ab810 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:33.496 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.493+0000 7f8fbc332700 1 -- 172.21.15.42:0/1849969958 shutdown_connections 2020-04-02T23:39:33.497 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.493+0000 7f8fbc332700 1 -- 172.21.15.42:0/1849969958 wait complete. 2020-04-02T23:39:33.500 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 3 to deep-scrub 2020-04-02T23:39:33.512 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:33.579 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-02T23:39:33.778 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.775+0000 7f4ae38c9700 1 Processor -- start 2020-04-02T23:39:33.778 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.775+0000 7f4ae38c9700 1 -- start start 2020-04-02T23:39:33.779 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.776+0000 7f4ae38c9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4adc0aa1a0 0x7f4adc138720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:33.780 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.776+0000 7f4ae38c9700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4adc138b80 0x7f4adc05c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:33.780 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.776+0000 7f4ae38c9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4adc05c960 con 0x7f4adc05c4f0 2020-04-02T23:39:33.780 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.776+0000 7f4ae38c9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4adc0aacd0 con 0x7f4adc0aa1a0 2020-04-02T23:39:33.780 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.776+0000 7f4ae38c9700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc0a2980 con 0x7f4adc138b80 2020-04-02T23:39:33.780 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.776+0000 7f4ae1e66700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4adc05c4f0 0x7f4adc09dc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:54608/0 (socket says 172.21.15.42:54608) 2020-04-02T23:39:33.780 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.776+0000 7f4ae1e66700 1 -- 172.21.15.42:0/2443578351 learned_addr learned my addr 172.21.15.42:0/2443578351 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:33.781 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.777+0000 7f4ae0e64700 1 --2- 172.21.15.42:0/2443578351 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4adc138b80 0x7f4adc05c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:33.781 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.777+0000 7f4ae1665700 1 --2- 172.21.15.42:0/2443578351 >> v2:172.21.15.84:3300/0 conn(0x7f4adc0aa1a0 0x7f4adc138720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:33.781 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.777+0000 7f4ae0e64700 1 -- 172.21.15.42:0/2443578351 >> v2:172.21.15.84:3300/0 conn(0x7f4adc0aa1a0 msgr2=0x7f4adc138720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:33.781 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.777+0000 7f4ae0e64700 1 --2- 172.21.15.42:0/2443578351 >> v2:172.21.15.84:3300/0 conn(0x7f4adc0aa1a0 0x7f4adc138720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:33.782 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.777+0000 7f4ae0e64700 1 -- 172.21.15.42:0/2443578351 >> v1:172.21.15.84:6789/0 conn(0x7f4adc05c4f0 legacy=0x7f4adc09dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:33.783 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.779+0000 7f4ae0e64700 1 -- 172.21.15.42:0/2443578351 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc13c100 con 0x7f4adc138b80 2020-04-02T23:39:33.783 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.779+0000 7f4ae1665700 1 --2- 172.21.15.42:0/2443578351 >> v2:172.21.15.84:3300/0 conn(0x7f4adc0aa1a0 0x7f4adc138720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:39:33.783 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.779+0000 7f4ae0e64700 1 --2- 172.21.15.42:0/2443578351 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4adc138b80 0x7f4adc05c090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4ad40032b0 tx=0x7f4ad4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.783 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.779+0000 7f4acbfff700 1 -- 172.21.15.42:0/2443578351 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2146108969 0 0) 0x7f4adc05c960 con 0x7f4adc05c4f0 2020-04-02T23:39:33.783 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.779+0000 7f4ae0e64700 1 --2- 172.21.15.42:0/2443578351 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4adc138b80 0x7f4adc05c090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4ad40032b0 tx=0x7f4ad4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.783 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.779+0000 7f4ae0e64700 1 --2- 172.21.15.42:0/2443578351 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4adc138b80 0x7f4adc05c090 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f4ad40032b0 tx=0x7f4ad4007dc0).ready entity=mon.2 client_cookie=c3d6a97374c66f42 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:33.783 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.779+0000 7f4ae0e64700 1 --2- 172.21.15.42:0/2443578351 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4adc138b80 0x7f4adc05c090 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f4ad40032b0 tx=0x7f4ad4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.779+0000 7f4acbfff700 1 -- 172.21.15.42:0/2443578351 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ad400a160 con 0x7f4adc138b80 2020-04-02T23:39:33.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.779+0000 7f4ae0e64700 1 --2- 172.21.15.42:0/2443578351 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4adc138b80 0x7f4adc05c090 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f4ad40032b0 tx=0x7f4ad4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.779+0000 7f4ae0e64700 1 --2- 172.21.15.42:0/2443578351 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4adc138b80 0x7f4adc05c090 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f4ad40032b0 tx=0x7f4ad4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.779+0000 7f4acbfff700 1 -- 172.21.15.42:0/2443578351 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad400a2c0 con 0x7f4adc138b80 2020-04-02T23:39:33.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.780+0000 7f4acbfff700 1 -- 172.21.15.42:0/2443578351 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ad400a6a0 con 0x7f4adc138b80 2020-04-02T23:39:33.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.780+0000 7f4ae38c9700 1 -- 172.21.15.42:0/2443578351 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4adc138b80 msgr2=0x7f4adc05c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:33.784 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.780+0000 7f4ae38c9700 1 --2- 172.21.15.42:0/2443578351 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4adc138b80 0x7f4adc05c090 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f4ad40032b0 tx=0x7f4ad4007dc0).stop 2020-04-02T23:39:33.785 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.780+0000 7f4ae38c9700 1 -- 172.21.15.42:0/2443578351 shutdown_connections 2020-04-02T23:39:33.785 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.780+0000 7f4ae38c9700 1 --2- 172.21.15.42:0/2443578351 >> v2:172.21.15.84:3300/0 conn(0x7f4adc0aa1a0 0x7f4adc138720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:33.785 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.780+0000 7f4ae38c9700 1 --2- 172.21.15.42:0/2443578351 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4adc138b80 0x7f4adc05c090 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:33.786 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.780+0000 7f4ae38c9700 1 -- 172.21.15.42:0/2443578351 >> 172.21.15.42:0/2443578351 conn(0x7f4adc0aedc0 msgr2=0x7f4adc0af1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:33.786 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.781+0000 7f4ae38c9700 1 -- 172.21.15.42:0/2443578351 shutdown_connections 2020-04-02T23:39:33.786 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.781+0000 7f4ae38c9700 1 -- 172.21.15.42:0/2443578351 wait complete. 2020-04-02T23:39:33.787 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.783+0000 7f4ae38c9700 1 Processor -- start 2020-04-02T23:39:33.787 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.783+0000 7f4ae38c9700 1 -- start start 2020-04-02T23:39:33.787 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.784+0000 7f4ae38c9700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4adc05c4f0 0x7f4adc0a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:33.787 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.784+0000 7f4ae38c9700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4adc0aa1a0 0x7f4adc1375f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:33.787 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.784+0000 7f4ae38c9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4adc0a0ac0 con 0x7f4adc138b80 2020-04-02T23:39:33.787 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.784+0000 7f4ae38c9700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4adc0a0d60 con 0x7f4adc05c4f0 2020-04-02T23:39:33.788 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.784+0000 7f4ae38c9700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc09fb10 con 0x7f4adc0aa1a0 2020-04-02T23:39:33.788 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.784+0000 7f4ae1665700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4adc05c4f0 0x7f4adc0a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:33.788 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.784+0000 7f4ae0e64700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4adc0aa1a0 0x7f4adc1375f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:33.788 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.784+0000 7f4ae1665700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4adc05c4f0 0x7f4adc0a0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40812/0 (socket says 172.21.15.42:40812) 2020-04-02T23:39:33.788 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.784+0000 7f4ae1665700 1 -- 172.21.15.42:0/2038707230 learned_addr learned my addr 172.21.15.42:0/2038707230 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:39:33.788 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.784+0000 7f4ae0e64700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4adc0aa1a0 0x7f4adc1375f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.84:3301/0 says I am v2:172.21.15.42:60566/0 (socket says 172.21.15.42:60566) 2020-04-02T23:39:33.790 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.784+0000 7f4ae1665700 1 -- 172.21.15.42:0/2038707230 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4adc0aa1a0 msgr2=0x7f4adc1375f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:33.790 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.784+0000 7f4ae1665700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4adc0aa1a0 0x7f4adc1375f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:33.790 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.784+0000 7f4ae1665700 1 -- 172.21.15.42:0/2038707230 >> v1:172.21.15.84:6789/0 conn(0x7f4adc138b80 legacy=0x7f4adc1367c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-04-02T23:39:33.790 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.784+0000 7f4ae1665700 1 -- 172.21.15.42:0/2038707230 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc1398d0 con 0x7f4adc05c4f0 2020-04-02T23:39:33.790 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.784+0000 7f4ae0e64700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4adc0aa1a0 0x7f4adc1375f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:39:33.791 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.784+0000 7f4ae1665700 1 --2- 172.21.15.42:0/2038707230 >> v2:172.21.15.42:3300/0 conn(0x7f4adc05c4f0 0x7f4adc0a0500 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4adc0aeac0 tx=0x7f4acc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.791 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.785+0000 7f4ae1665700 1 --2- 172.21.15.42:0/2038707230 >> v2:172.21.15.42:3300/0 conn(0x7f4adc05c4f0 0x7f4adc0a0500 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4adc0aeac0 tx=0x7f4acc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.791 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.785+0000 7f4ae1665700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4adc05c4f0 0x7f4adc0a0500 secure :-1 s=READY pgs=240 cs=0 l=1 rx=0x7f4adc0aeac0 tx=0x7f4acc010eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:33.791 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.785+0000 7f4ae1665700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4adc05c4f0 0x7f4adc0a0500 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f4adc0aeac0 tx=0x7f4acc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.791 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.785+0000 7f4ae1665700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4adc05c4f0 0x7f4adc0a0500 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f4adc0aeac0 tx=0x7f4acc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.792 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.785+0000 7f4ae1665700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4adc05c4f0 0x7f4adc0a0500 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f4adc0aeac0 tx=0x7f4acc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.792 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.785+0000 7f4aca7fc700 1 -- 172.21.15.42:0/2038707230 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4acc007540 con 0x7f4adc05c4f0 2020-04-02T23:39:33.792 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.785+0000 7f4aca7fc700 1 -- 172.21.15.42:0/2038707230 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc0059c0 con 0x7f4adc05c4f0 2020-04-02T23:39:33.792 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.785+0000 7f4aca7fc700 1 -- 172.21.15.42:0/2038707230 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4acc005de0 con 0x7f4adc05c4f0 2020-04-02T23:39:33.792 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.785+0000 7f4ae38c9700 1 -- 172.21.15.42:0/2038707230 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4adc09f670 con 0x7f4adc05c4f0 2020-04-02T23:39:33.792 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.786+0000 7f4ae38c9700 1 -- 172.21.15.42:0/2038707230 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4adc0a2400 con 0x7f4adc05c4f0 2020-04-02T23:39:33.792 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.786+0000 7f4ae1665700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4adc05c4f0 0x7f4adc0a0500 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f4adc0aeac0 tx=0x7f4acc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.793 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.787+0000 7f4aca7fc700 1 -- 172.21.15.42:0/2038707230 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f4acc010180 con 0x7f4adc05c4f0 2020-04-02T23:39:33.793 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.787+0000 7f4ae1665700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4adc05c4f0 0x7f4adc0a0500 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f4adc0aeac0 tx=0x7f4acc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.794 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.787+0000 7f4aca7fc700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4abc04d680 0x7f4abc04fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:33.794 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.787+0000 7f4aca7fc700 1 -- 172.21.15.42:0/2038707230 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4acc061210 con 0x7f4adc05c4f0 2020-04-02T23:39:33.794 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.788+0000 7f4ae0e64700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4abc04d680 0x7f4abc04fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:33.794 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.788+0000 7f4ae0e64700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4abc04d680 0x7f4abc04fb40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4ad40032b0 tx=0x7f4ad4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.794 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.788+0000 7f4ae0e64700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4abc04d680 0x7f4abc04fb40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4ad40032b0 tx=0x7f4ad4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.794 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.788+0000 7f4ae0e64700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4abc04d680 0x7f4abc04fb40 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f4ad40032b0 tx=0x7f4ad4007dc0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:33.794 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.788+0000 7f4ae38c9700 1 -- 172.21.15.42:0/2038707230 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4adc0a1f10 con 0x7f4adc05c4f0 2020-04-02T23:39:33.803 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.796+0000 7f4ae1665700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4adc05c4f0 0x7f4adc0a0500 secure :-1 s=THROTTLE_DONE pgs=240 cs=0 l=1 rx=0x7f4adc0aeac0 tx=0x7f4acc010eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:33.803 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:33.796+0000 7f4aca7fc700 1 -- 172.21.15.42:0/2038707230 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f4adc0a1f10 con 0x7f4adc05c4f0 2020-04-02T23:39:34.039 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:34.036+0000 7f4ae38c9700 1 -- 172.21.15.42:0/2038707230 --> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4adc0a2590 con 0x7f4abc04d680 2020-04-02T23:39:34.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:34.044+0000 7f4ae0e64700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4abc04d680 0x7f4abc04fb40 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f4ad40032b0 tx=0x7f4ad4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:34.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:34.044+0000 7f4aca7fc700 1 -- 172.21.15.42:0/2038707230 <== mgr.4100 v2:172.21.15.84:6800/23437 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+107553 (secure 0 0 0) 0x7f4ad4008940 con 0x7f4abc04d680 2020-04-02T23:39:34.049 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:39:34.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:34.047+0000 7f4ae38c9700 1 -- 172.21.15.42:0/2038707230 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4abc04d680 msgr2=0x7f4abc04fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:34.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:34.047+0000 7f4ae38c9700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4abc04d680 0x7f4abc04fb40 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f4ad40032b0 tx=0x7f4ad4007dc0).stop 2020-04-02T23:39:34.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:34.047+0000 7f4ae38c9700 1 -- 172.21.15.42:0/2038707230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4adc05c4f0 msgr2=0x7f4adc0a0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:34.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:34.047+0000 7f4ae38c9700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4adc05c4f0 0x7f4adc0a0500 secure :-1 s=READY pgs=240 cs=0 l=1 rx=0x7f4adc0aeac0 tx=0x7f4acc010eb0).stop 2020-04-02T23:39:34.050 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:34.047+0000 7f4ae38c9700 1 -- 172.21.15.42:0/2038707230 shutdown_connections 2020-04-02T23:39:34.051 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:34.047+0000 7f4ae38c9700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4adc05c4f0 0x7f4adc0a0500 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:34.051 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:34.047+0000 7f4ae38c9700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f4abc04d680 0x7f4abc04fb40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:34.051 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:34.047+0000 7f4ae38c9700 1 --2- 172.21.15.42:0/2038707230 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f4adc0aa1a0 0x7f4adc1375f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:34.051 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:34.047+0000 7f4ae38c9700 1 -- 172.21.15.42:0/2038707230 >> 172.21.15.42:0/2038707230 conn(0x7f4adc0aedc0 msgr2=0x7f4adc0af1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:34.051 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:34.047+0000 7f4ae38c9700 1 -- 172.21.15.42:0/2038707230 shutdown_connections 2020-04-02T23:39:34.051 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:34.047+0000 7f4ae38c9700 1 -- 172.21.15.42:0/2038707230 wait complete. 2020-04-02T23:39:34.052 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2020-04-02T23:39:34.064 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":475,"stamp":"2020-04-02T23:39:33.284080+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":9674598807,"num_objects":2440,"num_object_clones":0,"num_object_copies":9688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2440,"num_whiteouts":0,"num_read":29,"num_read_kb":65,"num_write":445764,"num_write_kb":14885688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23176,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82343,"ondisk_log_size":82343,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":21243536,"kb_used_data":12854864,"kb_used_omap":7386,"kb_used_meta":8381221,"kb_avail":733731184,"statfs":{"total":773094113280,"available":751340732416,"internally_reserved":8589934592,"allocated":13163380736,"data_stored":18486873952,"data_compressed":520415462,"data_compressed_allocated":5324840960,"data_compressed_original":10649681920,"omap_allocated":7563560,"internal_metadata":8582371032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,2,6,11,6,14,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3669961227,"num_objects":-875,"num_object_clones":0,"num_object_copies":-3500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-875,"num_whiteouts":0,"num_read":2,"num_read_kb":9,"num_write":1824,"num_write_kb":3893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23176,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002581"},"pg_stats":[{"pgid":"4.2","version":"26'16740","reported_seq":"16751","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:28.667860+0000","last_change":"2020-04-02T23:24:47.993492+0000","last_active":"2020-04-02T23:39:28.667860+0000","last_peered":"2020-04-02T23:39:28.667860+0000","last_clean":"2020-04-02T23:39:28.667860+0000","last_became_active":"2020-04-02T23:24:47.993002+0000","last_became_peered":"2020-04-02T23:24:47.993002+0000","last_unstale":"2020-04-02T23:39:28.667860+0000","last_undegraded":"2020-04-02T23:39:28.667860+0000","last_fullsized":"2020-04-02T23:39:28.667860+0000","mapping_epoch":24,"log_start":"26'6649","ondisk_log_start":"26'6649","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10091,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1292384810,"num_objects":320,"num_object_clones":0,"num_object_copies":1280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":320,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58550,"num_write_kb":1925310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:27.185192+0000","last_change":"2020-04-02T23:39:27.185287+0000","last_active":"2020-04-02T23:39:27.185192+0000","last_peered":"2020-04-02T23:39:27.185192+0000","last_clean":"2020-04-02T23:39:27.185192+0000","last_became_active":"2020-04-02T23:24:42.210455+0000","last_became_peered":"2020-04-02T23:24:42.210455+0000","last_unstale":"2020-04-02T23:39:27.185192+0000","last_undegraded":"2020-04-02T23:39:27.185192+0000","last_fullsized":"2020-04-02T23:39:27.185192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:39:27.185184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:39:27.185184+0000","last_clean_scrub_stamp":"2020-04-02T23:39:27.185184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'25","reported_seq":"37","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:37:45.671075+0000","last_change":"2020-04-02T23:24:44.978026+0000","last_active":"2020-04-02T23:37:45.671075+0000","last_peered":"2020-04-02T23:37:45.671075+0000","last_clean":"2020-04-02T23:37:45.671075+0000","last_became_active":"2020-04-02T23:24:44.977559+0000","last_became_peered":"2020-04-02T23:24:44.977559+0000","last_unstale":"2020-04-02T23:37:45.671075+0000","last_undegraded":"2020-04-02T23:37:45.671075+0000","last_fullsized":"2020-04-02T23:37:45.671075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"26'13983","reported_seq":"13994","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:28.586121+0000","last_change":"2020-04-02T23:24:48.354332+0000","last_active":"2020-04-02T23:39:28.586121+0000","last_peered":"2020-04-02T23:39:28.586121+0000","last_clean":"2020-04-02T23:39:28.586121+0000","last_became_active":"2020-04-02T23:24:48.353610+0000","last_became_peered":"2020-04-02T23:24:48.353610+0000","last_unstale":"2020-04-02T23:39:28.586121+0000","last_undegraded":"2020-04-02T23:39:28.586121+0000","last_fullsized":"2020-04-02T23:39:28.586121+0000","mapping_epoch":24,"log_start":"26'3913","ondisk_log_start":"26'3913","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10070,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1182892506,"num_objects":293,"num_object_clones":0,"num_object_copies":1172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":293,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48299,"num_write_kb":1720160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983921+0000","last_change":"2020-04-02T23:24:42.210957+0000","last_active":"2020-04-02T23:24:47.983921+0000","last_peered":"2020-04-02T23:24:47.983921+0000","last_clean":"2020-04-02T23:24:47.983921+0000","last_became_active":"2020-04-02T23:24:42.210546+0000","last_became_peered":"2020-04-02T23:24:42.210546+0000","last_unstale":"2020-04-02T23:24:47.983921+0000","last_undegraded":"2020-04-02T23:24:47.983921+0000","last_fullsized":"2020-04-02T23:24:47.983921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"26'1003","reported_seq":"1018","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:30.575131+0000","last_change":"2020-04-02T23:39:30.575219+0000","last_active":"2020-04-02T23:39:30.575131+0000","last_peered":"2020-04-02T23:39:30.575131+0000","last_clean":"2020-04-02T23:39:30.575131+0000","last_became_active":"2020-04-02T23:24:44.976952+0000","last_became_peered":"2020-04-02T23:24:44.976952+0000","last_unstale":"2020-04-02T23:39:30.575131+0000","last_undegraded":"2020-04-02T23:39:30.575131+0000","last_fullsized":"2020-04-02T23:39:30.575131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1003","last_scrub_stamp":"2020-04-02T23:39:30.575123+0000","last_deep_scrub":"26'1003","last_deep_scrub_stamp":"2020-04-02T23:39:30.575123+0000","last_clean_scrub_stamp":"2020-04-02T23:39:30.575123+0000","log_size":1003,"ondisk_log_size":1003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4471886,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":997,"num_write_kb":4717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12050,"num_omap_keys":26,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"26'15355","reported_seq":"15366","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:28.653863+0000","last_change":"2020-04-02T23:24:48.354357+0000","last_active":"2020-04-02T23:39:28.653863+0000","last_peered":"2020-04-02T23:39:28.653863+0000","last_clean":"2020-04-02T23:39:28.653863+0000","last_became_active":"2020-04-02T23:24:48.353668+0000","last_became_peered":"2020-04-02T23:24:48.353668+0000","last_unstale":"2020-04-02T23:39:28.653863+0000","last_undegraded":"2020-04-02T23:39:28.653863+0000","last_fullsized":"2020-04-02T23:39:28.653863+0000","mapping_epoch":24,"log_start":"26'5273","ondisk_log_start":"26'5273","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10082,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1267154199,"num_objects":314,"num_object_clones":0,"num_object_copies":1256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53529,"num_write_kb":1823426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.986299+0000","last_change":"2020-04-02T23:24:41.967219+0000","last_active":"2020-04-02T23:24:47.986299+0000","last_peered":"2020-04-02T23:24:47.986299+0000","last_clean":"2020-04-02T23:24:47.986299+0000","last_became_active":"2020-04-02T23:24:41.966868+0000","last_became_peered":"2020-04-02T23:24:41.966868+0000","last_unstale":"2020-04-02T23:24:47.986299+0000","last_undegraded":"2020-04-02T23:24:47.986299+0000","last_fullsized":"2020-04-02T23:24:47.986299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"26'17","reported_seq":"31","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:28.227967+0000","last_change":"2020-04-02T23:39:28.228046+0000","last_active":"2020-04-02T23:39:28.227967+0000","last_peered":"2020-04-02T23:39:28.227967+0000","last_clean":"2020-04-02T23:39:28.227967+0000","last_became_active":"2020-04-02T23:24:44.977934+0000","last_became_peered":"2020-04-02T23:24:44.977934+0000","last_unstale":"2020-04-02T23:39:28.227967+0000","last_undegraded":"2020-04-02T23:39:28.227967+0000","last_fullsized":"2020-04-02T23:39:28.227967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'17","last_scrub_stamp":"2020-04-02T23:39:28.227959+0000","last_deep_scrub":"26'17","last_deep_scrub_stamp":"2020-04-02T23:39:28.227959+0000","last_clean_scrub_stamp":"2020-04-02T23:39:28.227959+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11126,"num_omap_keys":24,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"26'15530","reported_seq":"15541","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:33.159229+0000","last_change":"2020-04-02T23:24:48.354531+0000","last_active":"2020-04-02T23:39:33.159229+0000","last_peered":"2020-04-02T23:39:33.159229+0000","last_clean":"2020-04-02T23:39:33.159229+0000","last_became_active":"2020-04-02T23:24:48.353432+0000","last_became_peered":"2020-04-02T23:24:48.353432+0000","last_unstale":"2020-04-02T23:39:33.159229+0000","last_undegraded":"2020-04-02T23:39:33.159229+0000","last_fullsized":"2020-04-02T23:39:33.159229+0000","mapping_epoch":24,"log_start":"26'5441","ondisk_log_start":"26'5441","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10089,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":994194734,"num_objects":251,"num_object_clones":0,"num_object_copies":1004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54645,"num_write_kb":1823228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983940+0000","last_change":"2020-04-02T23:24:42.200692+0000","last_active":"2020-04-02T23:24:47.983940+0000","last_peered":"2020-04-02T23:24:47.983940+0000","last_clean":"2020-04-02T23:24:47.983940+0000","last_became_active":"2020-04-02T23:24:42.200326+0000","last_became_peered":"2020-04-02T23:24:42.200326+0000","last_unstale":"2020-04-02T23:24:47.983940+0000","last_undegraded":"2020-04-02T23:24:47.983940+0000","last_fullsized":"2020-04-02T23:24:47.983940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:48.178748+0000","last_change":"2020-04-02T23:24:37.115477+0000","last_active":"2020-04-02T23:24:48.178748+0000","last_peered":"2020-04-02T23:24:48.178748+0000","last_clean":"2020-04-02T23:24:48.178748+0000","last_became_active":"2020-04-02T23:24:37.114896+0000","last_became_peered":"2020-04-02T23:24:37.114896+0000","last_unstale":"2020-04-02T23:24:48.178748+0000","last_undegraded":"2020-04-02T23:24:48.178748+0000","last_fullsized":"2020-04-02T23:24:48.178748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:28.069299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:28.069299+0000","last_clean_scrub_stamp":"2020-04-02T23:24:28.069299+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"26'3","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:25:45.029664+0000","last_change":"2020-04-02T23:24:44.977844+0000","last_active":"2020-04-02T23:25:45.029664+0000","last_peered":"2020-04-02T23:25:45.029664+0000","last_clean":"2020-04-02T23:25:45.029664+0000","last_became_active":"2020-04-02T23:24:44.977355+0000","last_became_peered":"2020-04-02T23:24:44.977355+0000","last_unstale":"2020-04-02T23:25:45.029664+0000","last_undegraded":"2020-04-02T23:25:45.029664+0000","last_fullsized":"2020-04-02T23:25:45.029664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"26'16010","reported_seq":"16022","reported_epoch":"26","state":"active+clean+scrubbing+deep","last_fresh":"2020-04-02T23:39:30.756128+0000","last_change":"2020-04-02T23:39:29.242732+0000","last_active":"2020-04-02T23:39:30.756128+0000","last_peered":"2020-04-02T23:39:30.756128+0000","last_clean":"2020-04-02T23:39:30.756128+0000","last_became_active":"2020-04-02T23:24:48.179989+0000","last_became_peered":"2020-04-02T23:24:48.179989+0000","last_unstale":"2020-04-02T23:39:30.756128+0000","last_undegraded":"2020-04-02T23:39:30.756128+0000","last_fullsized":"2020-04-02T23:39:30.756128+0000","mapping_epoch":24,"log_start":"26'5920","ondisk_log_start":"26'5920","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10090,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1178977664,"num_objects":296,"num_object_clones":0,"num_object_copies":1184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":296,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55910,"num_write_kb":1812324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983937+0000","last_change":"2020-04-02T23:24:41.967177+0000","last_active":"2020-04-02T23:24:47.983937+0000","last_peered":"2020-04-02T23:24:47.983937+0000","last_clean":"2020-04-02T23:24:47.983937+0000","last_became_active":"2020-04-02T23:24:41.966804+0000","last_became_peered":"2020-04-02T23:24:41.966804+0000","last_unstale":"2020-04-02T23:24:47.983937+0000","last_undegraded":"2020-04-02T23:24:47.983937+0000","last_fullsized":"2020-04-02T23:24:47.983937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"26'36","reported_seq":"76","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:21.022286+0000","last_change":"2020-04-02T23:24:44.977656+0000","last_active":"2020-04-02T23:39:21.022286+0000","last_peered":"2020-04-02T23:39:21.022286+0000","last_clean":"2020-04-02T23:39:21.022286+0000","last_became_active":"2020-04-02T23:24:44.977243+0000","last_became_peered":"2020-04-02T23:24:44.977243+0000","last_unstale":"2020-04-02T23:39:21.022286+0000","last_undegraded":"2020-04-02T23:39:21.022286+0000","last_fullsized":"2020-04-02T23:39:21.022286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":36,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47478,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":65,"num_write":38,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"26'16275","reported_seq":"16286","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:28.628471+0000","last_change":"2020-04-02T23:24:48.354355+0000","last_active":"2020-04-02T23:39:28.628471+0000","last_peered":"2020-04-02T23:39:28.628471+0000","last_clean":"2020-04-02T23:39:28.628471+0000","last_became_active":"2020-04-02T23:24:48.353592+0000","last_became_peered":"2020-04-02T23:24:48.353592+0000","last_unstale":"2020-04-02T23:39:28.628471+0000","last_undegraded":"2020-04-02T23:39:28.628471+0000","last_fullsized":"2020-04-02T23:39:28.628471+0000","mapping_epoch":24,"log_start":"26'6226","ondisk_log_start":"26'6226","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10049,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1409530695,"num_objects":350,"num_object_clones":0,"num_object_copies":1400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":350,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56195,"num_write_kb":1907521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.984549+0000","last_change":"2020-04-02T23:24:41.965438+0000","last_active":"2020-04-02T23:24:47.984549+0000","last_peered":"2020-04-02T23:24:47.984549+0000","last_clean":"2020-04-02T23:24:47.984549+0000","last_became_active":"2020-04-02T23:24:41.965120+0000","last_became_peered":"2020-04-02T23:24:41.965120+0000","last_unstale":"2020-04-02T23:24:47.984549+0000","last_undegraded":"2020-04-02T23:24:47.984549+0000","last_fullsized":"2020-04-02T23:24:47.984549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'607","reported_seq":"618","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:37:55.977087+0000","last_change":"2020-04-02T23:24:44.980384+0000","last_active":"2020-04-02T23:37:55.977087+0000","last_peered":"2020-04-02T23:37:55.977087+0000","last_clean":"2020-04-02T23:37:55.977087+0000","last_became_active":"2020-04-02T23:24:44.980010+0000","last_became_peered":"2020-04-02T23:24:44.980010+0000","last_unstale":"2020-04-02T23:37:55.977087+0000","last_undegraded":"2020-04-02T23:37:55.977087+0000","last_fullsized":"2020-04-02T23:37:55.977087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":607,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194938,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":605,"num_write_kb":4299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"26'15635","reported_seq":"15646","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:31.293539+0000","last_change":"2020-04-02T23:24:48.180789+0000","last_active":"2020-04-02T23:39:31.293539+0000","last_peered":"2020-04-02T23:39:31.293539+0000","last_clean":"2020-04-02T23:39:31.293539+0000","last_became_active":"2020-04-02T23:24:48.179994+0000","last_became_peered":"2020-04-02T23:24:48.179994+0000","last_unstale":"2020-04-02T23:39:31.293539+0000","last_undegraded":"2020-04-02T23:39:31.293539+0000","last_fullsized":"2020-04-02T23:39:31.293539+0000","mapping_epoch":24,"log_start":"26'5610","ondisk_log_start":"26'5610","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10025,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1115827164,"num_objects":277,"num_object_clones":0,"num_object_copies":1108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54551,"num_write_kb":1835362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'9","reported_seq":"20","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:25:45.021167+0000","last_change":"2020-04-02T23:24:44.979136+0000","last_active":"2020-04-02T23:25:45.021167+0000","last_peered":"2020-04-02T23:25:45.021167+0000","last_clean":"2020-04-02T23:25:45.021167+0000","last_became_active":"2020-04-02T23:24:44.978145+0000","last_became_peered":"2020-04-02T23:24:44.978145+0000","last_unstale":"2020-04-02T23:25:45.021167+0000","last_undegraded":"2020-04-02T23:25:45.021167+0000","last_fullsized":"2020-04-02T23:25:45.021167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:27.922218+0000","last_change":"2020-04-02T23:39:27.922278+0000","last_active":"2020-04-02T23:39:27.922218+0000","last_peered":"2020-04-02T23:39:27.922218+0000","last_clean":"2020-04-02T23:39:27.922218+0000","last_became_active":"2020-04-02T23:24:42.311136+0000","last_became_peered":"2020-04-02T23:24:42.311136+0000","last_unstale":"2020-04-02T23:39:27.922218+0000","last_undegraded":"2020-04-02T23:39:27.922218+0000","last_fullsized":"2020-04-02T23:39:27.922218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:39:27.922214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:39:27.922214+0000","last_clean_scrub_stamp":"2020-04-02T23:39:27.922214+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"26'17969","reported_seq":"17980","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:32.482969+0000","last_change":"2020-04-02T23:24:48.180425+0000","last_active":"2020-04-02T23:39:32.482969+0000","last_peered":"2020-04-02T23:39:32.482969+0000","last_clean":"2020-04-02T23:39:32.482969+0000","last_became_active":"2020-04-02T23:24:48.179883+0000","last_became_peered":"2020-04-02T23:24:48.179883+0000","last_unstale":"2020-04-02T23:39:32.482969+0000","last_undegraded":"2020-04-02T23:39:32.482969+0000","last_fullsized":"2020-04-02T23:39:32.482969+0000","mapping_epoch":24,"log_start":"26'7946","ondisk_log_start":"26'7946","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10023,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1224922007,"num_objects":303,"num_object_clones":0,"num_object_copies":1212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":303,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62079,"num_write_kb":2029025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983945+0000","last_change":"2020-04-02T23:24:42.311312+0000","last_active":"2020-04-02T23:24:47.983945+0000","last_peered":"2020-04-02T23:24:47.983945+0000","last_clean":"2020-04-02T23:24:47.983945+0000","last_became_active":"2020-04-02T23:24:42.310964+0000","last_became_peered":"2020-04-02T23:24:42.310964+0000","last_unstale":"2020-04-02T23:24:47.983945+0000","last_undegraded":"2020-04-02T23:24:47.983945+0000","last_fullsized":"2020-04-02T23:24:47.983945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'122","reported_seq":"133","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:37:55.976876+0000","last_change":"2020-04-02T23:24:44.974217+0000","last_active":"2020-04-02T23:37:55.976876+0000","last_peered":"2020-04-02T23:37:55.976876+0000","last_clean":"2020-04-02T23:37:55.976876+0000","last_became_active":"2020-04-02T23:24:44.973795+0000","last_became_peered":"2020-04-02T23:24:44.973795+0000","last_unstale":"2020-04-02T23:37:55.976876+0000","last_undegraded":"2020-04-02T23:37:55.976876+0000","last_fullsized":"2020-04-02T23:37:55.976876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":122,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":9665883779,"num_objects":2404,"num_object_clones":0,"num_object_copies":9616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443758,"num_write_kb":14876356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12945498112,"data_stored":18160287744,"data_compressed":508416248,"data_compressed_allocated":5214789632,"data_compressed_original":10429579264,"omap_allocated":0,"internal_metadata":0},"log_size":80519,"ondisk_log_size":80519,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":8715028,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":29,"num_read_kb":65,"num_write":2004,"num_write_kb":9323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23176,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13647872,"data_stored":17430056,"data_compressed":1653144,"data_compressed_allocated":3842048,"data_compressed_original":7684096,"omap_allocated":4474845,"internal_metadata":0},"log_size":1822,"ondisk_log_size":1822,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1550595,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509621,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2941224,"kb_used_data":1892640,"kb_used_omap":1529,"kb_used_meta":1047046,"kb_avail":91430616,"statfs":{"total":96636764160,"available":93624950784,"internally_reserved":1073741824,"allocated":1938063360,"data_stored":2714823463,"data_compressed":75761016,"data_compressed_allocated":776921088,"data_compressed_original":1553842176,"omap_allocated":1566281,"internal_metadata":1072175543},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":1.3149999999999999,"15min":0.80000000000000004},"min":{"1min":0.19800000000000001,"5min":0.192,"15min":0.19},"max":{"1min":0.55400000000000005,"5min":9.0990000000000002,"15min":9.0990000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.68700000000000006,"15min":0.56000000000000005},"min":{"1min":0.23699999999999999,"5min":0.223,"15min":0.19900000000000001},"max":{"1min":0.53800000000000003,"5min":7.6920000000000002,"15min":7.6920000000000002},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.627,"15min":0.50600000000000001},"min":{"1min":0.247,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.45000000000000001,"5min":5.5099999999999998,"15min":5.5099999999999998},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.41699999999999998,"5min":1.2669999999999999,"15min":0.83599999999999997},"min":{"1min":0.30299999999999999,"5min":0.23300000000000001,"15min":0.223},"max":{"1min":0.69899999999999995,"5min":8.3049999999999997,"15min":8.8030000000000008},"last":0.89700000000000002}]},{"osd":2,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":1.5,"15min":0.91600000000000004},"min":{"1min":0.25900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52300000000000002,"5min":8.7690000000000001,"15min":8.8569999999999993},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.434,"5min":0.67400000000000004,"15min":0.622},"min":{"1min":0.32900000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.57299999999999995,"5min":3.899,"15min":5.6020000000000003},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.70999999999999996,"15min":0.621},"min":{"1min":0.25600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46999999999999997,"5min":6.0250000000000004,"15min":9.8620000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":1.427,"15min":0.97099999999999997},"min":{"1min":0.29999999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.71599999999999997,"5min":8.4420000000000002,"15min":12.067},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.79900000000000004,"15min":0.61299999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.22800000000000001},"max":{"1min":0.69499999999999995,"5min":4.907,"15min":5.4619999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.81200000000000006,"15min":0.60499999999999998},"min":{"1min":0.25600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.65800000000000003,"5min":5.3310000000000004,"15min":5.3310000000000004},"last":0.30599999999999999}]},{"osd":5,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":1.3440000000000001,"15min":0.89600000000000002},"min":{"1min":0.26500000000000001,"5min":0.255,"15min":0.24199999999999999},"max":{"1min":0.64700000000000002,"5min":9.5389999999999997,"15min":9.5389999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.94399999999999995,"15min":0.72499999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.26700000000000002},"max":{"1min":0.628,"5min":5.6500000000000004,"15min":5.6699999999999999},"last":0.33200000000000002}]},{"osd":6,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":1.004,"15min":0.74399999999999999},"min":{"1min":0.31900000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68100000000000005,"5min":7.7359999999999998,"15min":7.7359999999999998},"last":1.52},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.97099999999999997,"15min":0.72199999999999998},"min":{"1min":0.30299999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71599999999999997,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":1.375}]}]},{"osd":4,"up_from":14,"seq":60129542326,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1445468,"kb_used_data":396884,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92926372,"statfs":{"total":96636764160,"available":95156604928,"internally_reserved":1073741824,"allocated":406409216,"data_stored":570637661,"data_compressed":16033431,"data_compressed_allocated":164397056,"data_compressed_original":328794112,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.79100000000000004,"15min":0.57099999999999995},"min":{"1min":0.23000000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.46600000000000003,"5min":5.2089999999999996,"15min":5.2999999999999998},"last":1.425},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.79800000000000004,"15min":0.58599999999999997},"min":{"1min":0.24099999999999999,"5min":0.20799999999999999,"15min":0.19600000000000001},"max":{"1min":0.51400000000000001,"5min":4.2690000000000001,"15min":5.0190000000000001},"last":1.464}]},{"osd":1,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.73599999999999999,"15min":0.57599999999999996},"min":{"1min":0.23100000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.51300000000000001,"5min":5.5289999999999999,"15min":5.5289999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.88700000000000001,"15min":0.66300000000000003},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.217},"max":{"1min":0.52400000000000002,"5min":5.1719999999999997,"15min":5.4820000000000002},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.76800000000000002,"15min":0.63100000000000001},"min":{"1min":0.30399999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56200000000000006,"5min":5.3769999999999998,"15min":11.308999999999999},"last":0.376},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.98299999999999998,"15min":0.68899999999999995},"min":{"1min":0.29899999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.54800000000000004,"5min":7.5590000000000002,"15min":7.5590000000000002},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.94099999999999995,"15min":0.69799999999999995},"min":{"1min":0.29099999999999998,"5min":0.25700000000000001,"15min":0.249},"max":{"1min":0.55200000000000005,"5min":7.2160000000000002,"15min":7.2160000000000002},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.95099999999999996,"15min":0.70699999999999996},"min":{"1min":0.28399999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59799999999999998,"5min":8.6630000000000003,"15min":8.6630000000000003},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.83199999999999996,"15min":0.65300000000000002},"min":{"1min":0.26800000000000002,"5min":0.22800000000000001,"15min":0.224},"max":{"1min":0.623,"5min":5.8860000000000001,"15min":5.8860000000000001},"last":0.307},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.77300000000000002,"15min":0.58799999999999997},"min":{"1min":0.29799999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.54400000000000004,"5min":4.0919999999999996,"15min":5.1210000000000004},"last":0.35399999999999998}]},{"osd":6,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":1.0840000000000001,"15min":0.71199999999999997},"min":{"1min":0.25700000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.64100000000000001,"5min":18.419,"15min":18.419},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.49299999999999999,"5min":1.1519999999999999,"15min":0.85499999999999998},"min":{"1min":0.33500000000000002,"5min":0.28000000000000003,"15min":0.23300000000000001},"max":{"1min":0.71899999999999997,"5min":22.329000000000001,"15min":22.329000000000001},"last":0.81799999999999995}]},{"osd":7,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.98799999999999999,"15min":0.71499999999999997},"min":{"1min":0.34100000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56100000000000005,"5min":6.6200000000000001,"15min":6.6200000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.79500000000000004,"15min":0.64300000000000002},"min":{"1min":0.379,"5min":0.254,"15min":0.254},"max":{"1min":0.624,"5min":5.7960000000000003,"15min":5.7960000000000003},"last":0.45400000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542325,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4278140,"kb_used_data":3229556,"kb_used_omap":212,"kb_used_meta":1048363,"kb_avail":90093700,"statfs":{"total":96636764160,"available":92255948800,"internally_reserved":1073741824,"allocated":3307065344,"data_stored":4711582189,"data_compressed":137334783,"data_compressed_allocated":1404702720,"data_compressed_original":2809405440,"omap_allocated":217393,"internal_metadata":1073524431},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,0,1,2,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":1.2210000000000001,"15min":0.747},"min":{"1min":0.22,"5min":0.186,"15min":0.157},"max":{"1min":0.59299999999999997,"5min":7.0700000000000003,"15min":7.0700000000000003},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.93300000000000005,"15min":0.66300000000000003},"min":{"1min":0.23899999999999999,"5min":0.20699999999999999,"15min":0.191},"max":{"1min":0.56999999999999995,"5min":5.5979999999999999,"15min":6.2060000000000004},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":1.2609999999999999,"15min":0.78700000000000003},"min":{"1min":0.21099999999999999,"5min":0.20999999999999999,"15min":0.20000000000000001},"max":{"1min":0.55100000000000005,"5min":5.7169999999999996,"15min":5.7169999999999996},"last":0.223},{"interface":"front","average":{"1min":0.41299999999999998,"5min":1.2569999999999999,"15min":0.75600000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.21299999999999999},"max":{"1min":0.56100000000000005,"5min":6.9199999999999999,"15min":6.9199999999999999},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":1.22,"15min":0.78900000000000003},"min":{"1min":0.24399999999999999,"5min":0.23999999999999999,"15min":0.23000000000000001},"max":{"1min":0.54200000000000004,"5min":7.016,"15min":7.016},"last":0.311},{"interface":"front","average":{"1min":0.42599999999999999,"5min":1.292,"15min":0.81100000000000005},"min":{"1min":0.26400000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.58099999999999996,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":1.2430000000000001,"15min":0.77600000000000002},"min":{"1min":0.27200000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.60099999999999998,"5min":9.7159999999999993,"15min":9.7159999999999993},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.41099999999999998,"5min":1.228,"15min":0.83199999999999996},"min":{"1min":0.26500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56899999999999995,"5min":5.5279999999999996,"15min":5.5279999999999996},"last":0.28599999999999998}]},{"osd":4,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":1.1459999999999999,"15min":0.71099999999999997},"min":{"1min":0.23400000000000001,"5min":0.218,"15min":0.20699999999999999},"max":{"1min":0.52100000000000002,"5min":7.8099999999999996,"15min":7.8099999999999996},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":1.522,"15min":0.871},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.622,"5min":9.9800000000000004,"15min":9.9800000000000004},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":1.2529999999999999,"15min":0.79600000000000004},"min":{"1min":0.251,"5min":0.24299999999999999,"15min":0.23799999999999999},"max":{"1min":0.60099999999999998,"5min":6.6890000000000001,"15min":6.6890000000000001},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":1.3939999999999999,"15min":0.88700000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60599999999999998,"5min":13.016,"15min":13.016},"last":0.47499999999999998}]},{"osd":7,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":1.3300000000000001,"15min":0.82399999999999995},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.63400000000000001,"5min":9.2710000000000008,"15min":9.2710000000000008},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.46800000000000003,"5min":1.3979999999999999,"15min":0.874},"min":{"1min":0.26300000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.69199999999999995,"5min":6.1849999999999996,"15min":6.1849999999999996},"last":0.80700000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542325,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1894000,"kb_used_data":845416,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92477840,"statfs":{"total":96636764160,"available":94697308160,"internally_reserved":1073741824,"allocated":865705984,"data_stored":1216970145,"data_compressed":34671672,"data_compressed_allocated":351432704,"data_compressed_original":702865408,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,1,2,2,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.63300000000000001,"15min":0.49199999999999999},"min":{"1min":0.189,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.46700000000000003,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.74199999999999999,"15min":0.57499999999999996},"min":{"1min":0.21199999999999999,"5min":0.20499999999999999,"15min":0.19800000000000001},"max":{"1min":0.56100000000000005,"5min":7.3920000000000003,"15min":7.3920000000000003},"last":0.52200000000000002}]},{"osd":1,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.78300000000000003,"15min":0.62},"min":{"1min":0.26900000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.64500000000000002,"5min":5.46,"15min":7.859},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.35699999999999998,"5min":1.095,"15min":0.71099999999999997},"min":{"1min":0.24399999999999999,"5min":0.20999999999999999,"15min":0.20499999999999999},"max":{"1min":0.58499999999999996,"5min":6.8319999999999999,"15min":8.1300000000000008},"last":0.63}]},{"osd":2,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.97499999999999998,"15min":0.64400000000000002},"min":{"1min":0.26700000000000002,"5min":0.23599999999999999,"15min":0.214},"max":{"1min":0.626,"5min":6.5679999999999996,"15min":6.5679999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.90600000000000003,"15min":0.69399999999999995},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.55500000000000005,"5min":5.6459999999999999,"15min":5.6459999999999999},"last":0.47199999999999998}]},{"osd":3,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":1.089,"15min":0.71999999999999997},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.22700000000000001},"max":{"1min":0.54000000000000004,"5min":7.1189999999999998,"15min":7.1189999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.46600000000000003,"5min":1.0740000000000001,"15min":0.72699999999999998},"min":{"1min":0.29099999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59399999999999997,"5min":7.0780000000000003,"15min":7.0780000000000003},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.91600000000000004,"15min":0.61899999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.223},"max":{"1min":0.68400000000000005,"5min":6.5880000000000001,"15min":6.5880000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.79200000000000004,"15min":0.61899999999999999},"min":{"1min":0.32100000000000001,"5min":0.253,"15min":0.192},"max":{"1min":0.64100000000000001,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":0.44}]},{"osd":6,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":1.157,"15min":0.84899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.247},"max":{"1min":0.59799999999999998,"5min":10.731,"15min":18.593},"last":0.497},{"interface":"front","average":{"1min":0.45200000000000001,"5min":1.1850000000000001,"15min":0.84999999999999998},"min":{"1min":0.30199999999999999,"5min":0.25700000000000001,"15min":0.246},"max":{"1min":0.63100000000000001,"5min":8.2870000000000008,"15min":18.402000000000001},"last":0.80300000000000005}]},{"osd":7,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":1.1639999999999999,"15min":0.74399999999999999},"min":{"1min":0.316,"5min":0.27300000000000002,"15min":0.245},"max":{"1min":0.629,"5min":9.0570000000000004,"15min":9.0570000000000004},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.93799999999999994,"15min":0.68999999999999995},"min":{"1min":0.30199999999999999,"5min":0.29599999999999999,"15min":0.253},"max":{"1min":0.73799999999999999,"5min":11.67,"15min":11.67},"last":0.83499999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509621,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2542472,"kb_used_data":1493888,"kb_used_omap":1390,"kb_used_meta":1047185,"kb_avail":91829368,"statfs":{"total":96636764160,"available":94033272832,"internally_reserved":1073741824,"allocated":1529741312,"data_stored":2148448117,"data_compressed":60589493,"data_compressed_allocated":618872832,"data_compressed_original":1237745664,"omap_allocated":1423856,"internal_metadata":1072317968},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.71399999999999997,"15min":0.53600000000000003},"min":{"1min":0.185,"5min":0.159,"15min":0.156},"max":{"1min":0.52200000000000002,"5min":6.6529999999999996,"15min":6.6529999999999996},"last":2.1320000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.65100000000000002,"15min":0.47899999999999998},"min":{"1min":0.20300000000000001,"5min":0.17999999999999999,"15min":0.16400000000000001},"max":{"1min":0.56200000000000006,"5min":4.8979999999999997,"15min":5.0830000000000002},"last":1.075}]},{"osd":2,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.81200000000000006,"15min":0.54000000000000004},"min":{"1min":0.249,"5min":0.17799999999999999,"15min":0.17199999999999999},"max":{"1min":0.52300000000000002,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":1.8380000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.83799999999999997,"15min":0.57699999999999996},"min":{"1min":0.21299999999999999,"5min":0.16200000000000001,"15min":0.152},"max":{"1min":0.49199999999999999,"5min":10.241,"15min":10.241},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.67200000000000004,"15min":0.49399999999999999},"min":{"1min":0.20000000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.46100000000000002,"5min":4.8879999999999999,"15min":5.0709999999999997},"last":3.9870000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.84199999999999997,"15min":0.60499999999999998},"min":{"1min":0.26100000000000001,"5min":0.20699999999999999,"15min":0.20000000000000001},"max":{"1min":0.57499999999999996,"5min":5.0350000000000001,"15min":5.1710000000000003},"last":4.0439999999999996}]},{"osd":4,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.82699999999999996,"15min":0.66000000000000003},"min":{"1min":0.28199999999999997,"5min":0.224,"15min":0.224},"max":{"1min":0.59499999999999997,"5min":5.452,"15min":5.452},"last":7.1879999999999997},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.876,"15min":0.65900000000000003},"min":{"1min":0.35699999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.81000000000000005,"5min":5.274,"15min":5.274},"last":1.111}]},{"osd":5,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":1.0029999999999999,"15min":0.751},"min":{"1min":0.30499999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60899999999999999,"5min":6.5910000000000002,"15min":6.5910000000000002},"last":2.3730000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.73099999999999998,"15min":0.59999999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.59799999999999998,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":1.0469999999999999,"15min":0.84299999999999997},"min":{"1min":0.32600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.75800000000000001,"5min":5.1749999999999998,"15min":24.530999999999999},"last":7.0119999999999996},{"interface":"front","average":{"1min":0.47699999999999998,"5min":1.179,"15min":0.89700000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.26200000000000001},"max":{"1min":0.69099999999999995,"5min":8.7899999999999991,"15min":24.390000000000001},"last":2.488}]},{"osd":7,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":1.0309999999999999,"15min":0.88100000000000001},"min":{"1min":0.40500000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68999999999999995,"5min":7.2539999999999996,"15min":24.459},"last":2.1749999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.78100000000000003,"15min":0.71099999999999997},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.60199999999999998,"5min":5.9989999999999997,"15min":24.559000000000001},"last":0.73699999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509623,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2948880,"kb_used_data":1900296,"kb_used_omap":1514,"kb_used_meta":1047061,"kb_avail":91422960,"statfs":{"total":96636764160,"available":93617111040,"internally_reserved":1073741824,"allocated":1945903104,"data_stored":2704128807,"data_compressed":73906343,"data_compressed_allocated":758386688,"data_compressed_original":1516773376,"omap_allocated":1550595,"internal_metadata":1072191229},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.498,"15min":0.46600000000000003},"min":{"1min":0.20699999999999999,"5min":0.152,"15min":0.152},"max":{"1min":0.44500000000000001,"5min":3.7069999999999999,"15min":8.6370000000000005},"last":3.0150000000000001},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.88200000000000001,"15min":0.58699999999999997},"min":{"1min":0.23699999999999999,"5min":0.19900000000000001,"15min":0.17599999999999999},"max":{"1min":0.49399999999999999,"5min":8.5950000000000006,"15min":8.5950000000000006},"last":2.976}]},{"osd":2,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":1.0109999999999999,"15min":0.61799999999999999},"min":{"1min":0.20100000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.53400000000000003,"5min":8.8989999999999991,"15min":8.8989999999999991},"last":4.1959999999999997},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.80100000000000005,"15min":0.61699999999999999},"min":{"1min":0.215,"5min":0.20200000000000001,"15min":0.192},"max":{"1min":0.51600000000000001,"5min":12.585000000000001,"15min":12.585000000000001},"last":0.372}]},{"osd":3,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.78900000000000003,"15min":0.63900000000000001},"min":{"1min":0.253,"5min":0.218,"15min":0.218},"max":{"1min":0.56000000000000005,"5min":5.7130000000000001,"15min":8.6690000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.372,"5min":0.89800000000000002,"15min":0.63700000000000001},"min":{"1min":0.23599999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.57199999999999995,"5min":7.1840000000000002,"15min":8.4570000000000007},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":1.054,"15min":0.79500000000000004},"min":{"1min":0.29699999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.51700000000000002,"5min":8.9600000000000009,"15min":8.9600000000000009},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.72099999999999997,"15min":0.68200000000000005},"min":{"1min":0.308,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59999999999999998,"5min":7.117,"15min":9.0879999999999992},"last":0.45800000000000002}]},{"osd":5,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":1.2789999999999999,"15min":0.86199999999999999},"min":{"1min":0.25800000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.56699999999999995,"5min":8.5519999999999996,"15min":8.5519999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.42699999999999999,"5min":1.294,"15min":0.89300000000000002},"min":{"1min":0.28499999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68100000000000005,"5min":8.9979999999999993,"15min":8.9979999999999993},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":1.516,"15min":0.95999999999999996},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.26800000000000002},"max":{"1min":0.58899999999999997,"5min":10.012,"15min":10.012},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":1.637,"15min":1.075},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":0.65400000000000003,"5min":10.760999999999999,"15min":10.760999999999999},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":1.0660000000000001,"15min":0.81399999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.61499999999999999,"5min":12.641999999999999,"15min":12.641999999999999},"last":0.505},{"interface":"front","average":{"1min":0.53000000000000003,"5min":1.135,"15min":0.82099999999999995},"min":{"1min":0.39000000000000001,"5min":0.313,"15min":0.30299999999999999},"max":{"1min":0.65400000000000003,"5min":7.306,"15min":8.8460000000000001},"last":0.69099999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509621,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2257004,"kb_used_data":1208420,"kb_used_omap":1237,"kb_used_meta":1047338,"kb_avail":92114836,"statfs":{"total":96636764160,"available":94325592064,"internally_reserved":1073741824,"allocated":1237422080,"data_stored":1724658059,"data_compressed":47764176,"data_compressed_allocated":487411712,"data_compressed_original":974823424,"omap_allocated":1267315,"internal_metadata":1072474509},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.82899999999999996,"15min":0.55500000000000005},"min":{"1min":0.183,"5min":0.161,"15min":0.153},"max":{"1min":0.46999999999999997,"5min":6.8869999999999996,"15min":6.8869999999999996},"last":6.3920000000000003},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.90400000000000003,"15min":0.59099999999999997},"min":{"1min":0.20300000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.52800000000000002,"5min":4.907,"15min":4.907},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.81200000000000006,"15min":0.55100000000000005},"min":{"1min":0.254,"5min":0.182,"15min":0.16},"max":{"1min":0.52100000000000002,"5min":7.0449999999999999,"15min":7.0449999999999999},"last":6.1840000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":1.0529999999999999,"15min":0.64500000000000002},"min":{"1min":0.28599999999999998,"5min":0.223,"15min":0.223},"max":{"1min":0.51800000000000002,"5min":9.4179999999999993,"15min":9.4179999999999993},"last":6.2510000000000003}]},{"osd":3,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":1.0169999999999999,"15min":0.66200000000000003},"min":{"1min":0.20499999999999999,"5min":0.191,"15min":0.184},"max":{"1min":0.47199999999999998,"5min":6.5789999999999997,"15min":6.5789999999999997},"last":4.7990000000000004},{"interface":"front","average":{"1min":0.37,"5min":1.071,"15min":0.69099999999999995},"min":{"1min":0.24399999999999999,"5min":0.20399999999999999,"15min":0.20100000000000001},"max":{"1min":0.48599999999999999,"5min":8.891,"15min":8.891},"last":4.7320000000000002}]},{"osd":4,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.97699999999999998,"15min":0.73299999999999998},"min":{"1min":0.27500000000000002,"5min":0.27100000000000002,"15min":0.26700000000000002},"max":{"1min":0.56299999999999994,"5min":9.0619999999999994,"15min":9.0619999999999994},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.44,"5min":1.002,"15min":0.76500000000000001},"min":{"1min":0.31900000000000001,"5min":0.26400000000000001,"15min":0.25900000000000001},"max":{"1min":0.69799999999999995,"5min":5.5970000000000004,"15min":5.5970000000000004},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":1.1319999999999999,"15min":0.79200000000000004},"min":{"1min":0.26700000000000002,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":0.504,"5min":8.3539999999999992,"15min":8.3539999999999992},"last":4.5339999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":1.0740000000000001,"15min":0.77500000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27500000000000002},"max":{"1min":0.57599999999999996,"5min":8.9949999999999992,"15min":8.9949999999999992},"last":0.52100000000000002}]},{"osd":6,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":1.96,"15min":1.202},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.61099999999999999,"5min":68.593000000000004,"15min":68.593000000000004},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.443,"5min":2.0289999999999999,"15min":1.252},"min":{"1min":0.32600000000000001,"5min":0.307,"15min":0.28999999999999998},"max":{"1min":0.55600000000000005,"5min":68.489000000000004,"15min":68.489000000000004},"last":9.3030000000000008}]},{"osd":7,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":1.3120000000000001,"15min":0.878},"min":{"1min":0.34799999999999998,"5min":0.33200000000000002,"15min":0.32700000000000001},"max":{"1min":0.65800000000000003,"5min":6.2519999999999998,"15min":6.2519999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.48099999999999998,"5min":1.163,"15min":0.83399999999999996},"min":{"1min":0.374,"5min":0.32300000000000001,"15min":0.311},"max":{"1min":0.59999999999999998,"5min":9.0999999999999996,"15min":9.0999999999999996},"last":4.484}]}]},{"osd":3,"up_from":15,"seq":64424509623,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2936348,"kb_used_data":1887764,"kb_used_omap":1502,"kb_used_meta":1047073,"kb_avail":91435492,"statfs":{"total":96636764160,"available":93629943808,"internally_reserved":1073741824,"allocated":1933070336,"data_stored":2695625511,"data_compressed":74354548,"data_compressed_allocated":762716160,"data_compressed_original":1525432320,"omap_allocated":1538120,"internal_metadata":1072203704},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,3,1,7,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.255,"5min":0.83899999999999997,"15min":0.58999999999999997},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.154},"max":{"1min":0.51200000000000001,"5min":7.6989999999999998,"15min":7.6989999999999998},"last":3.661},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.71999999999999997,"15min":0.46999999999999997},"min":{"1min":0.20999999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.52800000000000002,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":1.1439999999999999,"15min":0.71599999999999997},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.17999999999999999},"max":{"1min":0.52600000000000002,"5min":7.5549999999999997,"15min":7.5549999999999997},"last":4.6340000000000003},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.93300000000000005,"15min":0.61899999999999999},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.182},"max":{"1min":0.46400000000000002,"5min":7.585,"15min":7.585},"last":4.5810000000000004}]},{"osd":2,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":1.0149999999999999,"15min":0.71199999999999997},"min":{"1min":0.216,"5min":0.21199999999999999,"15min":0.18099999999999999},"max":{"1min":0.622,"5min":7.6379999999999999,"15min":7.6379999999999999},"last":3.7989999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.88800000000000001,"15min":0.61899999999999999},"min":{"1min":0.24099999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.59399999999999997,"5min":7.6369999999999996,"15min":7.6369999999999996},"last":1.909}]},{"osd":4,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":1.2230000000000001,"15min":0.80100000000000005},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.54000000000000004,"5min":6.9569999999999999,"15min":6.9569999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":1.0760000000000001,"15min":0.78700000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25700000000000001},"max":{"1min":0.56799999999999995,"5min":5.6849999999999996,"15min":5.6849999999999996},"last":3.7080000000000002}]},{"osd":5,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":1.24,"15min":0.82599999999999996},"min":{"1min":0.33900000000000002,"5min":0.29399999999999998,"15min":0.27900000000000003},"max":{"1min":0.501,"5min":9.7520000000000007,"15min":9.7520000000000007},"last":1.7290000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":1.23,"15min":0.81200000000000006},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55700000000000005,"5min":8.8650000000000002,"15min":8.8650000000000002},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":1.4810000000000001,"15min":0.93400000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.502,"5min":8.0009999999999994,"15min":8.0009999999999994},"last":3.77},{"interface":"front","average":{"1min":0.45500000000000002,"5min":1.429,"15min":0.94199999999999995},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58599999999999997,"5min":9.8759999999999994,"15min":9.8759999999999994},"last":1.766}]},{"osd":7,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":1.149,"15min":0.81200000000000006},"min":{"1min":0.35699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.58399999999999996,"5min":7.5149999999999997,"15min":7.5149999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":1.109,"15min":0.84399999999999997},"min":{"1min":0.373,"5min":0.312,"15min":0.312},"max":{"1min":0.58099999999999996,"5min":6.8079999999999998,"15min":6.8079999999999998},"last":3.7400000000000002}]}]}]}} 2020-04-02T23:39:34.070 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2020-04-02T23:24:46.979073+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=46, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.071 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2020-04-02T23:24:43.961930+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=43, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.071 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2020-04-02T23:24:46.979073+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=46, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.071 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2020-04-02T23:24:40.944127+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.071 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2020-04-02T23:24:46.979073+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=46, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.071 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2020-04-02T23:24:40.944127+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.072 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2020-04-02T23:24:46.979073+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=46, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.072 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-04-02T23:24:40.944127+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.072 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-04-02T23:24:28.069299+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=28, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.072 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2020-04-02T23:24:43.961930+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=43, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.072 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2020-04-02T23:24:46.979073+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=46, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.073 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-04-02T23:24:40.944127+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.073 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2020-04-02T23:24:43.961930+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=43, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.073 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2020-04-02T23:24:46.979073+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=46, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.073 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-04-02T23:24:40.944127+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.073 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2020-04-02T23:24:43.961930+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=43, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.073 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2020-04-02T23:24:46.979073+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=46, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.074 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2020-04-02T23:24:43.961930+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=43, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.074 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2020-04-02T23:24:46.979073+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=46, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.074 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-04-02T23:24:40.944127+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.074 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2020-04-02T23:24:43.961930+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=43, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:34.074 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2020-04-02T23:39:54.076 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:39:54.120 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-02T23:39:54.725 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.721+0000 7efe2261d700 1 Processor -- start 2020-04-02T23:39:54.725 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.721+0000 7efe2261d700 1 -- start start 2020-04-02T23:39:54.726 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.722+0000 7efe2261d700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe1c0ad460 0x7efe1c0a83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:54.726 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.722+0000 7efe2261d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efe1c0a9930 0x7efe1c0a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:39:54.726 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.722+0000 7efe2261d700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe1c0a4060 con 0x7efe1c0a8840 2020-04-02T23:39:54.726 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.722+0000 7efe2261d700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1c0626b0 con 0x7efe1c0a9930 2020-04-02T23:39:54.727 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.722+0000 7efe2261d700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c060f70 con 0x7efe1c0ad460 2020-04-02T23:39:54.729 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.723+0000 7efe1b7fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7efe1c0a8840 0x7efe1c0a9220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60246/0 (socket says 172.21.15.42:60246) 2020-04-02T23:39:54.730 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.723+0000 7efe1b7fe700 1 -- 172.21.15.42:0/4046269088 learned_addr learned my addr 172.21.15.42:0/4046269088 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:39:54.730 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.725+0000 7efe20bba700 1 --2- 172.21.15.42:0/4046269088 >> v2:172.21.15.42:3300/0 conn(0x7efe1c0a9930 0x7efe1c0a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:54.730 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.725+0000 7efe1bfff700 1 --2- 172.21.15.42:0/4046269088 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe1c0ad460 0x7efe1c0a83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:54.730 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.725+0000 7efe20bba700 1 -- 172.21.15.42:0/4046269088 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe1c0ad460 msgr2=0x7efe1c0a83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:39:54.730 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.725+0000 7efe20bba700 1 --2- 172.21.15.42:0/4046269088 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe1c0ad460 0x7efe1c0a83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:54.730 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.725+0000 7efe20bba700 1 -- 172.21.15.42:0/4046269088 >> v1:172.21.15.42:6789/0 conn(0x7efe1c0a8840 legacy=0x7efe1c0a9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:54.730 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.725+0000 7efe20bba700 1 -- 172.21.15.42:0/4046269088 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1c060400 con 0x7efe1c0a9930 2020-04-02T23:39:54.731 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.725+0000 7efe20bba700 1 --2- 172.21.15.42:0/4046269088 >> v2:172.21.15.42:3300/0 conn(0x7efe1c0a9930 0x7efe1c0a9da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efe100010d0 tx=0x7efe14007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:54.731 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.725+0000 7efe20bba700 1 --2- 172.21.15.42:0/4046269088 >> v2:172.21.15.42:3300/0 conn(0x7efe1c0a9930 0x7efe1c0a9da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efe100010d0 tx=0x7efe14007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:54.731 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.725+0000 7efe20bba700 1 --2- 172.21.15.42:0/4046269088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c0a9930 0x7efe1c0a9da0 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7efe100010d0 tx=0x7efe14007dc0).ready entity=mon.0 client_cookie=1de62e1aee218520 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:54.731 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.725+0000 7efe20bba700 1 --2- 172.21.15.42:0/4046269088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c0a9930 0x7efe1c0a9da0 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7efe100010d0 tx=0x7efe14007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:54.731 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.725+0000 7efe20bba700 1 --2- 172.21.15.42:0/4046269088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c0a9930 0x7efe1c0a9da0 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7efe100010d0 tx=0x7efe14007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:54.731 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.725+0000 7efe20bba700 1 --2- 172.21.15.42:0/4046269088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c0a9930 0x7efe1c0a9da0 secure :-1 s=THROTTLE_DONE pgs=242 cs=0 l=1 rx=0x7efe100010d0 tx=0x7efe14007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:54.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.728+0000 7efe1affd700 1 -- 172.21.15.42:0/4046269088 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe14008270 con 0x7efe1c0a9930 2020-04-02T23:39:54.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.728+0000 7efe1affd700 1 -- 172.21.15.42:0/4046269088 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe140017d0 con 0x7efe1c0a9930 2020-04-02T23:39:54.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.728+0000 7efe1affd700 1 -- 172.21.15.42:0/4046269088 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe14001bb0 con 0x7efe1c0a9930 2020-04-02T23:39:54.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.728+0000 7efe2261d700 1 -- 172.21.15.42:0/4046269088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c0a9930 msgr2=0x7efe1c0a9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:54.732 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.728+0000 7efe2261d700 1 --2- 172.21.15.42:0/4046269088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c0a9930 0x7efe1c0a9da0 secure :-1 s=READY pgs=242 cs=0 l=1 rx=0x7efe100010d0 tx=0x7efe14007dc0).stop 2020-04-02T23:39:54.736 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.734+0000 7efe2261d700 1 -- 172.21.15.42:0/4046269088 shutdown_connections 2020-04-02T23:39:54.736 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.734+0000 7efe2261d700 1 --2- 172.21.15.42:0/4046269088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c0a9930 0x7efe1c0a9da0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:54.736 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.734+0000 7efe2261d700 1 --2- 172.21.15.42:0/4046269088 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe1c0ad460 0x7efe1c0a83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:39:54.736 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.734+0000 7efe2261d700 1 -- 172.21.15.42:0/4046269088 >> 172.21.15.42:0/4046269088 conn(0x7efe1c062930 msgr2=0x7efe1c0acb90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:54.736 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.734+0000 7efe2261d700 1 -- 172.21.15.42:0/4046269088 shutdown_connections 2020-04-02T23:39:54.737 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.734+0000 7efe2261d700 1 -- 172.21.15.42:0/4046269088 wait complete. 2020-04-02T23:39:54.742 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.735+0000 7efe2261d700 1 Processor -- start 2020-04-02T23:39:54.742 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.737+0000 7efe2261d700 1 -- start start 2020-04-02T23:39:54.743 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.738+0000 7efe2261d700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe1c0a8840 0x7efe1c09d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:54.743 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.738+0000 7efe2261d700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efe1c0a9930 0x7efe1c09f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:54.743 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.738+0000 7efe2261d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efe1c0ad460 0x7efe1c0a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:54.743 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.738+0000 7efe2261d700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1c09def0 con 0x7efe1c0ad460 2020-04-02T23:39:54.743 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.738+0000 7efe2261d700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1c09dc50 con 0x7efe1c0a9930 2020-04-02T23:39:54.743 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.738+0000 7efe2261d700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c09f400 con 0x7efe1c0a8840 2020-04-02T23:39:54.743 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.740+0000 7efe20bba700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efe1c0ad460 0x7efe1c0a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:54.744 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.740+0000 7efe20bba700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efe1c0ad460 0x7efe1c0a5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40824/0 (socket says 172.21.15.42:40824) 2020-04-02T23:39:54.744 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.740+0000 7efe20bba700 1 -- 172.21.15.42:0/3418715417 learned_addr learned my addr 172.21.15.42:0/3418715417 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:39:54.744 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.740+0000 7efe1bfff700 1 --2- 172.21.15.42:0/3418715417 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe1c0a8840 0x7efe1c09d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:54.744 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.740+0000 7efe20bba700 1 -- 172.21.15.42:0/3418715417 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe1c0a8840 msgr2=0x7efe1c09d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:54.744 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.740+0000 7efe20bba700 1 --2- 172.21.15.42:0/3418715417 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe1c0a8840 0x7efe1c09d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:54.744 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.740+0000 7efe20bba700 1 -- 172.21.15.42:0/3418715417 >> v2:172.21.15.84:3300/0 conn(0x7efe1c0a9930 msgr2=0x7efe1c09f8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2020-04-02T23:39:54.744 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.740+0000 7efe20bba700 1 --2- 172.21.15.42:0/3418715417 >> v2:172.21.15.84:3300/0 conn(0x7efe1c0a9930 0x7efe1c09f8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:54.745 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.740+0000 7efe20bba700 1 -- 172.21.15.42:0/3418715417 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1c0a6010 con 0x7efe1c0ad460 2020-04-02T23:39:54.745 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.740+0000 7efe20bba700 1 --2- 172.21.15.42:0/3418715417 >> v2:172.21.15.42:3300/0 conn(0x7efe1c0ad460 0x7efe1c0a5bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe100010d0 tx=0x7efe14007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:54.745 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.740+0000 7efe20bba700 1 --2- 172.21.15.42:0/3418715417 >> v2:172.21.15.42:3300/0 conn(0x7efe1c0ad460 0x7efe1c0a5bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe100010d0 tx=0x7efe14007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:54.745 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.740+0000 7efe20bba700 1 --2- 172.21.15.42:0/3418715417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c0ad460 0x7efe1c0a5bb0 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7efe100010d0 tx=0x7efe14007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:54.749 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.743+0000 7efe20bba700 1 --2- 172.21.15.42:0/3418715417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c0ad460 0x7efe1c0a5bb0 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7efe100010d0 tx=0x7efe14007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:54.749 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.743+0000 7efe20bba700 1 --2- 172.21.15.42:0/3418715417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c0ad460 0x7efe1c0a5bb0 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7efe100010d0 tx=0x7efe14007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:54.749 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.743+0000 7efe20bba700 1 --2- 172.21.15.42:0/3418715417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c0ad460 0x7efe1c0a5bb0 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7efe100010d0 tx=0x7efe14007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:54.749 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.746+0000 7efe197fa700 1 -- 172.21.15.42:0/3418715417 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe14005c30 con 0x7efe1c0ad460 2020-04-02T23:39:54.750 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.746+0000 7efe197fa700 1 -- 172.21.15.42:0/3418715417 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe14005d90 con 0x7efe1c0ad460 2020-04-02T23:39:54.750 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.746+0000 7efe197fa700 1 -- 172.21.15.42:0/3418715417 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe1400a6e0 con 0x7efe1c0ad460 2020-04-02T23:39:54.753 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.752+0000 7efe2261d700 1 -- 172.21.15.42:0/3418715417 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1c1355f0 con 0x7efe1c0ad460 2020-04-02T23:39:54.754 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.752+0000 7efe2261d700 1 -- 172.21.15.42:0/3418715417 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe1c09d4e0 con 0x7efe1c0ad460 2020-04-02T23:39:54.754 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.753+0000 7efe20bba700 1 --2- 172.21.15.42:0/3418715417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c0ad460 0x7efe1c0a5bb0 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7efe100010d0 tx=0x7efe14007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:54.755 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.753+0000 7efe197fa700 1 -- 172.21.15.42:0/3418715417 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7efe1400a840 con 0x7efe1c0ad460 2020-04-02T23:39:54.755 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.753+0000 7efe20bba700 1 --2- 172.21.15.42:0/3418715417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c0ad460 0x7efe1c0a5bb0 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7efe100010d0 tx=0x7efe14007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:54.756 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.754+0000 7efe197fa700 1 --2- 172.21.15.42:0/3418715417 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7efe0804d6c0 0x7efe0804fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:39:54.756 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.754+0000 7efe197fa700 1 -- 172.21.15.42:0/3418715417 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7efe14083f80 con 0x7efe1c0ad460 2020-04-02T23:39:54.756 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.754+0000 7efe1bfff700 1 --2- 172.21.15.42:0/3418715417 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7efe0804d6c0 0x7efe0804fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:39:54.757 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.754+0000 7efe1bfff700 1 --2- 172.21.15.42:0/3418715417 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7efe0804d6c0 0x7efe0804fb80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe0c002f30 tx=0x7efe0c009840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:54.757 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.754+0000 7efe1bfff700 1 --2- 172.21.15.42:0/3418715417 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7efe0804d6c0 0x7efe0804fb80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe0c002f30 tx=0x7efe0c009840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:54.757 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.754+0000 7efe1bfff700 1 --2- 172.21.15.42:0/3418715417 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7efe0804d6c0 0x7efe0804fb80 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7efe0c002f30 tx=0x7efe0c009840).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:39:54.778 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.776+0000 7efe2261d700 1 -- 172.21.15.42:0/3418715417 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe1c056c50 con 0x7efe1c0ad460 2020-04-02T23:39:54.785 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.783+0000 7efe20bba700 1 --2- 172.21.15.42:0/3418715417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c0ad460 0x7efe1c0a5bb0 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7efe100010d0 tx=0x7efe14007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:54.785 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:54.783+0000 7efe197fa700 1 -- 172.21.15.42:0/3418715417 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7efe1405f7a0 con 0x7efe1c0ad460 2020-04-02T23:39:55.082 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:55.080+0000 7efe2261d700 1 -- 172.21.15.42:0/3418715417 --> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe1c0ab710 con 0x7efe0804d6c0 2020-04-02T23:39:55.094 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:55.092+0000 7efe1bfff700 1 --2- 172.21.15.42:0/3418715417 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7efe0804d6c0 0x7efe0804fb80 secure :-1 s=THROTTLE_DONE pgs=126 cs=0 l=1 rx=0x7efe0c002f30 tx=0x7efe0c009840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:39:55.094 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:55.092+0000 7efe197fa700 1 -- 172.21.15.42:0/3418715417 <== mgr.4100 v2:172.21.15.84:6800/23437 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+107281 (secure 0 0 0) 0x7efe1c0ab710 con 0x7efe0804d6c0 2020-04-02T23:39:55.117 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:39:55.126 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:55.124+0000 7efe2261d700 1 -- 172.21.15.42:0/3418715417 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7efe0804d6c0 msgr2=0x7efe0804fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:55.126 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:55.124+0000 7efe2261d700 1 --2- 172.21.15.42:0/3418715417 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7efe0804d6c0 0x7efe0804fb80 secure :-1 s=READY pgs=126 cs=0 l=1 rx=0x7efe0c002f30 tx=0x7efe0c009840).stop 2020-04-02T23:39:55.126 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:55.124+0000 7efe2261d700 1 -- 172.21.15.42:0/3418715417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c0ad460 msgr2=0x7efe1c0a5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:39:55.126 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:55.124+0000 7efe2261d700 1 --2- 172.21.15.42:0/3418715417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c0ad460 0x7efe1c0a5bb0 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7efe100010d0 tx=0x7efe14007dc0).stop 2020-04-02T23:39:55.128 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:55.127+0000 7efe2261d700 1 -- 172.21.15.42:0/3418715417 shutdown_connections 2020-04-02T23:39:55.129 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:55.127+0000 7efe2261d700 1 --2- 172.21.15.42:0/3418715417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe1c0ad460 0x7efe1c0a5bb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:55.129 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:55.127+0000 7efe2261d700 1 --2- 172.21.15.42:0/3418715417 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7efe0804d6c0 0x7efe0804fb80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:55.129 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:55.127+0000 7efe2261d700 1 --2- 172.21.15.42:0/3418715417 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7efe1c0a8840 0x7efe1c09d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:55.129 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:55.127+0000 7efe2261d700 1 --2- 172.21.15.42:0/3418715417 >> v2:172.21.15.84:3300/0 conn(0x7efe1c0a9930 0x7efe1c09f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:39:55.129 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:55.127+0000 7efe2261d700 1 -- 172.21.15.42:0/3418715417 >> 172.21.15.42:0/3418715417 conn(0x7efe1c062930 msgr2=0x7efe1c0a7230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:39:55.129 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:55.127+0000 7efe2261d700 1 -- 172.21.15.42:0/3418715417 shutdown_connections 2020-04-02T23:39:55.129 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:39:55.127+0000 7efe2261d700 1 -- 172.21.15.42:0/3418715417 wait complete. 2020-04-02T23:39:55.130 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2020-04-02T23:39:55.149 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":485,"stamp":"2020-04-02T23:39:53.290555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2189753108,"num_objects":547,"num_object_clones":0,"num_object_copies":2134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":547,"num_whiteouts":0,"num_read":29,"num_read_kb":65,"num_write":447659,"num_write_kb":14885690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23176,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82342,"ondisk_log_size":82342,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":11238368,"kb_used_data":2848388,"kb_used_omap":7386,"kb_used_meta":8381221,"kb_avail":743736352,"statfs":{"total":773094113280,"available":761586024448,"internally_reserved":8589934592,"allocated":2916749312,"data_stored":3833024352,"data_compressed":90666453,"data_compressed_allocated":917622784,"data_compressed_original":1835245568,"omap_allocated":7563560,"internal_metadata":8582371032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,3,3,6,9,7],"upper_bound":128},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4416602112,"num_objects":-1053,"num_object_clones":0,"num_object_copies":-4212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1053,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1054,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004853"},"pg_stats":[{"pgid":"4.2","version":"26'17201","reported_seq":"17212","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:48.769486+0000","last_change":"2020-04-02T23:24:47.993492+0000","last_active":"2020-04-02T23:39:48.769486+0000","last_peered":"2020-04-02T23:39:48.769486+0000","last_clean":"2020-04-02T23:39:48.769486+0000","last_became_active":"2020-04-02T23:24:47.993002+0000","last_became_peered":"2020-04-02T23:24:47.993002+0000","last_unstale":"2020-04-02T23:39:48.769486+0000","last_undegraded":"2020-04-02T23:39:48.769486+0000","last_fullsized":"2020-04-02T23:39:48.769486+0000","mapping_epoch":24,"log_start":"26'7149","ondisk_log_start":"26'7149","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10052,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":352321536,"num_objects":84,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58786,"num_write_kb":1925310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:27.185192+0000","last_change":"2020-04-02T23:39:27.185287+0000","last_active":"2020-04-02T23:39:27.185192+0000","last_peered":"2020-04-02T23:39:27.185192+0000","last_clean":"2020-04-02T23:39:27.185192+0000","last_became_active":"2020-04-02T23:24:42.210455+0000","last_became_peered":"2020-04-02T23:24:42.210455+0000","last_unstale":"2020-04-02T23:39:27.185192+0000","last_undegraded":"2020-04-02T23:39:27.185192+0000","last_fullsized":"2020-04-02T23:39:27.185192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:39:27.185184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:39:27.185184+0000","last_clean_scrub_stamp":"2020-04-02T23:39:27.185184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'31","reported_seq":"46","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:44.413193+0000","last_change":"2020-04-02T23:39:44.413193+0000","last_active":"2020-04-02T23:39:44.413193+0000","last_peered":"2020-04-02T23:39:44.413193+0000","last_clean":"2020-04-02T23:39:44.413193+0000","last_became_active":"2020-04-02T23:24:44.977559+0000","last_became_peered":"2020-04-02T23:24:44.977559+0000","last_unstale":"2020-04-02T23:39:44.413193+0000","last_undegraded":"2020-04-02T23:39:44.413193+0000","last_fullsized":"2020-04-02T23:39:44.413193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'30","last_scrub_stamp":"2020-04-02T23:39:44.413104+0000","last_deep_scrub":"26'30","last_deep_scrub_stamp":"2020-04-02T23:39:44.413104+0000","last_clean_scrub_stamp":"2020-04-02T23:39:44.413104+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"26'14472","reported_seq":"14483","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:48.737759+0000","last_change":"2020-04-02T23:24:48.354332+0000","last_active":"2020-04-02T23:39:48.737759+0000","last_peered":"2020-04-02T23:39:48.737759+0000","last_clean":"2020-04-02T23:39:48.737759+0000","last_became_active":"2020-04-02T23:24:48.353610+0000","last_became_peered":"2020-04-02T23:24:48.353610+0000","last_unstale":"2020-04-02T23:39:48.737759+0000","last_undegraded":"2020-04-02T23:39:48.737759+0000","last_fullsized":"2020-04-02T23:39:48.737759+0000","mapping_epoch":24,"log_start":"26'4413","ondisk_log_start":"26'4413","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10059,"ondisk_log_size":10059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48532,"num_write_kb":1720160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983921+0000","last_change":"2020-04-02T23:24:42.210957+0000","last_active":"2020-04-02T23:24:47.983921+0000","last_peered":"2020-04-02T23:24:47.983921+0000","last_clean":"2020-04-02T23:24:47.983921+0000","last_became_active":"2020-04-02T23:24:42.210546+0000","last_became_peered":"2020-04-02T23:24:42.210546+0000","last_unstale":"2020-04-02T23:24:47.983921+0000","last_undegraded":"2020-04-02T23:24:47.983921+0000","last_fullsized":"2020-04-02T23:24:47.983921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"26'1005","reported_seq":"1020","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:33.609262+0000","last_change":"2020-04-02T23:39:30.575219+0000","last_active":"2020-04-02T23:39:33.609262+0000","last_peered":"2020-04-02T23:39:33.609262+0000","last_clean":"2020-04-02T23:39:33.609262+0000","last_became_active":"2020-04-02T23:24:44.976952+0000","last_became_peered":"2020-04-02T23:24:44.976952+0000","last_unstale":"2020-04-02T23:39:33.609262+0000","last_undegraded":"2020-04-02T23:39:33.609262+0000","last_fullsized":"2020-04-02T23:39:33.609262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1003","last_scrub_stamp":"2020-04-02T23:39:30.575123+0000","last_deep_scrub":"26'1003","last_deep_scrub_stamp":"2020-04-02T23:39:30.575123+0000","last_clean_scrub_stamp":"2020-04-02T23:39:30.575123+0000","log_size":1005,"ondisk_log_size":1005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4471886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":999,"num_write_kb":4717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12050,"num_omap_keys":26,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"26'15805","reported_seq":"15816","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:48.790706+0000","last_change":"2020-04-02T23:24:48.354357+0000","last_active":"2020-04-02T23:39:48.790706+0000","last_peered":"2020-04-02T23:39:48.790706+0000","last_clean":"2020-04-02T23:39:48.790706+0000","last_became_active":"2020-04-02T23:24:48.353668+0000","last_became_peered":"2020-04-02T23:24:48.353668+0000","last_unstale":"2020-04-02T23:39:48.790706+0000","last_undegraded":"2020-04-02T23:39:48.790706+0000","last_fullsized":"2020-04-02T23:39:48.790706+0000","mapping_epoch":24,"log_start":"26'5773","ondisk_log_start":"26'5773","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10032,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53763,"num_write_kb":1823426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:42.677241+0000","last_change":"2020-04-02T23:39:42.677324+0000","last_active":"2020-04-02T23:39:42.677241+0000","last_peered":"2020-04-02T23:39:42.677241+0000","last_clean":"2020-04-02T23:39:42.677241+0000","last_became_active":"2020-04-02T23:24:41.966868+0000","last_became_peered":"2020-04-02T23:24:41.966868+0000","last_unstale":"2020-04-02T23:39:42.677241+0000","last_undegraded":"2020-04-02T23:39:42.677241+0000","last_fullsized":"2020-04-02T23:39:42.677241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:39:42.677235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:39:42.677235+0000","last_clean_scrub_stamp":"2020-04-02T23:39:42.677235+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"26'20","reported_seq":"34","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:33.608921+0000","last_change":"2020-04-02T23:39:28.228046+0000","last_active":"2020-04-02T23:39:33.608921+0000","last_peered":"2020-04-02T23:39:33.608921+0000","last_clean":"2020-04-02T23:39:33.608921+0000","last_became_active":"2020-04-02T23:24:44.977934+0000","last_became_peered":"2020-04-02T23:24:44.977934+0000","last_unstale":"2020-04-02T23:39:33.608921+0000","last_undegraded":"2020-04-02T23:39:33.608921+0000","last_fullsized":"2020-04-02T23:39:33.608921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'17","last_scrub_stamp":"2020-04-02T23:39:28.227959+0000","last_deep_scrub":"26'17","last_deep_scrub_stamp":"2020-04-02T23:39:28.227959+0000","last_clean_scrub_stamp":"2020-04-02T23:39:28.227959+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11126,"num_omap_keys":24,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"26'15875","reported_seq":"15886","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:48.153321+0000","last_change":"2020-04-02T23:24:48.354531+0000","last_active":"2020-04-02T23:39:48.153321+0000","last_peered":"2020-04-02T23:39:48.153321+0000","last_clean":"2020-04-02T23:39:48.153321+0000","last_became_active":"2020-04-02T23:24:48.353432+0000","last_became_peered":"2020-04-02T23:24:48.353432+0000","last_unstale":"2020-04-02T23:39:48.153321+0000","last_undegraded":"2020-04-02T23:39:48.153321+0000","last_fullsized":"2020-04-02T23:39:48.153321+0000","mapping_epoch":24,"log_start":"26'5841","ondisk_log_start":"26'5841","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10034,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":343932928,"num_objects":82,"num_object_clones":0,"num_object_copies":328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54814,"num_write_kb":1823228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983940+0000","last_change":"2020-04-02T23:24:42.200692+0000","last_active":"2020-04-02T23:24:47.983940+0000","last_peered":"2020-04-02T23:24:47.983940+0000","last_clean":"2020-04-02T23:24:47.983940+0000","last_became_active":"2020-04-02T23:24:42.200326+0000","last_became_peered":"2020-04-02T23:24:42.200326+0000","last_unstale":"2020-04-02T23:24:47.983940+0000","last_undegraded":"2020-04-02T23:24:47.983940+0000","last_fullsized":"2020-04-02T23:24:47.983940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:48.178748+0000","last_change":"2020-04-02T23:24:37.115477+0000","last_active":"2020-04-02T23:24:48.178748+0000","last_peered":"2020-04-02T23:24:48.178748+0000","last_clean":"2020-04-02T23:24:48.178748+0000","last_became_active":"2020-04-02T23:24:37.114896+0000","last_became_peered":"2020-04-02T23:24:37.114896+0000","last_unstale":"2020-04-02T23:24:48.178748+0000","last_undegraded":"2020-04-02T23:24:48.178748+0000","last_fullsized":"2020-04-02T23:24:48.178748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:28.069299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:28.069299+0000","last_clean_scrub_stamp":"2020-04-02T23:24:28.069299+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"26'4","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:31.951249+0000","last_change":"2020-04-02T23:39:31.951249+0000","last_active":"2020-04-02T23:39:31.951249+0000","last_peered":"2020-04-02T23:39:31.951249+0000","last_clean":"2020-04-02T23:39:31.951249+0000","last_became_active":"2020-04-02T23:24:44.977355+0000","last_became_peered":"2020-04-02T23:24:44.977355+0000","last_unstale":"2020-04-02T23:39:31.951249+0000","last_undegraded":"2020-04-02T23:39:31.951249+0000","last_fullsized":"2020-04-02T23:39:31.951249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2020-04-02T23:39:31.951151+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2020-04-02T23:39:31.951151+0000","last_clean_scrub_stamp":"2020-04-02T23:39:31.951151+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"26'16485","reported_seq":"16499","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:50.801812+0000","last_change":"2020-04-02T23:39:41.836654+0000","last_active":"2020-04-02T23:39:50.801812+0000","last_peered":"2020-04-02T23:39:50.801812+0000","last_clean":"2020-04-02T23:39:50.801812+0000","last_became_active":"2020-04-02T23:24:48.179989+0000","last_became_peered":"2020-04-02T23:24:48.179989+0000","last_unstale":"2020-04-02T23:39:50.801812+0000","last_undegraded":"2020-04-02T23:39:50.801812+0000","last_fullsized":"2020-04-02T23:39:50.801812+0000","mapping_epoch":24,"log_start":"26'6420","ondisk_log_start":"26'6420","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16248","last_scrub_stamp":"2020-04-02T23:39:41.836588+0000","last_deep_scrub":"26'16248","last_deep_scrub_stamp":"2020-04-02T23:39:41.836588+0000","last_clean_scrub_stamp":"2020-04-02T23:39:41.836588+0000","log_size":10065,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":239075328,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56149,"num_write_kb":1812324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983937+0000","last_change":"2020-04-02T23:24:41.967177+0000","last_active":"2020-04-02T23:24:47.983937+0000","last_peered":"2020-04-02T23:24:47.983937+0000","last_clean":"2020-04-02T23:24:47.983937+0000","last_became_active":"2020-04-02T23:24:41.966804+0000","last_became_peered":"2020-04-02T23:24:41.966804+0000","last_unstale":"2020-04-02T23:24:47.983937+0000","last_undegraded":"2020-04-02T23:24:47.983937+0000","last_fullsized":"2020-04-02T23:24:47.983937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"26'38","reported_seq":"81","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:41.893728+0000","last_change":"2020-04-02T23:39:41.893825+0000","last_active":"2020-04-02T23:39:41.893728+0000","last_peered":"2020-04-02T23:39:41.893728+0000","last_clean":"2020-04-02T23:39:41.893728+0000","last_became_active":"2020-04-02T23:24:44.977243+0000","last_became_peered":"2020-04-02T23:24:44.977243+0000","last_unstale":"2020-04-02T23:39:41.893728+0000","last_undegraded":"2020-04-02T23:39:41.893728+0000","last_fullsized":"2020-04-02T23:39:41.893728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'38","last_scrub_stamp":"2020-04-02T23:39:41.893720+0000","last_deep_scrub":"26'38","last_deep_scrub_stamp":"2020-04-02T23:39:41.893720+0000","last_clean_scrub_stamp":"2020-04-02T23:39:41.893720+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47478,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":65,"num_write":40,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"26'16799","reported_seq":"16810","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:48.715446+0000","last_change":"2020-04-02T23:24:48.354355+0000","last_active":"2020-04-02T23:39:48.715446+0000","last_peered":"2020-04-02T23:39:48.715446+0000","last_clean":"2020-04-02T23:39:48.715446+0000","last_became_active":"2020-04-02T23:24:48.353592+0000","last_became_peered":"2020-04-02T23:24:48.353592+0000","last_unstale":"2020-04-02T23:39:48.715446+0000","last_undegraded":"2020-04-02T23:39:48.715446+0000","last_fullsized":"2020-04-02T23:39:48.715446+0000","mapping_epoch":24,"log_start":"26'6726","ondisk_log_start":"26'6726","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10073,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":293601280,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56475,"num_write_kb":1907521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.984549+0000","last_change":"2020-04-02T23:24:41.965438+0000","last_active":"2020-04-02T23:24:47.984549+0000","last_peered":"2020-04-02T23:24:47.984549+0000","last_clean":"2020-04-02T23:24:47.984549+0000","last_became_active":"2020-04-02T23:24:41.965120+0000","last_became_peered":"2020-04-02T23:24:41.965120+0000","last_unstale":"2020-04-02T23:24:47.984549+0000","last_undegraded":"2020-04-02T23:24:47.984549+0000","last_fullsized":"2020-04-02T23:24:47.984549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'608","reported_seq":"619","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:20.435567+0000","last_change":"2020-04-02T23:24:44.980384+0000","last_active":"2020-04-02T23:39:20.435567+0000","last_peered":"2020-04-02T23:39:20.435567+0000","last_clean":"2020-04-02T23:39:20.435567+0000","last_became_active":"2020-04-02T23:24:44.980010+0000","last_became_peered":"2020-04-02T23:24:44.980010+0000","last_unstale":"2020-04-02T23:39:20.435567+0000","last_undegraded":"2020-04-02T23:39:20.435567+0000","last_fullsized":"2020-04-02T23:39:20.435567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":608,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194938,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":605,"num_write_kb":4299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"26'16097","reported_seq":"16108","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:51.342638+0000","last_change":"2020-04-02T23:24:48.180789+0000","last_active":"2020-04-02T23:39:51.342638+0000","last_peered":"2020-04-02T23:39:51.342638+0000","last_clean":"2020-04-02T23:39:51.342638+0000","last_became_active":"2020-04-02T23:24:48.179994+0000","last_became_peered":"2020-04-02T23:24:48.179994+0000","last_unstale":"2020-04-02T23:39:51.342638+0000","last_undegraded":"2020-04-02T23:39:51.342638+0000","last_fullsized":"2020-04-02T23:39:51.342638+0000","mapping_epoch":24,"log_start":"26'6010","ondisk_log_start":"26'6010","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10087,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":197132288,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54781,"num_write_kb":1835362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'12","reported_seq":"23","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:33.792207+0000","last_change":"2020-04-02T23:24:44.979136+0000","last_active":"2020-04-02T23:39:33.792207+0000","last_peered":"2020-04-02T23:39:33.792207+0000","last_clean":"2020-04-02T23:39:33.792207+0000","last_became_active":"2020-04-02T23:24:44.978145+0000","last_became_peered":"2020-04-02T23:24:44.978145+0000","last_unstale":"2020-04-02T23:39:33.792207+0000","last_undegraded":"2020-04-02T23:39:33.792207+0000","last_fullsized":"2020-04-02T23:39:33.792207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:43.961930+0000","last_clean_scrub_stamp":"2020-04-02T23:24:43.961930+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:27.922218+0000","last_change":"2020-04-02T23:39:27.922278+0000","last_active":"2020-04-02T23:39:27.922218+0000","last_peered":"2020-04-02T23:39:27.922218+0000","last_clean":"2020-04-02T23:39:27.922218+0000","last_became_active":"2020-04-02T23:24:42.311136+0000","last_became_peered":"2020-04-02T23:24:42.311136+0000","last_unstale":"2020-04-02T23:39:27.922218+0000","last_undegraded":"2020-04-02T23:39:27.922218+0000","last_fullsized":"2020-04-02T23:39:27.922218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:39:27.922214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:39:27.922214+0000","last_clean_scrub_stamp":"2020-04-02T23:39:27.922214+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"26'18441","reported_seq":"18451","reported_epoch":"26","state":"active+clean+scrubbing+deep","last_fresh":"2020-04-02T23:39:52.707066+0000","last_change":"2020-04-02T23:39:45.382967+0000","last_active":"2020-04-02T23:39:52.707066+0000","last_peered":"2020-04-02T23:39:52.707066+0000","last_clean":"2020-04-02T23:39:52.707066+0000","last_became_active":"2020-04-02T23:24:48.179883+0000","last_became_peered":"2020-04-02T23:24:48.179883+0000","last_unstale":"2020-04-02T23:39:52.707066+0000","last_undegraded":"2020-04-02T23:39:52.707066+0000","last_fullsized":"2020-04-02T23:39:52.707066+0000","mapping_epoch":24,"log_start":"26'8346","ondisk_log_start":"26'8346","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10095,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62342,"num_write_kb":2029025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983945+0000","last_change":"2020-04-02T23:24:42.311312+0000","last_active":"2020-04-02T23:24:47.983945+0000","last_peered":"2020-04-02T23:24:47.983945+0000","last_clean":"2020-04-02T23:24:47.983945+0000","last_became_active":"2020-04-02T23:24:42.310964+0000","last_became_peered":"2020-04-02T23:24:42.310964+0000","last_unstale":"2020-04-02T23:24:47.983945+0000","last_undegraded":"2020-04-02T23:24:47.983945+0000","last_fullsized":"2020-04-02T23:24:47.983945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'125","reported_seq":"139","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:43.978952+0000","last_change":"2020-04-02T23:39:43.979031+0000","last_active":"2020-04-02T23:39:43.978952+0000","last_peered":"2020-04-02T23:39:43.978952+0000","last_clean":"2020-04-02T23:39:43.978952+0000","last_became_active":"2020-04-02T23:24:44.973795+0000","last_became_peered":"2020-04-02T23:24:44.973795+0000","last_unstale":"2020-04-02T23:39:43.978952+0000","last_undegraded":"2020-04-02T23:39:43.978952+0000","last_fullsized":"2020-04-02T23:39:43.978952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'125","last_scrub_stamp":"2020-04-02T23:39:43.978942+0000","last_deep_scrub":"26'125","last_deep_scrub_stamp":"2020-04-02T23:39:43.978942+0000","last_clean_scrub_stamp":"2020-04-02T23:39:43.978942+0000","log_size":125,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":2181038080,"num_objects":520,"num_object_clones":0,"num_object_copies":2080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":520,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":445642,"num_write_kb":14876356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2665426944,"data_stored":3495952384,"data_compressed":80903235,"data_compressed_allocated":830525440,"data_compressed_original":1661050880,"omap_allocated":0,"internal_metadata":0},"log_size":80497,"ondisk_log_size":80497,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":8715028,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":29,"num_read_kb":65,"num_write":2015,"num_write_kb":9325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23176,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13647872,"data_stored":17430056,"data_compressed":1653144,"data_compressed_allocated":3842048,"data_compressed_original":7684096,"omap_allocated":4474845,"internal_metadata":0},"log_size":1843,"ondisk_log_size":1843,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1550595,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509625,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1274628,"kb_used_data":226044,"kb_used_omap":1529,"kb_used_meta":1047046,"kb_avail":93097212,"statfs":{"total":96636764160,"available":95331545088,"internally_reserved":1073741824,"allocated":231469056,"data_stored":300002087,"data_compressed":6691629,"data_compressed_allocated":68694016,"data_compressed_original":137388032,"omap_allocated":1566281,"internal_metadata":1072175543},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":1.3149999999999999,"15min":0.80000000000000004},"min":{"1min":0.19800000000000001,"5min":0.192,"15min":0.19},"max":{"1min":0.55400000000000005,"5min":9.0990000000000002,"15min":9.0990000000000002},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.68700000000000006,"15min":0.56000000000000005},"min":{"1min":0.23699999999999999,"5min":0.223,"15min":0.19900000000000001},"max":{"1min":0.53800000000000003,"5min":7.6920000000000002,"15min":7.6920000000000002},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.627,"15min":0.50600000000000001},"min":{"1min":0.247,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.45000000000000001,"5min":5.5099999999999998,"15min":5.5099999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":1.2669999999999999,"15min":0.83599999999999997},"min":{"1min":0.30299999999999999,"5min":0.23300000000000001,"15min":0.223},"max":{"1min":0.69899999999999995,"5min":8.3049999999999997,"15min":8.8030000000000008},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":1.5,"15min":0.91600000000000004},"min":{"1min":0.25900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52300000000000002,"5min":8.7690000000000001,"15min":8.8569999999999993},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.434,"5min":0.67400000000000004,"15min":0.622},"min":{"1min":0.32900000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.57299999999999995,"5min":3.899,"15min":5.6020000000000003},"last":0.249}]},{"osd":3,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.70999999999999996,"15min":0.621},"min":{"1min":0.25600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46999999999999997,"5min":6.0250000000000004,"15min":9.8620000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":1.427,"15min":0.97099999999999997},"min":{"1min":0.29999999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.71599999999999997,"5min":8.4420000000000002,"15min":12.067},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.79900000000000004,"15min":0.61299999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.22800000000000001},"max":{"1min":0.69499999999999995,"5min":4.907,"15min":5.4619999999999997},"last":0.442},{"interface":"front","average":{"1min":0.376,"5min":0.81200000000000006,"15min":0.60499999999999998},"min":{"1min":0.25600000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.65800000000000003,"5min":5.3310000000000004,"15min":5.3310000000000004},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":1.3440000000000001,"15min":0.89600000000000002},"min":{"1min":0.26500000000000001,"5min":0.255,"15min":0.24199999999999999},"max":{"1min":0.64700000000000002,"5min":9.5389999999999997,"15min":9.5389999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.94399999999999995,"15min":0.72499999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.26700000000000002},"max":{"1min":0.628,"5min":5.6500000000000004,"15min":5.6699999999999999},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":1.004,"15min":0.74399999999999999},"min":{"1min":0.31900000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68100000000000005,"5min":7.7359999999999998,"15min":7.7359999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.97099999999999997,"15min":0.72199999999999998},"min":{"1min":0.30299999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71599999999999997,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.39000000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542330,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1133200,"kb_used_data":84616,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93238640,"statfs":{"total":96636764160,"available":95476367360,"internally_reserved":1073741824,"allocated":86646784,"data_stored":111258973,"data_compressed":2413950,"data_compressed_allocated":24780800,"data_compressed_original":49561600,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.79100000000000004,"15min":0.57099999999999995},"min":{"1min":0.23000000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.46600000000000003,"5min":5.2089999999999996,"15min":5.2999999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.79800000000000004,"15min":0.58599999999999997},"min":{"1min":0.24099999999999999,"5min":0.20799999999999999,"15min":0.19600000000000001},"max":{"1min":0.51400000000000001,"5min":4.2690000000000001,"15min":5.0190000000000001},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.73599999999999999,"15min":0.57599999999999996},"min":{"1min":0.23100000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.51300000000000001,"5min":5.5289999999999999,"15min":5.5289999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.88700000000000001,"15min":0.66300000000000003},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.217},"max":{"1min":0.52400000000000002,"5min":5.1719999999999997,"15min":5.4820000000000002},"last":1.617}]},{"osd":2,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.76800000000000002,"15min":0.63100000000000001},"min":{"1min":0.30399999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56200000000000006,"5min":5.3769999999999998,"15min":11.308999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.98299999999999998,"15min":0.68899999999999995},"min":{"1min":0.29899999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.54800000000000004,"5min":7.5590000000000002,"15min":7.5590000000000002},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.94099999999999995,"15min":0.69799999999999995},"min":{"1min":0.29099999999999998,"5min":0.25700000000000001,"15min":0.249},"max":{"1min":0.55200000000000005,"5min":7.2160000000000002,"15min":7.2160000000000002},"last":0.307},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.95099999999999996,"15min":0.70699999999999996},"min":{"1min":0.28399999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59799999999999998,"5min":8.6630000000000003,"15min":8.6630000000000003},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.83199999999999996,"15min":0.65300000000000002},"min":{"1min":0.26800000000000002,"5min":0.22800000000000001,"15min":0.224},"max":{"1min":0.623,"5min":5.8860000000000001,"15min":5.8860000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.77300000000000002,"15min":0.58799999999999997},"min":{"1min":0.29799999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.54400000000000004,"5min":4.0919999999999996,"15min":5.1210000000000004},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":1.0840000000000001,"15min":0.71199999999999997},"min":{"1min":0.25700000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.64100000000000001,"5min":18.419,"15min":18.419},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":1.1519999999999999,"15min":0.85499999999999998},"min":{"1min":0.33500000000000002,"5min":0.28000000000000003,"15min":0.23300000000000001},"max":{"1min":0.71899999999999997,"5min":22.329000000000001,"15min":22.329000000000001},"last":0.623}]},{"osd":7,"last update":"Thu Apr 2 23:39:01 2020","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.98799999999999999,"15min":0.71499999999999997},"min":{"1min":0.34100000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56100000000000005,"5min":6.6200000000000001,"15min":6.6200000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.79500000000000004,"15min":0.64300000000000002},"min":{"1min":0.379,"5min":0.254,"15min":0.254},"max":{"1min":0.624,"5min":5.7960000000000003,"15min":5.7960000000000003},"last":0.40200000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542329,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1997864,"kb_used_data":949280,"kb_used_omap":212,"kb_used_meta":1048363,"kb_avail":92373976,"statfs":{"total":96636764160,"available":94590951424,"internally_reserved":1073741824,"allocated":972062720,"data_stored":1289906669,"data_compressed":31365102,"data_compressed_allocated":318029824,"data_compressed_original":636059648,"omap_allocated":217393,"internal_metadata":1073524431},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,1,2,3,6],"upper_bound":128},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":1.2210000000000001,"15min":0.747},"min":{"1min":0.22,"5min":0.186,"15min":0.157},"max":{"1min":0.59299999999999997,"5min":7.0700000000000003,"15min":7.0700000000000003},"last":1.6499999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.93300000000000005,"15min":0.66300000000000003},"min":{"1min":0.23899999999999999,"5min":0.20699999999999999,"15min":0.191},"max":{"1min":0.56999999999999995,"5min":5.5979999999999999,"15min":6.2060000000000004},"last":4.8280000000000003}]},{"osd":1,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":1.2609999999999999,"15min":0.78700000000000003},"min":{"1min":0.21099999999999999,"5min":0.20999999999999999,"15min":0.20000000000000001},"max":{"1min":0.55100000000000005,"5min":5.7169999999999996,"15min":5.7169999999999996},"last":3.254},{"interface":"front","average":{"1min":0.41299999999999998,"5min":1.2569999999999999,"15min":0.75600000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.21299999999999999},"max":{"1min":0.56100000000000005,"5min":6.9199999999999999,"15min":6.9199999999999999},"last":3.278}]},{"osd":2,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":1.22,"15min":0.78900000000000003},"min":{"1min":0.24399999999999999,"5min":0.23999999999999999,"15min":0.23000000000000001},"max":{"1min":0.54200000000000004,"5min":7.016,"15min":7.016},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":1.292,"15min":0.81100000000000005},"min":{"1min":0.26400000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.58099999999999996,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":3.2090000000000001}]},{"osd":3,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":1.2430000000000001,"15min":0.77600000000000002},"min":{"1min":0.27200000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.60099999999999998,"5min":9.7159999999999993,"15min":9.7159999999999993},"last":13.199},{"interface":"front","average":{"1min":0.41099999999999998,"5min":1.228,"15min":0.83199999999999996},"min":{"1min":0.26500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56899999999999995,"5min":5.5279999999999996,"15min":5.5279999999999996},"last":11.922000000000001}]},{"osd":4,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":1.1459999999999999,"15min":0.71099999999999997},"min":{"1min":0.23400000000000001,"5min":0.218,"15min":0.20699999999999999},"max":{"1min":0.52100000000000002,"5min":7.8099999999999996,"15min":7.8099999999999996},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":1.522,"15min":0.871},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.622,"5min":9.9800000000000004,"15min":9.9800000000000004},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":1.2529999999999999,"15min":0.79600000000000004},"min":{"1min":0.251,"5min":0.24299999999999999,"15min":0.23799999999999999},"max":{"1min":0.60099999999999998,"5min":6.6890000000000001,"15min":6.6890000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":1.3939999999999999,"15min":0.88700000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60599999999999998,"5min":13.016,"15min":13.016},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Apr 2 23:39:06 2020","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":1.3300000000000001,"15min":0.82399999999999995},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.63400000000000001,"5min":9.2710000000000008,"15min":9.2710000000000008},"last":1.696},{"interface":"front","average":{"1min":0.46800000000000003,"5min":1.3979999999999999,"15min":0.874},"min":{"1min":0.26300000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.69199999999999995,"5min":6.1849999999999996,"15min":6.1849999999999996},"last":1.671}]}]},{"osd":5,"up_from":14,"seq":60129542329,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1264776,"kb_used_data":216192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93107064,"statfs":{"total":96636764160,"available":95341633536,"internally_reserved":1073741824,"allocated":221380608,"data_stored":287419809,"data_compressed":6833303,"data_compressed_allocated":66207744,"data_compressed_original":132415488,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.63300000000000001,"15min":0.49199999999999999},"min":{"1min":0.189,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.46700000000000003,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.74199999999999999,"15min":0.57499999999999996},"min":{"1min":0.21199999999999999,"5min":0.20499999999999999,"15min":0.19800000000000001},"max":{"1min":0.56100000000000005,"5min":7.3920000000000003,"15min":7.3920000000000003},"last":0.26200000000000001}]},{"osd":1,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.78300000000000003,"15min":0.62},"min":{"1min":0.26900000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.64500000000000002,"5min":5.46,"15min":7.859},"last":1.276},{"interface":"front","average":{"1min":0.35699999999999998,"5min":1.095,"15min":0.71099999999999997},"min":{"1min":0.24399999999999999,"5min":0.20999999999999999,"15min":0.20499999999999999},"max":{"1min":0.58499999999999996,"5min":6.8319999999999999,"15min":8.1300000000000008},"last":1.4019999999999999}]},{"osd":2,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.97499999999999998,"15min":0.64400000000000002},"min":{"1min":0.26700000000000002,"5min":0.23599999999999999,"15min":0.214},"max":{"1min":0.626,"5min":6.5679999999999996,"15min":6.5679999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.435,"5min":0.90600000000000003,"15min":0.69399999999999995},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.55500000000000005,"5min":5.6459999999999999,"15min":5.6459999999999999},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":1.089,"15min":0.71999999999999997},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.22700000000000001},"max":{"1min":0.54000000000000004,"5min":7.1189999999999998,"15min":7.1189999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":1.0740000000000001,"15min":0.72699999999999998},"min":{"1min":0.29099999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59399999999999997,"5min":7.0780000000000003,"15min":7.0780000000000003},"last":0.378}]},{"osd":4,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.91600000000000004,"15min":0.61899999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.223},"max":{"1min":0.68400000000000005,"5min":6.5880000000000001,"15min":6.5880000000000001},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.79200000000000004,"15min":0.61899999999999999},"min":{"1min":0.32100000000000001,"5min":0.253,"15min":0.192},"max":{"1min":0.64100000000000001,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":0.32100000000000001}]},{"osd":6,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":1.157,"15min":0.84899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.247},"max":{"1min":0.59799999999999998,"5min":10.731,"15min":18.593},"last":1.236},{"interface":"front","average":{"1min":0.45200000000000001,"5min":1.1850000000000001,"15min":0.84999999999999998},"min":{"1min":0.30199999999999999,"5min":0.25700000000000001,"15min":0.246},"max":{"1min":0.63100000000000001,"5min":8.2870000000000008,"15min":18.402000000000001},"last":1.3620000000000001}]},{"osd":7,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":1.1639999999999999,"15min":0.74399999999999999},"min":{"1min":0.316,"5min":0.27300000000000002,"15min":0.245},"max":{"1min":0.629,"5min":9.0570000000000004,"15min":9.0570000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.93799999999999994,"15min":0.68999999999999995},"min":{"1min":0.30199999999999999,"5min":0.29599999999999999,"15min":0.253},"max":{"1min":0.73799999999999999,"5min":11.67,"15min":11.67},"last":0.34699999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509625,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1272764,"kb_used_data":224180,"kb_used_omap":1390,"kb_used_meta":1047185,"kb_avail":93099076,"statfs":{"total":96636764160,"available":95333453824,"internally_reserved":1073741824,"allocated":229560320,"data_stored":300279669,"data_compressed":7159389,"data_compressed_allocated":70885376,"data_compressed_original":141770752,"omap_allocated":1423856,"internal_metadata":1072317968},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.71399999999999997,"15min":0.53600000000000003},"min":{"1min":0.185,"5min":0.159,"15min":0.156},"max":{"1min":0.52200000000000002,"5min":6.6529999999999996,"15min":6.6529999999999996},"last":5.5019999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.65100000000000002,"15min":0.47899999999999998},"min":{"1min":0.20300000000000001,"5min":0.17999999999999999,"15min":0.16400000000000001},"max":{"1min":0.56200000000000006,"5min":4.8979999999999997,"15min":5.0830000000000002},"last":5.4180000000000001}]},{"osd":2,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.81200000000000006,"15min":0.54000000000000004},"min":{"1min":0.249,"5min":0.17799999999999999,"15min":0.17199999999999999},"max":{"1min":0.52300000000000002,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.83799999999999997,"15min":0.57699999999999996},"min":{"1min":0.21299999999999999,"5min":0.16200000000000001,"15min":0.152},"max":{"1min":0.49199999999999999,"5min":10.241,"15min":10.241},"last":0.437}]},{"osd":3,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.67200000000000004,"15min":0.49399999999999999},"min":{"1min":0.20000000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.46100000000000002,"5min":4.8879999999999999,"15min":5.0709999999999997},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.84199999999999997,"15min":0.60499999999999998},"min":{"1min":0.26100000000000001,"5min":0.20699999999999999,"15min":0.20000000000000001},"max":{"1min":0.57499999999999996,"5min":5.0350000000000001,"15min":5.1710000000000003},"last":0.621}]},{"osd":4,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.82699999999999996,"15min":0.66000000000000003},"min":{"1min":0.28199999999999997,"5min":0.224,"15min":0.224},"max":{"1min":0.59499999999999997,"5min":5.452,"15min":5.452},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.876,"15min":0.65900000000000003},"min":{"1min":0.35699999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.81000000000000005,"5min":5.274,"15min":5.274},"last":5.4580000000000002}]},{"osd":5,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":1.0029999999999999,"15min":0.751},"min":{"1min":0.30499999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60899999999999999,"5min":6.5910000000000002,"15min":6.5910000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.73099999999999998,"15min":0.59999999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.59799999999999998,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":1.0469999999999999,"15min":0.84299999999999997},"min":{"1min":0.32600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.75800000000000001,"5min":5.1749999999999998,"15min":24.530999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.47699999999999998,"5min":1.179,"15min":0.89700000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.26200000000000001},"max":{"1min":0.69099999999999995,"5min":8.7899999999999991,"15min":24.390000000000001},"last":5.6289999999999996}]},{"osd":7,"last update":"Thu Apr 2 23:39:05 2020","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":1.0309999999999999,"15min":0.88100000000000001},"min":{"1min":0.40500000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68999999999999995,"5min":7.2539999999999996,"15min":24.459},"last":5.54},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.78100000000000003,"15min":0.71099999999999997},"min":{"1min":0.34000000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.60199999999999998,"5min":5.9989999999999997,"15min":24.559000000000001},"last":7.5049999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509627,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1329776,"kb_used_data":281192,"kb_used_omap":1514,"kb_used_meta":1047061,"kb_avail":93042064,"statfs":{"total":96636764160,"available":95275073536,"internally_reserved":1073741824,"allocated":287940608,"data_stored":371305255,"data_compressed":8136408,"data_compressed_allocated":83525632,"data_compressed_original":167051264,"omap_allocated":1550595,"internal_metadata":1072191229},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.498,"15min":0.46600000000000003},"min":{"1min":0.20699999999999999,"5min":0.152,"15min":0.152},"max":{"1min":0.44500000000000001,"5min":3.7069999999999999,"15min":8.6370000000000005},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.88200000000000001,"15min":0.58699999999999997},"min":{"1min":0.23699999999999999,"5min":0.19900000000000001,"15min":0.17599999999999999},"max":{"1min":0.49399999999999999,"5min":8.5950000000000006,"15min":8.5950000000000006},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":1.0109999999999999,"15min":0.61799999999999999},"min":{"1min":0.20100000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.53400000000000003,"5min":8.8989999999999991,"15min":8.8989999999999991},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.80100000000000005,"15min":0.61699999999999999},"min":{"1min":0.215,"5min":0.20200000000000001,"15min":0.192},"max":{"1min":0.51600000000000001,"5min":12.585000000000001,"15min":12.585000000000001},"last":0.309}]},{"osd":3,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.78900000000000003,"15min":0.63900000000000001},"min":{"1min":0.253,"5min":0.218,"15min":0.218},"max":{"1min":0.56000000000000005,"5min":5.7130000000000001,"15min":8.6690000000000005},"last":8.016},{"interface":"front","average":{"1min":0.372,"5min":0.89800000000000002,"15min":0.63700000000000001},"min":{"1min":0.23599999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.57199999999999995,"5min":7.1840000000000002,"15min":8.4570000000000007},"last":8.0589999999999993}]},{"osd":4,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":1.054,"15min":0.79500000000000004},"min":{"1min":0.29699999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.51700000000000002,"5min":8.9600000000000009,"15min":8.9600000000000009},"last":7.923},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.72099999999999997,"15min":0.68200000000000005},"min":{"1min":0.308,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59999999999999998,"5min":7.117,"15min":9.0879999999999992},"last":7.9550000000000001}]},{"osd":5,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":1.2789999999999999,"15min":0.86199999999999999},"min":{"1min":0.25800000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.56699999999999995,"5min":8.5519999999999996,"15min":8.5519999999999996},"last":3.8650000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":1.294,"15min":0.89300000000000002},"min":{"1min":0.28499999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68100000000000005,"5min":8.9979999999999993,"15min":8.9979999999999993},"last":0.504}]},{"osd":6,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":1.516,"15min":0.95999999999999996},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.26800000000000002},"max":{"1min":0.58899999999999997,"5min":10.012,"15min":10.012},"last":3.907},{"interface":"front","average":{"1min":0.44600000000000001,"5min":1.637,"15min":1.075},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":0.65400000000000003,"5min":10.760999999999999,"15min":10.760999999999999},"last":3.7530000000000001}]},{"osd":7,"last update":"Thu Apr 2 23:38:54 2020","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":1.0660000000000001,"15min":0.81399999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.61499999999999999,"5min":12.641999999999999,"15min":12.641999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":1.135,"15min":0.82099999999999995},"min":{"1min":0.39000000000000001,"5min":0.313,"15min":0.30299999999999999},"max":{"1min":0.65400000000000003,"5min":7.306,"15min":8.8460000000000001},"last":3.786}]}]},{"osd":2,"up_from":15,"seq":64424509625,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1241216,"kb_used_data":192632,"kb_used_omap":1237,"kb_used_meta":1047338,"kb_avail":93130624,"statfs":{"total":96636764160,"available":95365758976,"internally_reserved":1073741824,"allocated":197255168,"data_stored":254189963,"data_compressed":5818831,"data_compressed_allocated":57110528,"data_compressed_original":114221056,"omap_allocated":1267315,"internal_metadata":1072474509},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.82899999999999996,"15min":0.55500000000000005},"min":{"1min":0.183,"5min":0.161,"15min":0.153},"max":{"1min":0.46999999999999997,"5min":6.8869999999999996,"15min":6.8869999999999996},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.90400000000000003,"15min":0.59099999999999997},"min":{"1min":0.20300000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.52800000000000002,"5min":4.907,"15min":4.907},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.81200000000000006,"15min":0.55100000000000005},"min":{"1min":0.254,"5min":0.182,"15min":0.16},"max":{"1min":0.52100000000000002,"5min":7.0449999999999999,"15min":7.0449999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":1.0529999999999999,"15min":0.64500000000000002},"min":{"1min":0.28599999999999998,"5min":0.223,"15min":0.223},"max":{"1min":0.51800000000000002,"5min":9.4179999999999993,"15min":9.4179999999999993},"last":1.016}]},{"osd":3,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":1.0169999999999999,"15min":0.66200000000000003},"min":{"1min":0.20499999999999999,"5min":0.191,"15min":0.184},"max":{"1min":0.47199999999999998,"5min":6.5789999999999997,"15min":6.5789999999999997},"last":0.254},{"interface":"front","average":{"1min":0.37,"5min":1.071,"15min":0.69099999999999995},"min":{"1min":0.24399999999999999,"5min":0.20399999999999999,"15min":0.20100000000000001},"max":{"1min":0.48599999999999999,"5min":8.891,"15min":8.891},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.97699999999999998,"15min":0.73299999999999998},"min":{"1min":0.27500000000000002,"5min":0.27100000000000002,"15min":0.26700000000000002},"max":{"1min":0.56299999999999994,"5min":9.0619999999999994,"15min":9.0619999999999994},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.44,"5min":1.002,"15min":0.76500000000000001},"min":{"1min":0.31900000000000001,"5min":0.26400000000000001,"15min":0.25900000000000001},"max":{"1min":0.69799999999999995,"5min":5.5970000000000004,"15min":5.5970000000000004},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":1.1319999999999999,"15min":0.79200000000000004},"min":{"1min":0.26700000000000002,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":0.504,"5min":8.3539999999999992,"15min":8.3539999999999992},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":1.0740000000000001,"15min":0.77500000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27500000000000002},"max":{"1min":0.57599999999999996,"5min":8.9949999999999992,"15min":8.9949999999999992},"last":0.498}]},{"osd":6,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":1.96,"15min":1.202},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.61099999999999999,"5min":68.593000000000004,"15min":68.593000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.443,"5min":2.0289999999999999,"15min":1.252},"min":{"1min":0.32600000000000001,"5min":0.307,"15min":0.28999999999999998},"max":{"1min":0.55600000000000005,"5min":68.489000000000004,"15min":68.489000000000004},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Apr 2 23:39:04 2020","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":1.3120000000000001,"15min":0.878},"min":{"1min":0.34799999999999998,"5min":0.33200000000000002,"15min":0.32700000000000001},"max":{"1min":0.65800000000000003,"5min":6.2519999999999998,"15min":6.2519999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.48099999999999998,"5min":1.163,"15min":0.83399999999999996},"min":{"1min":0.374,"5min":0.32300000000000001,"15min":0.311},"max":{"1min":0.59999999999999998,"5min":9.0999999999999996,"15min":9.0999999999999996},"last":0.36799999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509626,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1724144,"kb_used_data":674252,"kb_used_omap":1502,"kb_used_meta":1047073,"kb_avail":92647696,"statfs":{"total":96636764160,"available":94871240704,"internally_reserved":1073741824,"allocated":690434048,"data_stored":918661927,"data_compressed":22247841,"data_compressed_allocated":228388864,"data_compressed_original":456777728,"omap_allocated":1538120,"internal_metadata":1072203704},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1,2,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.255,"5min":0.83899999999999997,"15min":0.58999999999999997},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.154},"max":{"1min":0.51200000000000001,"5min":7.6989999999999998,"15min":7.6989999999999998},"last":13.66},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.71999999999999997,"15min":0.46999999999999997},"min":{"1min":0.20999999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.52800000000000002,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":13.696}]},{"osd":1,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":1.1439999999999999,"15min":0.71599999999999997},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.17999999999999999},"max":{"1min":0.52600000000000002,"5min":7.5549999999999997,"15min":7.5549999999999997},"last":13.513},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.93300000000000005,"15min":0.61899999999999999},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.182},"max":{"1min":0.46400000000000002,"5min":7.585,"15min":7.585},"last":13.956}]},{"osd":2,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":1.0149999999999999,"15min":0.71199999999999997},"min":{"1min":0.216,"5min":0.21199999999999999,"15min":0.18099999999999999},"max":{"1min":0.622,"5min":7.6379999999999999,"15min":7.6379999999999999},"last":13.583},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.88800000000000001,"15min":0.61899999999999999},"min":{"1min":0.24099999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.59399999999999997,"5min":7.6369999999999996,"15min":7.6369999999999996},"last":13.795}]},{"osd":4,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":1.2230000000000001,"15min":0.80100000000000005},"min":{"1min":0.26100000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.54000000000000004,"5min":6.9569999999999999,"15min":6.9569999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":1.0760000000000001,"15min":0.78700000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25700000000000001},"max":{"1min":0.56799999999999995,"5min":5.6849999999999996,"15min":5.6849999999999996},"last":13.728999999999999}]},{"osd":5,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":1.24,"15min":0.82599999999999996},"min":{"1min":0.33900000000000002,"5min":0.29399999999999998,"15min":0.27900000000000003},"max":{"1min":0.501,"5min":9.7520000000000007,"15min":9.7520000000000007},"last":13.837999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":1.23,"15min":0.81200000000000006},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.55700000000000005,"5min":8.8650000000000002,"15min":8.8650000000000002},"last":0.432}]},{"osd":6,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":1.4810000000000001,"15min":0.93400000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.502,"5min":8.0009999999999994,"15min":8.0009999999999994},"last":13.618},{"interface":"front","average":{"1min":0.45500000000000002,"5min":1.429,"15min":0.94199999999999995},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58599999999999997,"5min":9.8759999999999994,"15min":9.8759999999999994},"last":13.997999999999999}]},{"osd":7,"last update":"Thu Apr 2 23:38:56 2020","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":1.149,"15min":0.81200000000000006},"min":{"1min":0.35699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.58399999999999996,"5min":7.5149999999999997,"15min":7.5149999999999997},"last":13.638},{"interface":"front","average":{"1min":0.47399999999999998,"5min":1.109,"15min":0.84399999999999997},"min":{"1min":0.373,"5min":0.312,"15min":0.312},"max":{"1min":0.58099999999999996,"5min":6.8079999999999998,"15min":6.8079999999999998},"last":13.766999999999999}]}]}]}} 2020-04-02T23:39:55.154 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2020-04-02T23:24:46.979073+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=46, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:55.154 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2020-04-02T23:24:46.979073+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=46, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:55.154 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2020-04-02T23:24:40.944127+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:55.154 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2020-04-02T23:24:46.979073+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=46, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:55.154 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2020-04-02T23:24:46.979073+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=46, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:55.155 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-04-02T23:24:40.944127+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:55.155 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-04-02T23:24:28.069299+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=28, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:55.155 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-04-02T23:24:40.944127+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:55.155 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2020-04-02T23:24:46.979073+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=46, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:55.155 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-04-02T23:24:40.944127+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:55.156 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2020-04-02T23:24:43.961930+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=43, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:55.156 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2020-04-02T23:24:46.979073+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=46, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:55.156 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2020-04-02T23:24:43.961930+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=43, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:55.156 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2020-04-02T23:24:46.979073+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=46, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:55.156 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-04-02T23:24:40.944127+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:39:55.163 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2020-04-02T23:40:15.164 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:40:15.179 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-02T23:40:15.334 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.332+0000 7f3689ed9700 1 Processor -- start 2020-04-02T23:40:15.334 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.332+0000 7f3689ed9700 1 -- start start 2020-04-02T23:40:15.351 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f3689ed9700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f36840ab410 0x7f36840a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:40:15.352 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f3689ed9700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36840a6a90 0x7f36840a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:40:15.352 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f3689ed9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36840a31b0 con 0x7f36840a2130 2020-04-02T23:40:15.352 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f3689ed9700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36840a49f0 con 0x7f36840ab410 2020-04-02T23:40:15.352 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f3689ed9700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368405ff40 con 0x7f36840a6a90 2020-04-02T23:40:15.352 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f36837fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f36840ab410 0x7f36840a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:40:15.352 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f36837fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f36840ab410 0x7f36840a6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40830/0 (socket says 172.21.15.42:40830) 2020-04-02T23:40:15.352 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f36837fe700 1 -- 172.21.15.42:0/1148835856 learned_addr learned my addr 172.21.15.42:0/1148835856 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:40:15.353 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f367bfff700 1 --2- 172.21.15.42:0/1148835856 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36840a6a90 0x7f36840a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:40:15.353 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f36837fe700 1 -- 172.21.15.42:0/1148835856 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36840a6a90 msgr2=0x7f36840a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:40:15.353 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f36837fe700 1 --2- 172.21.15.42:0/1148835856 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36840a6a90 0x7f36840a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:40:15.353 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f36837fe700 1 -- 172.21.15.42:0/1148835856 >> v1:172.21.15.84:6789/0 conn(0x7f36840a2130 legacy=0x7f36840a2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:40:15.353 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f36837fe700 1 -- 172.21.15.42:0/1148835856 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36840a3420 con 0x7f36840ab410 2020-04-02T23:40:15.353 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f36837fe700 1 --2- 172.21.15.42:0/1148835856 >> v2:172.21.15.42:3300/0 conn(0x7f36840ab410 0x7f36840a6630 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3674002f30 tx=0x7f3674007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:15.353 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f36837fe700 1 --2- 172.21.15.42:0/1148835856 >> v2:172.21.15.42:3300/0 conn(0x7f36840ab410 0x7f36840a6630 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3674002f30 tx=0x7f3674007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:15.354 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f36837fe700 1 --2- 172.21.15.42:0/1148835856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36840ab410 0x7f36840a6630 secure :-1 s=READY pgs=244 cs=0 l=1 rx=0x7f3674002f30 tx=0x7f3674007a40).ready entity=mon.0 client_cookie=1c02ac76f7071dc8 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:40:15.354 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f36837fe700 1 --2- 172.21.15.42:0/1148835856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36840ab410 0x7f36840a6630 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7f3674002f30 tx=0x7f3674007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:15.354 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f36837fe700 1 --2- 172.21.15.42:0/1148835856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36840ab410 0x7f36840a6630 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7f3674002f30 tx=0x7f3674007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:15.354 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f36837fe700 1 --2- 172.21.15.42:0/1148835856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36840ab410 0x7f36840a6630 secure :-1 s=THROTTLE_DONE pgs=244 cs=0 l=1 rx=0x7f3674002f30 tx=0x7f3674007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:15.354 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f3682ffd700 1 -- 172.21.15.42:0/1148835856 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3674011670 con 0x7f36840ab410 2020-04-02T23:40:15.354 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.333+0000 7f3682ffd700 1 -- 172.21.15.42:0/1148835856 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36740117d0 con 0x7f36840ab410 2020-04-02T23:40:15.354 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.334+0000 7f3682ffd700 1 -- 172.21.15.42:0/1148835856 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3674011bf0 con 0x7f36840ab410 2020-04-02T23:40:15.354 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.334+0000 7f3689ed9700 1 -- 172.21.15.42:0/1148835856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36840ab410 msgr2=0x7f36840a6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:40:15.355 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.334+0000 7f3689ed9700 1 --2- 172.21.15.42:0/1148835856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36840ab410 0x7f36840a6630 secure :-1 s=READY pgs=244 cs=0 l=1 rx=0x7f3674002f30 tx=0x7f3674007a40).stop 2020-04-02T23:40:15.355 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.334+0000 7f3689ed9700 1 -- 172.21.15.42:0/1148835856 shutdown_connections 2020-04-02T23:40:15.355 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.334+0000 7f3689ed9700 1 --2- 172.21.15.42:0/1148835856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36840ab410 0x7f36840a6630 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:40:15.355 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.334+0000 7f3689ed9700 1 --2- 172.21.15.42:0/1148835856 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f36840a6a90 0x7f36840a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:40:15.355 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.334+0000 7f3689ed9700 1 -- 172.21.15.42:0/1148835856 >> 172.21.15.42:0/1148835856 conn(0x7f368405b720 msgr2=0x7f36840aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:40:15.355 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.334+0000 7f3689ed9700 1 -- 172.21.15.42:0/1148835856 shutdown_connections 2020-04-02T23:40:15.355 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.334+0000 7f3689ed9700 1 -- 172.21.15.42:0/1148835856 wait complete. 2020-04-02T23:40:15.356 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.335+0000 7f3689ed9700 1 Processor -- start 2020-04-02T23:40:15.356 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.335+0000 7f3689ed9700 1 -- start start 2020-04-02T23:40:15.356 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f3689ed9700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f36840a6a90 0x7f3684137590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:40:15.356 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f3689ed9700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3684099940 con 0x7f36840ab410 2020-04-02T23:40:15.356 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f3689ed9700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3684063f50 con 0x7f36840a2130 2020-04-02T23:40:15.356 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f3689ed9700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3684063d60 con 0x7f36840a6a90 2020-04-02T23:40:15.356 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f36837fe700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f36840a2130 0x7f3684061280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:54638/0 (socket says 172.21.15.42:54638) 2020-04-02T23:40:15.357 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f36837fe700 1 -- 172.21.15.42:0/787012975 learned_addr learned my addr 172.21.15.42:0/787012975 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:40:15.357 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f3683fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f36840ab410 0x7f36841379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60264/0 (socket says 172.21.15.42:60264) 2020-04-02T23:40:15.357 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f367bfff700 1 --2- 172.21.15.42:0/787012975 >> v2:172.21.15.84:3300/0 conn(0x7f36840a6a90 0x7f3684137590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:40:15.357 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f36817fa700 1 -- 172.21.15.42:0/787012975 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764881620 0 0) 0x7f3684099940 con 0x7f36840ab410 2020-04-02T23:40:15.358 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f36817fa700 1 -- 172.21.15.42:0/787012975 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3668002fe0 con 0x7f36840ab410 2020-04-02T23:40:15.358 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f36817fa700 1 -- 172.21.15.42:0/787012975 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564562631 0 0) 0x7f3684063f50 con 0x7f36840a2130 2020-04-02T23:40:15.358 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f36817fa700 1 -- 172.21.15.42:0/787012975 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3684099940 con 0x7f36840a2130 2020-04-02T23:40:15.358 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f367bfff700 1 -- 172.21.15.42:0/787012975 >> v1:172.21.15.84:6789/0 conn(0x7f36840a2130 legacy=0x7f3684061280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:40:15.358 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f367bfff700 1 -- 172.21.15.42:0/787012975 >> v1:172.21.15.42:6789/0 conn(0x7f36840ab410 legacy=0x7f36841379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:40:15.358 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f367bfff700 1 -- 172.21.15.42:0/787012975 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36840641f0 con 0x7f36840a6a90 2020-04-02T23:40:15.358 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f367bfff700 1 --2- 172.21.15.42:0/787012975 >> v2:172.21.15.84:3300/0 conn(0x7f36840a6a90 0x7f3684137590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f366c002f30 tx=0x7f366c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:15.359 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f367bfff700 1 --2- 172.21.15.42:0/787012975 >> v2:172.21.15.84:3300/0 conn(0x7f36840a6a90 0x7f3684137590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f366c002f30 tx=0x7f366c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:15.359 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f367bfff700 1 --2- 172.21.15.42:0/787012975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36840a6a90 0x7f3684137590 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f366c002f30 tx=0x7f366c010bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:40:15.359 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f367bfff700 1 --2- 172.21.15.42:0/787012975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36840a6a90 0x7f3684137590 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f366c002f30 tx=0x7f366c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:15.359 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f36817fa700 1 -- 172.21.15.42:0/787012975 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f366c007530 con 0x7f36840a6a90 2020-04-02T23:40:15.359 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f367bfff700 1 --2- 172.21.15.42:0/787012975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36840a6a90 0x7f3684137590 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f366c002f30 tx=0x7f366c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:15.359 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f367bfff700 1 --2- 172.21.15.42:0/787012975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36840a6a90 0x7f3684137590 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f366c002f30 tx=0x7f366c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:15.359 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f36817fa700 1 -- 172.21.15.42:0/787012975 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366c0056c0 con 0x7f36840a6a90 2020-04-02T23:40:15.360 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f3689ed9700 1 -- 172.21.15.42:0/787012975 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3684064490 con 0x7f36840a6a90 2020-04-02T23:40:15.360 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f36817fa700 1 -- 172.21.15.42:0/787012975 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f366c005ae0 con 0x7f36840a6a90 2020-04-02T23:40:15.360 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.336+0000 7f3689ed9700 1 -- 172.21.15.42:0/787012975 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368409ab10 con 0x7f36840a6a90 2020-04-02T23:40:15.360 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.337+0000 7f367bfff700 1 --2- 172.21.15.42:0/787012975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36840a6a90 0x7f3684137590 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f366c002f30 tx=0x7f366c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:15.360 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.338+0000 7f3689ed9700 1 -- 172.21.15.42:0/787012975 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368405d2e0 con 0x7f36840a6a90 2020-04-02T23:40:15.360 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.338+0000 7f36817fa700 1 -- 172.21.15.42:0/787012975 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f366c00c580 con 0x7f36840a6a90 2020-04-02T23:40:15.361 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.338+0000 7f367bfff700 1 --2- 172.21.15.42:0/787012975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36840a6a90 0x7f3684137590 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f366c002f30 tx=0x7f366c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:15.361 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.338+0000 7f36817fa700 1 --2- 172.21.15.42:0/787012975 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f366804d9e0 0x7f366804fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:40:15.361 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.338+0000 7f36817fa700 1 -- 172.21.15.42:0/787012975 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f366c00d0c0 con 0x7f36840a6a90 2020-04-02T23:40:15.361 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.338+0000 7f36837fe700 1 --2- 172.21.15.42:0/787012975 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f366804d9e0 0x7f366804fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:40:15.361 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.339+0000 7f36837fe700 1 --2- 172.21.15.42:0/787012975 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f366804d9e0 0x7f366804fea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3684062e70 tx=0x7f3674007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:15.361 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.339+0000 7f36837fe700 1 --2- 172.21.15.42:0/787012975 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f366804d9e0 0x7f366804fea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3684062e70 tx=0x7f3674007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:15.361 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.339+0000 7f36837fe700 1 --2- 172.21.15.42:0/787012975 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f366804d9e0 0x7f366804fea0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7f3684062e70 tx=0x7f3674007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:40:15.362 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.342+0000 7f367bfff700 1 --2- 172.21.15.42:0/787012975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36840a6a90 0x7f3684137590 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f366c002f30 tx=0x7f366c010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:15.362 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.342+0000 7f36817fa700 1 -- 172.21.15.42:0/787012975 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f366c03c7b0 con 0x7f36840a6a90 2020-04-02T23:40:15.488 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.486+0000 7f3689ed9700 1 -- 172.21.15.42:0/787012975 --> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3684056c50 con 0x7f366804d9e0 2020-04-02T23:40:15.496 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.490+0000 7f36837fe700 1 --2- 172.21.15.42:0/787012975 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f366804d9e0 0x7f366804fea0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f3684062e70 tx=0x7f3674007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:15.497 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.490+0000 7f36817fa700 1 -- 172.21.15.42:0/787012975 <== mgr.4100 v2:172.21.15.84:6800/23437 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+105858 (secure 0 0 0) 0x7f3684056c50 con 0x7f366804d9e0 2020-04-02T23:40:15.497 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.492+0000 7f3689ed9700 1 -- 172.21.15.42:0/787012975 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f366804d9e0 msgr2=0x7f366804fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:40:15.497 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.492+0000 7f3689ed9700 1 --2- 172.21.15.42:0/787012975 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f366804d9e0 0x7f366804fea0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7f3684062e70 tx=0x7f3674007a40).stop 2020-04-02T23:40:15.498 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.492+0000 7f3689ed9700 1 -- 172.21.15.42:0/787012975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36840a6a90 msgr2=0x7f3684137590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:40:15.504 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.492+0000 7f3689ed9700 1 --2- 172.21.15.42:0/787012975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36840a6a90 0x7f3684137590 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f366c002f30 tx=0x7f366c010bd0).stop 2020-04-02T23:40:15.505 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.492+0000 7f3689ed9700 1 -- 172.21.15.42:0/787012975 shutdown_connections 2020-04-02T23:40:15.505 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.492+0000 7f3689ed9700 1 --2- 172.21.15.42:0/787012975 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f366804d9e0 0x7f366804fea0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:40:15.505 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.492+0000 7f3689ed9700 1 --2- 172.21.15.42:0/787012975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36840a6a90 0x7f3684137590 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:40:15.505 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.492+0000 7f3689ed9700 1 -- 172.21.15.42:0/787012975 >> 172.21.15.42:0/787012975 conn(0x7f368405b720 msgr2=0x7f36840aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:40:15.506 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.492+0000 7f3689ed9700 1 -- 172.21.15.42:0/787012975 shutdown_connections 2020-04-02T23:40:15.506 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:15.492+0000 7f3689ed9700 1 -- 172.21.15.42:0/787012975 wait complete. 2020-04-02T23:40:15.506 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2020-04-02T23:40:15.506 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:40:15.514 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":496,"stamp":"2020-04-02T23:40:15.295479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8715028,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":29,"num_read_kb":65,"num_write":448180,"num_write_kb":14885691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31207,"num_omap_keys":52,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82332,"ondisk_log_size":82332,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8404112,"kb_used_data":15440,"kb_used_omap":7386,"kb_used_meta":8381221,"kb_avail":746570608,"statfs":{"total":773094113280,"available":764488302592,"internally_reserved":8589934592,"allocated":15810560,"data_stored":18304864,"data_compressed":1653144,"data_compressed_allocated":3842048,"data_compressed_original":7684096,"omap_allocated":7563560,"internal_metadata":8582371032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8031,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002895"},"pg_stats":[{"pgid":"4.2","version":"26'17358","reported_seq":"17372","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:40:06.946585+0000","last_change":"2020-04-02T23:40:06.946688+0000","last_active":"2020-04-02T23:40:06.946585+0000","last_peered":"2020-04-02T23:40:06.946585+0000","last_clean":"2020-04-02T23:40:06.946585+0000","last_became_active":"2020-04-02T23:24:47.993002+0000","last_became_peered":"2020-04-02T23:24:47.993002+0000","last_unstale":"2020-04-02T23:40:06.946585+0000","last_undegraded":"2020-04-02T23:40:06.946585+0000","last_fullsized":"2020-04-02T23:40:06.946585+0000","mapping_epoch":24,"log_start":"26'7349","ondisk_log_start":"26'7349","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'17358","last_scrub_stamp":"2020-04-02T23:40:06.946579+0000","last_deep_scrub":"26'17358","last_deep_scrub_stamp":"2020-04-02T23:40:06.946579+0000","last_clean_scrub_stamp":"2020-04-02T23:40:06.946579+0000","log_size":10009,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58870,"num_write_kb":1925310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:27.185192+0000","last_change":"2020-04-02T23:39:27.185287+0000","last_active":"2020-04-02T23:39:27.185192+0000","last_peered":"2020-04-02T23:39:27.185192+0000","last_clean":"2020-04-02T23:39:27.185192+0000","last_became_active":"2020-04-02T23:24:42.210455+0000","last_became_peered":"2020-04-02T23:24:42.210455+0000","last_unstale":"2020-04-02T23:39:27.185192+0000","last_undegraded":"2020-04-02T23:39:27.185192+0000","last_fullsized":"2020-04-02T23:39:27.185192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:39:27.185184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:39:27.185184+0000","last_clean_scrub_stamp":"2020-04-02T23:39:27.185184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'32","reported_seq":"47","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:51.276349+0000","last_change":"2020-04-02T23:39:44.413193+0000","last_active":"2020-04-02T23:39:51.276349+0000","last_peered":"2020-04-02T23:39:51.276349+0000","last_clean":"2020-04-02T23:39:51.276349+0000","last_became_active":"2020-04-02T23:24:44.977559+0000","last_became_peered":"2020-04-02T23:24:44.977559+0000","last_unstale":"2020-04-02T23:39:51.276349+0000","last_undegraded":"2020-04-02T23:39:51.276349+0000","last_fullsized":"2020-04-02T23:39:51.276349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'30","last_scrub_stamp":"2020-04-02T23:39:44.413104+0000","last_deep_scrub":"26'30","last_deep_scrub_stamp":"2020-04-02T23:39:44.413104+0000","last_clean_scrub_stamp":"2020-04-02T23:39:44.413104+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"26'14611","reported_seq":"14625","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:40:11.893761+0000","last_change":"2020-04-02T23:40:11.893866+0000","last_active":"2020-04-02T23:40:11.893761+0000","last_peered":"2020-04-02T23:40:11.893761+0000","last_clean":"2020-04-02T23:40:11.893761+0000","last_became_active":"2020-04-02T23:24:48.353610+0000","last_became_peered":"2020-04-02T23:24:48.353610+0000","last_unstale":"2020-04-02T23:40:11.893761+0000","last_undegraded":"2020-04-02T23:40:11.893761+0000","last_fullsized":"2020-04-02T23:40:11.893761+0000","mapping_epoch":24,"log_start":"26'4513","ondisk_log_start":"26'4513","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'14611","last_scrub_stamp":"2020-04-02T23:40:11.893755+0000","last_deep_scrub":"26'14611","last_deep_scrub_stamp":"2020-04-02T23:40:11.893755+0000","last_clean_scrub_stamp":"2020-04-02T23:40:11.893755+0000","log_size":10098,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48592,"num_write_kb":1720160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:40:02.931004+0000","last_change":"2020-04-02T23:40:02.931084+0000","last_active":"2020-04-02T23:40:02.931004+0000","last_peered":"2020-04-02T23:40:02.931004+0000","last_clean":"2020-04-02T23:40:02.931004+0000","last_became_active":"2020-04-02T23:24:42.210546+0000","last_became_peered":"2020-04-02T23:24:42.210546+0000","last_unstale":"2020-04-02T23:40:02.931004+0000","last_undegraded":"2020-04-02T23:40:02.931004+0000","last_fullsized":"2020-04-02T23:40:02.931004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:40:02.931000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:40:02.931000+0000","last_clean_scrub_stamp":"2020-04-02T23:40:02.931000+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"26'1005","reported_seq":"1020","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:33.609262+0000","last_change":"2020-04-02T23:39:30.575219+0000","last_active":"2020-04-02T23:39:33.609262+0000","last_peered":"2020-04-02T23:39:33.609262+0000","last_clean":"2020-04-02T23:39:33.609262+0000","last_became_active":"2020-04-02T23:24:44.976952+0000","last_became_peered":"2020-04-02T23:24:44.976952+0000","last_unstale":"2020-04-02T23:39:33.609262+0000","last_undegraded":"2020-04-02T23:39:33.609262+0000","last_fullsized":"2020-04-02T23:39:33.609262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1003","last_scrub_stamp":"2020-04-02T23:39:30.575123+0000","last_deep_scrub":"26'1003","last_deep_scrub_stamp":"2020-04-02T23:39:30.575123+0000","last_clean_scrub_stamp":"2020-04-02T23:39:30.575123+0000","log_size":1005,"ondisk_log_size":1005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4471886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":999,"num_write_kb":4717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12050,"num_omap_keys":26,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"26'15959","reported_seq":"15970","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:55.797335+0000","last_change":"2020-04-02T23:24:48.354357+0000","last_active":"2020-04-02T23:39:55.797335+0000","last_peered":"2020-04-02T23:39:55.797335+0000","last_clean":"2020-04-02T23:39:55.797335+0000","last_became_active":"2020-04-02T23:24:48.353668+0000","last_became_peered":"2020-04-02T23:24:48.353668+0000","last_unstale":"2020-04-02T23:39:55.797335+0000","last_undegraded":"2020-04-02T23:39:55.797335+0000","last_fullsized":"2020-04-02T23:39:55.797335+0000","mapping_epoch":24,"log_start":"26'5873","ondisk_log_start":"26'5873","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10086,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53843,"num_write_kb":1823426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:42.677241+0000","last_change":"2020-04-02T23:39:42.677324+0000","last_active":"2020-04-02T23:39:42.677241+0000","last_peered":"2020-04-02T23:39:42.677241+0000","last_clean":"2020-04-02T23:39:42.677241+0000","last_became_active":"2020-04-02T23:24:41.966868+0000","last_became_peered":"2020-04-02T23:24:41.966868+0000","last_unstale":"2020-04-02T23:39:42.677241+0000","last_undegraded":"2020-04-02T23:39:42.677241+0000","last_fullsized":"2020-04-02T23:39:42.677241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:39:42.677235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:39:42.677235+0000","last_clean_scrub_stamp":"2020-04-02T23:39:42.677235+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"26'20","reported_seq":"34","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:33.608921+0000","last_change":"2020-04-02T23:39:28.228046+0000","last_active":"2020-04-02T23:39:33.608921+0000","last_peered":"2020-04-02T23:39:33.608921+0000","last_clean":"2020-04-02T23:39:33.608921+0000","last_became_active":"2020-04-02T23:24:44.977934+0000","last_became_peered":"2020-04-02T23:24:44.977934+0000","last_unstale":"2020-04-02T23:39:33.608921+0000","last_undegraded":"2020-04-02T23:39:33.608921+0000","last_fullsized":"2020-04-02T23:39:33.608921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'17","last_scrub_stamp":"2020-04-02T23:39:28.227959+0000","last_deep_scrub":"26'17","last_deep_scrub_stamp":"2020-04-02T23:39:28.227959+0000","last_clean_scrub_stamp":"2020-04-02T23:39:28.227959+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11126,"num_omap_keys":24,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"26'16046","reported_seq":"16057","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:55.925125+0000","last_change":"2020-04-02T23:24:48.354531+0000","last_active":"2020-04-02T23:39:55.925125+0000","last_peered":"2020-04-02T23:39:55.925125+0000","last_clean":"2020-04-02T23:39:55.925125+0000","last_became_active":"2020-04-02T23:24:48.353432+0000","last_became_peered":"2020-04-02T23:24:48.353432+0000","last_unstale":"2020-04-02T23:39:55.925125+0000","last_undegraded":"2020-04-02T23:39:55.925125+0000","last_fullsized":"2020-04-02T23:39:55.925125+0000","mapping_epoch":24,"log_start":"26'6041","ondisk_log_start":"26'6041","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:46.979073+0000","last_clean_scrub_stamp":"2020-04-02T23:24:46.979073+0000","log_size":10005,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54896,"num_write_kb":1823228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:40:03.957362+0000","last_change":"2020-04-02T23:40:03.957431+0000","last_active":"2020-04-02T23:40:03.957362+0000","last_peered":"2020-04-02T23:40:03.957362+0000","last_clean":"2020-04-02T23:40:03.957362+0000","last_became_active":"2020-04-02T23:24:42.200326+0000","last_became_peered":"2020-04-02T23:24:42.200326+0000","last_unstale":"2020-04-02T23:40:03.957362+0000","last_undegraded":"2020-04-02T23:40:03.957362+0000","last_fullsized":"2020-04-02T23:40:03.957362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:40:03.957357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:40:03.957357+0000","last_clean_scrub_stamp":"2020-04-02T23:40:03.957357+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'4","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:40:09.625910+0000","last_change":"2020-04-02T23:40:09.625961+0000","last_active":"2020-04-02T23:40:09.625910+0000","last_peered":"2020-04-02T23:40:09.625910+0000","last_clean":"2020-04-02T23:40:09.625910+0000","last_became_active":"2020-04-02T23:24:37.114896+0000","last_became_peered":"2020-04-02T23:24:37.114896+0000","last_unstale":"2020-04-02T23:40:09.625910+0000","last_undegraded":"2020-04-02T23:40:09.625910+0000","last_fullsized":"2020-04-02T23:40:09.625910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2020-04-02T23:40:09.625906+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2020-04-02T23:40:09.625906+0000","last_clean_scrub_stamp":"2020-04-02T23:40:09.625906+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8031,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"26'4","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:31.951249+0000","last_change":"2020-04-02T23:39:31.951249+0000","last_active":"2020-04-02T23:39:31.951249+0000","last_peered":"2020-04-02T23:39:31.951249+0000","last_clean":"2020-04-02T23:39:31.951249+0000","last_became_active":"2020-04-02T23:24:44.977355+0000","last_became_peered":"2020-04-02T23:24:44.977355+0000","last_unstale":"2020-04-02T23:39:31.951249+0000","last_undegraded":"2020-04-02T23:39:31.951249+0000","last_fullsized":"2020-04-02T23:39:31.951249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2020-04-02T23:39:31.951151+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2020-04-02T23:39:31.951151+0000","last_clean_scrub_stamp":"2020-04-02T23:39:31.951151+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"26'16586","reported_seq":"16600","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:55.835195+0000","last_change":"2020-04-02T23:39:41.836654+0000","last_active":"2020-04-02T23:39:55.835195+0000","last_peered":"2020-04-02T23:39:55.835195+0000","last_clean":"2020-04-02T23:39:55.835195+0000","last_became_active":"2020-04-02T23:24:48.179989+0000","last_became_peered":"2020-04-02T23:24:48.179989+0000","last_unstale":"2020-04-02T23:39:55.835195+0000","last_undegraded":"2020-04-02T23:39:55.835195+0000","last_fullsized":"2020-04-02T23:39:55.835195+0000","mapping_epoch":24,"log_start":"26'6520","ondisk_log_start":"26'6520","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16248","last_scrub_stamp":"2020-04-02T23:39:41.836588+0000","last_deep_scrub":"26'16248","last_deep_scrub_stamp":"2020-04-02T23:39:41.836588+0000","last_clean_scrub_stamp":"2020-04-02T23:39:41.836588+0000","log_size":10066,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56206,"num_write_kb":1812324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:59.961979+0000","last_change":"2020-04-02T23:39:59.962067+0000","last_active":"2020-04-02T23:39:59.961979+0000","last_peered":"2020-04-02T23:39:59.961979+0000","last_clean":"2020-04-02T23:39:59.961979+0000","last_became_active":"2020-04-02T23:24:41.966804+0000","last_became_peered":"2020-04-02T23:24:41.966804+0000","last_unstale":"2020-04-02T23:39:59.961979+0000","last_undegraded":"2020-04-02T23:39:59.961979+0000","last_fullsized":"2020-04-02T23:39:59.961979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:39:59.961974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:39:59.961974+0000","last_clean_scrub_stamp":"2020-04-02T23:39:59.961974+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"26'38","reported_seq":"81","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:41.893728+0000","last_change":"2020-04-02T23:39:41.893825+0000","last_active":"2020-04-02T23:39:41.893728+0000","last_peered":"2020-04-02T23:39:41.893728+0000","last_clean":"2020-04-02T23:39:41.893728+0000","last_became_active":"2020-04-02T23:24:44.977243+0000","last_became_peered":"2020-04-02T23:24:44.977243+0000","last_unstale":"2020-04-02T23:39:41.893728+0000","last_undegraded":"2020-04-02T23:39:41.893728+0000","last_fullsized":"2020-04-02T23:39:41.893728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'38","last_scrub_stamp":"2020-04-02T23:39:41.893720+0000","last_deep_scrub":"26'38","last_deep_scrub_stamp":"2020-04-02T23:39:41.893720+0000","last_clean_scrub_stamp":"2020-04-02T23:39:41.893720+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47478,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":65,"num_write":40,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"26'16973","reported_seq":"16987","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:40:08.924241+0000","last_change":"2020-04-02T23:40:08.924343+0000","last_active":"2020-04-02T23:40:08.924241+0000","last_peered":"2020-04-02T23:40:08.924241+0000","last_clean":"2020-04-02T23:40:08.924241+0000","last_became_active":"2020-04-02T23:24:48.353592+0000","last_became_peered":"2020-04-02T23:24:48.353592+0000","last_unstale":"2020-04-02T23:40:08.924241+0000","last_undegraded":"2020-04-02T23:40:08.924241+0000","last_fullsized":"2020-04-02T23:40:08.924241+0000","mapping_epoch":24,"log_start":"26'6926","ondisk_log_start":"26'6926","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16973","last_scrub_stamp":"2020-04-02T23:40:08.924234+0000","last_deep_scrub":"26'16973","last_deep_scrub_stamp":"2020-04-02T23:40:08.924234+0000","last_clean_scrub_stamp":"2020-04-02T23:40:08.924234+0000","log_size":10047,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56545,"num_write_kb":1907521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:40:07.001042+0000","last_change":"2020-04-02T23:40:07.001127+0000","last_active":"2020-04-02T23:40:07.001042+0000","last_peered":"2020-04-02T23:40:07.001042+0000","last_clean":"2020-04-02T23:40:07.001042+0000","last_became_active":"2020-04-02T23:24:41.965120+0000","last_became_peered":"2020-04-02T23:24:41.965120+0000","last_unstale":"2020-04-02T23:40:07.001042+0000","last_undegraded":"2020-04-02T23:40:07.001042+0000","last_fullsized":"2020-04-02T23:40:07.001042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:40:07.001037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:40:07.001037+0000","last_clean_scrub_stamp":"2020-04-02T23:40:07.001037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'613","reported_seq":"627","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:57.048494+0000","last_change":"2020-04-02T23:39:57.048581+0000","last_active":"2020-04-02T23:39:57.048494+0000","last_peered":"2020-04-02T23:39:57.048494+0000","last_clean":"2020-04-02T23:39:57.048494+0000","last_became_active":"2020-04-02T23:24:44.980010+0000","last_became_peered":"2020-04-02T23:24:44.980010+0000","last_unstale":"2020-04-02T23:39:57.048494+0000","last_undegraded":"2020-04-02T23:39:57.048494+0000","last_fullsized":"2020-04-02T23:39:57.048494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'613","last_scrub_stamp":"2020-04-02T23:39:57.048488+0000","last_deep_scrub":"26'613","last_deep_scrub_stamp":"2020-04-02T23:39:57.048488+0000","last_clean_scrub_stamp":"2020-04-02T23:39:57.048488+0000","log_size":613,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194938,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":605,"num_write_kb":4299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"26'16200","reported_seq":"16214","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:40:03.898233+0000","last_change":"2020-04-02T23:40:03.898331+0000","last_active":"2020-04-02T23:40:03.898233+0000","last_peered":"2020-04-02T23:40:03.898233+0000","last_clean":"2020-04-02T23:40:03.898233+0000","last_became_active":"2020-04-02T23:24:48.179994+0000","last_became_peered":"2020-04-02T23:24:48.179994+0000","last_unstale":"2020-04-02T23:40:03.898233+0000","last_undegraded":"2020-04-02T23:40:03.898233+0000","last_fullsized":"2020-04-02T23:40:03.898233+0000","mapping_epoch":24,"log_start":"26'6110","ondisk_log_start":"26'6110","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16200","last_scrub_stamp":"2020-04-02T23:40:03.898227+0000","last_deep_scrub":"26'16200","last_deep_scrub_stamp":"2020-04-02T23:40:03.898227+0000","last_clean_scrub_stamp":"2020-04-02T23:40:03.898227+0000","log_size":10090,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54828,"num_write_kb":1835362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'16","reported_seq":"30","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:57.879547+0000","last_change":"2020-04-02T23:39:57.879618+0000","last_active":"2020-04-02T23:39:57.879547+0000","last_peered":"2020-04-02T23:39:57.879547+0000","last_clean":"2020-04-02T23:39:57.879547+0000","last_became_active":"2020-04-02T23:24:44.978145+0000","last_became_peered":"2020-04-02T23:24:44.978145+0000","last_unstale":"2020-04-02T23:39:57.879547+0000","last_undegraded":"2020-04-02T23:39:57.879547+0000","last_fullsized":"2020-04-02T23:39:57.879547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16","last_scrub_stamp":"2020-04-02T23:39:57.879541+0000","last_deep_scrub":"26'16","last_deep_scrub_stamp":"2020-04-02T23:39:57.879541+0000","last_clean_scrub_stamp":"2020-04-02T23:39:57.879541+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:27.922218+0000","last_change":"2020-04-02T23:39:27.922278+0000","last_active":"2020-04-02T23:39:27.922218+0000","last_peered":"2020-04-02T23:39:27.922218+0000","last_clean":"2020-04-02T23:39:27.922218+0000","last_became_active":"2020-04-02T23:24:42.311136+0000","last_became_peered":"2020-04-02T23:24:42.311136+0000","last_unstale":"2020-04-02T23:39:27.922218+0000","last_undegraded":"2020-04-02T23:39:27.922218+0000","last_fullsized":"2020-04-02T23:39:27.922218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:39:27.922214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:39:27.922214+0000","last_clean_scrub_stamp":"2020-04-02T23:39:27.922214+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"26'18520","reported_seq":"18534","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:55.946486+0000","last_change":"2020-04-02T23:39:55.946558+0000","last_active":"2020-04-02T23:39:55.946486+0000","last_peered":"2020-04-02T23:39:55.946486+0000","last_clean":"2020-04-02T23:39:55.946486+0000","last_became_active":"2020-04-02T23:24:48.179883+0000","last_became_peered":"2020-04-02T23:24:48.179883+0000","last_unstale":"2020-04-02T23:39:55.946486+0000","last_undegraded":"2020-04-02T23:39:55.946486+0000","last_fullsized":"2020-04-02T23:39:55.946486+0000","mapping_epoch":24,"log_start":"26'8446","ondisk_log_start":"26'8446","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'18520","last_scrub_stamp":"2020-04-02T23:39:55.946482+0000","last_deep_scrub":"26'18520","last_deep_scrub_stamp":"2020-04-02T23:39:55.946482+0000","last_clean_scrub_stamp":"2020-04-02T23:39:55.946482+0000","log_size":10074,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62382,"num_write_kb":2029025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-04-02T23:24:47.983945+0000","last_change":"2020-04-02T23:24:42.311312+0000","last_active":"2020-04-02T23:24:47.983945+0000","last_peered":"2020-04-02T23:24:47.983945+0000","last_clean":"2020-04-02T23:24:47.983945+0000","last_became_active":"2020-04-02T23:24:42.310964+0000","last_became_peered":"2020-04-02T23:24:42.310964+0000","last_unstale":"2020-04-02T23:24:47.983945+0000","last_undegraded":"2020-04-02T23:24:47.983945+0000","last_fullsized":"2020-04-02T23:24:47.983945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:24:40.944127+0000","last_clean_scrub_stamp":"2020-04-02T23:24:40.944127+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'125","reported_seq":"139","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:43.978952+0000","last_change":"2020-04-02T23:39:43.979031+0000","last_active":"2020-04-02T23:39:43.978952+0000","last_peered":"2020-04-02T23:39:43.978952+0000","last_clean":"2020-04-02T23:39:43.978952+0000","last_became_active":"2020-04-02T23:24:44.973795+0000","last_became_peered":"2020-04-02T23:24:44.973795+0000","last_unstale":"2020-04-02T23:39:43.978952+0000","last_undegraded":"2020-04-02T23:39:43.978952+0000","last_fullsized":"2020-04-02T23:39:43.978952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'125","last_scrub_stamp":"2020-04-02T23:39:43.978942+0000","last_deep_scrub":"26'125","last_deep_scrub_stamp":"2020-04-02T23:39:43.978942+0000","last_clean_scrub_stamp":"2020-04-02T23:39:43.978942+0000","log_size":125,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":446162,"num_write_kb":14876356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80475,"ondisk_log_size":80475,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":8715028,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":29,"num_read_kb":65,"num_write":2016,"num_write_kb":9326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23176,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13647872,"data_stored":17430056,"data_compressed":1653144,"data_compressed_allocated":3842048,"data_compressed_original":7684096,"omap_allocated":4474845,"internal_metadata":0},"log_size":1853,"ondisk_log_size":1853,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8031,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1550595,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509629,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":1529,"kb_used_meta":1047046,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":109351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1566281,"internal_metadata":1072175543},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:40:05 2020","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.1879999999999999,"15min":0.82899999999999996},"min":{"1min":0.27100000000000002,"5min":0.192,"15min":0.19},"max":{"1min":6.7939999999999996,"5min":8.2720000000000002,"15min":9.0990000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":1.9139999999999999,"5min":0.94399999999999995,"15min":0.65800000000000003},"min":{"1min":0.23899999999999999,"5min":0.223,"15min":0.19900000000000001},"max":{"1min":16.812000000000001,"5min":16.812000000000001,"15min":16.812000000000001},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Apr 2 23:40:05 2020","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":0.73499999999999999,"15min":0.57299999999999995},"min":{"1min":0.27800000000000002,"5min":0.214,"15min":0.21299999999999999},"max":{"1min":6.7089999999999996,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":1.47,"5min":1.252,"15min":0.90100000000000002},"min":{"1min":0.32900000000000001,"5min":0.23699999999999999,"15min":0.223},"max":{"1min":6.8230000000000004,"5min":8.3049999999999997,"15min":8.8030000000000008},"last":0.434}]},{"osd":2,"last update":"Thu Apr 2 23:40:05 2020","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.298,"15min":0.96399999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":9.1010000000000009,"5min":9.1010000000000009,"15min":9.1010000000000009},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.2050000000000001,"5min":0.73199999999999998,"15min":0.66600000000000004},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":5.5060000000000002,"5min":5.5060000000000002,"15min":5.6020000000000003},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Apr 2 23:40:05 2020","interfaces":[{"interface":"back","average":{"1min":1.708,"5min":0.84799999999999998,"15min":0.70199999999999996},"min":{"1min":0.24199999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":12.053000000000001,"5min":12.053000000000001,"15min":12.053000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":2.4849999999999999,"5min":1.621,"15min":1.097},"min":{"1min":0.42199999999999999,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":12.137,"5min":12.137,"15min":12.137},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Apr 2 23:40:05 2020","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.755,"15min":0.64900000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.22800000000000001},"max":{"1min":6.6950000000000003,"5min":6.6950000000000003,"15min":6.6950000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.71199999999999997,"15min":0.61699999999999999},"min":{"1min":0.29899999999999999,"5min":0.25600000000000001,"15min":0.22},"max":{"1min":4.3659999999999997,"5min":4.7160000000000002,"15min":5.3310000000000004},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Apr 2 23:40:05 2020","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.3740000000000001,"15min":0.93999999999999995},"min":{"1min":0.31,"5min":0.255,"15min":0.24199999999999999},"max":{"1min":6.8490000000000002,"5min":9.5389999999999997,"15min":9.5389999999999997},"last":0.504},{"interface":"front","average":{"1min":1.4119999999999999,"5min":0.999,"15min":0.77900000000000003},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.26700000000000002},"max":{"1min":6.6680000000000001,"5min":6.6680000000000001,"15min":6.6680000000000001},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Apr 2 23:40:05 2020","interfaces":[{"interface":"back","average":{"1min":1.6719999999999999,"5min":1.1240000000000001,"15min":0.81599999999999995},"min":{"1min":0.32600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":6.7309999999999999,"5min":7.7359999999999998,"15min":7.7359999999999998},"last":0.622},{"interface":"front","average":{"1min":1.306,"5min":0.996,"15min":0.76600000000000001},"min":{"1min":0.28899999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":6.3310000000000004,"5min":6.3310000000000004,"15min":6.6399999999999997},"last":0.63200000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542334,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":109917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:40:01 2020","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.873,"15min":0.59999999999999998},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":6.9640000000000004,"5min":6.9640000000000004,"15min":6.9640000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.84499999999999997,"15min":0.61799999999999999},"min":{"1min":0.22,"5min":0.20799999999999999,"15min":0.19600000000000001},"max":{"1min":5.2880000000000003,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.498}]},{"osd":1,"last update":"Thu Apr 2 23:40:01 2020","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":0.83299999999999996,"15min":0.62},"min":{"1min":0.217,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":8.0960000000000001,"5min":8.0960000000000001,"15min":8.0960000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.8740000000000001,"5min":1.073,"15min":0.75600000000000001},"min":{"1min":0.26700000000000002,"5min":0.23499999999999999,"15min":0.217},"max":{"1min":8.1319999999999997,"5min":8.1319999999999997,"15min":8.1319999999999997},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Apr 2 23:40:01 2020","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.78000000000000003,"15min":0.65700000000000003},"min":{"1min":0.248,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":4.3579999999999997,"5min":5.3769999999999998,"15min":11.308999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.85299999999999998,"15min":0.69199999999999995},"min":{"1min":0.307,"5min":0.25,"15min":0.25},"max":{"1min":2.0409999999999999,"5min":7.5590000000000002,"15min":7.5590000000000002},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Apr 2 23:40:01 2020","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.88700000000000001,"15min":0.72799999999999998},"min":{"1min":0.307,"5min":0.25700000000000001,"15min":0.249},"max":{"1min":4.4390000000000001,"5min":7.2160000000000002,"15min":7.2160000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":1.1950000000000001,"5min":0.91300000000000003,"15min":0.749},"min":{"1min":0.33400000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":6.8899999999999997,"5min":8.6630000000000003,"15min":8.6630000000000003},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Apr 2 23:40:01 2020","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.57199999999999995,"15min":0.64900000000000002},"min":{"1min":0.24299999999999999,"5min":0.22800000000000001,"15min":0.224},"max":{"1min":0.75,"5min":4.8639999999999999,"15min":5.8860000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.71099999999999997,"15min":0.58899999999999997},"min":{"1min":0.253,"5min":0.224,"15min":0.224},"max":{"1min":1.3169999999999999,"5min":4.0919999999999996,"15min":5.1210000000000004},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Apr 2 23:40:01 2020","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":1.012,"15min":0.72999999999999998},"min":{"1min":0.26700000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":3.5840000000000001,"5min":18.419,"15min":18.419},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.86499999999999999,"5min":1.1000000000000001,"15min":0.874},"min":{"1min":0.29399999999999998,"5min":0.28000000000000003,"15min":0.23300000000000001},"max":{"1min":4.3250000000000002,"5min":22.329000000000001,"15min":22.329000000000001},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Apr 2 23:40:01 2020","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.98499999999999999,"15min":0.74099999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27400000000000002},"max":{"1min":5.0410000000000004,"5min":6.6200000000000001,"15min":6.6200000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.69299999999999995,"15min":0.64400000000000002},"min":{"1min":0.314,"5min":0.254,"15min":0.254},"max":{"1min":1.4910000000000001,"5min":5.7960000000000003,"15min":5.7960000000000003},"last":0.56399999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542334,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1051856,"kb_used_data":3272,"kb_used_omap":212,"kb_used_meta":1048363,"kb_avail":93319984,"statfs":{"total":96636764160,"available":95559663616,"internally_reserved":1073741824,"allocated":3350528,"data_stored":4352493,"data_compressed":500856,"data_compressed_allocated":1187840,"data_compressed_original":2375680,"omap_allocated":217393,"internal_metadata":1073524431},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:40:08 2020","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":1.208,"15min":0.75900000000000001},"min":{"1min":0.22800000000000001,"5min":0.186,"15min":0.157},"max":{"1min":3.3279999999999998,"5min":7.0700000000000003,"15min":7.0700000000000003},"last":0.501},{"interface":"front","average":{"1min":1.786,"5min":1.0780000000000001,"15min":0.753},"min":{"1min":0.23799999999999999,"5min":0.20699999999999999,"15min":0.191},"max":{"1min":16.202000000000002,"5min":16.202000000000002,"15min":16.202000000000002},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Apr 2 23:40:08 2020","interfaces":[{"interface":"back","average":{"1min":1.8320000000000001,"5min":1.3300000000000001,"15min":0.877},"min":{"1min":0.223,"5min":0.20999999999999999,"15min":0.20000000000000001},"max":{"1min":12.231999999999999,"5min":12.231999999999999,"15min":12.231999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.2310000000000001,"15min":0.78900000000000003},"min":{"1min":0.316,"5min":0.23200000000000001,"15min":0.21299999999999999},"max":{"1min":3.7749999999999999,"5min":6.9199999999999999,"15min":6.9199999999999999},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Apr 2 23:40:08 2020","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.23,"15min":0.84699999999999998},"min":{"1min":0.29699999999999999,"5min":0.23999999999999999,"15min":0.23000000000000001},"max":{"1min":12.321,"5min":12.321,"15min":12.321},"last":0.44},{"interface":"front","average":{"1min":1.659,"5min":1.4119999999999999,"15min":0.88800000000000001},"min":{"1min":0.26300000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":14.734999999999999,"5min":14.734999999999999,"15min":14.734999999999999},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Apr 2 23:40:08 2020","interfaces":[{"interface":"back","average":{"1min":2.7290000000000001,"5min":1.387,"15min":0.92400000000000004},"min":{"1min":0.30199999999999999,"5min":0.224,"15min":0.224},"max":{"1min":16.161000000000001,"5min":16.161000000000001,"15min":16.161000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":2.6549999999999998,"5min":1.4610000000000001,"15min":0.97399999999999998},"min":{"1min":0.28599999999999998,"5min":0.26500000000000001,"15min":0.26400000000000001},"max":{"1min":12.372,"5min":12.372,"15min":12.372},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Apr 2 23:40:08 2020","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.129,"15min":0.77800000000000002},"min":{"1min":0.24299999999999999,"5min":0.218,"15min":0.20699999999999999},"max":{"1min":16.239000000000001,"5min":16.239000000000001,"15min":16.239000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.871,"5min":1.323,"15min":0.89300000000000002},"min":{"1min":0.374,"5min":0.219,"15min":0.219},"max":{"1min":3.246,"5min":7.9379999999999997,"15min":9.9800000000000004},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Apr 2 23:40:08 2020","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":1.246,"15min":0.86699999999999999},"min":{"1min":0.26000000000000001,"5min":0.24299999999999999,"15min":0.23799999999999999},"max":{"1min":12.289999999999999,"5min":12.289999999999999,"15min":12.289999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.86899999999999999,"5min":1.349,"15min":0.90400000000000003},"min":{"1min":0.314,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.2949999999999999,"5min":13.016,"15min":13.016},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Apr 2 23:40:08 2020","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.3779999999999999,"15min":0.89300000000000002},"min":{"1min":0.27100000000000002,"5min":0.222,"15min":0.222},"max":{"1min":16.015999999999998,"5min":16.015999999999998,"15min":16.015999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.7589999999999999,"5min":1.488,"15min":0.95199999999999996},"min":{"1min":0.41999999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":12.346,"5min":12.346,"15min":12.346},"last":0.63800000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542333,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1051796,"kb_used_data":3212,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93320044,"statfs":{"total":96636764160,"available":95559725056,"internally_reserved":1073741824,"allocated":3289088,"data_stored":4304289,"data_compressed":499178,"data_compressed_allocated":1183744,"data_compressed_original":2367488,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.63300000000000001,"15min":0.49199999999999999},"min":{"1min":0.189,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.46700000000000003,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.74199999999999999,"15min":0.57499999999999996},"min":{"1min":0.21199999999999999,"5min":0.20499999999999999,"15min":0.19800000000000001},"max":{"1min":0.56100000000000005,"5min":7.3920000000000003,"15min":7.3920000000000003},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.78300000000000003,"15min":0.62},"min":{"1min":0.26900000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.64500000000000002,"5min":5.46,"15min":7.859},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":1.095,"15min":0.71099999999999997},"min":{"1min":0.24399999999999999,"5min":0.20999999999999999,"15min":0.20499999999999999},"max":{"1min":0.58499999999999996,"5min":6.8319999999999999,"15min":8.1300000000000008},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.97499999999999998,"15min":0.64400000000000002},"min":{"1min":0.26700000000000002,"5min":0.23599999999999999,"15min":0.214},"max":{"1min":0.626,"5min":6.5679999999999996,"15min":6.5679999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.90600000000000003,"15min":0.69399999999999995},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.55500000000000005,"5min":5.6459999999999999,"15min":5.6459999999999999},"last":0.254}]},{"osd":3,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":1.089,"15min":0.71999999999999997},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.22700000000000001},"max":{"1min":0.54000000000000004,"5min":7.1189999999999998,"15min":7.1189999999999998},"last":0.435},{"interface":"front","average":{"1min":0.46600000000000003,"5min":1.0740000000000001,"15min":0.72699999999999998},"min":{"1min":0.29099999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59399999999999997,"5min":7.0780000000000003,"15min":7.0780000000000003},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.91600000000000004,"15min":0.61899999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.223},"max":{"1min":0.68400000000000005,"5min":6.5880000000000001,"15min":6.5880000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.79200000000000004,"15min":0.61899999999999999},"min":{"1min":0.32100000000000001,"5min":0.253,"15min":0.192},"max":{"1min":0.64100000000000001,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":0.41199999999999998}]},{"osd":6,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":1.157,"15min":0.84899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.247},"max":{"1min":0.59799999999999998,"5min":10.731,"15min":18.593},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":1.1850000000000001,"15min":0.84999999999999998},"min":{"1min":0.30199999999999999,"5min":0.25700000000000001,"15min":0.246},"max":{"1min":0.63100000000000001,"5min":8.2870000000000008,"15min":18.402000000000001},"last":0.28799999999999998}]},{"osd":7,"last update":"Thu Apr 2 23:39:11 2020","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":1.1639999999999999,"15min":0.74399999999999999},"min":{"1min":0.316,"5min":0.27300000000000002,"15min":0.245},"max":{"1min":0.629,"5min":9.0570000000000004,"15min":9.0570000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.93799999999999994,"15min":0.68999999999999995},"min":{"1min":0.30199999999999999,"5min":0.29599999999999999,"15min":0.253},"max":{"1min":0.73799999999999999,"5min":11.67,"15min":11.67},"last":0.46300000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509629,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1052504,"kb_used_data":3920,"kb_used_omap":1390,"kb_used_meta":1047185,"kb_avail":93319336,"statfs":{"total":96636764160,"available":95559000064,"internally_reserved":1073741824,"allocated":4014080,"data_stored":4581237,"data_compressed":325716,"data_compressed_allocated":733184,"data_compressed_original":1466368,"omap_allocated":1423856,"internal_metadata":1072317968},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 2 23:40:06 2020","interfaces":[{"interface":"back","average":{"1min":2.988,"5min":1.1000000000000001,"15min":0.71299999999999997},"min":{"1min":0.16200000000000001,"5min":0.159,"15min":0.156},"max":{"1min":13.994,"5min":13.994,"15min":13.994},"last":0.42299999999999999},{"interface":"front","average":{"1min":2.7160000000000002,"5min":1.0209999999999999,"15min":0.63900000000000001},"min":{"1min":0.187,"5min":0.17999999999999999,"15min":0.16400000000000001},"max":{"1min":15.039999999999999,"5min":15.039999999999999,"15min":15.039999999999999},"last":0.312}]},{"osd":2,"last update":"Thu Apr 2 23:40:06 2020","interfaces":[{"interface":"back","average":{"1min":1.7669999999999999,"5min":0.92900000000000005,"15min":0.63400000000000001},"min":{"1min":0.22900000000000001,"5min":0.17799999999999999,"15min":0.17199999999999999},"max":{"1min":6.9509999999999996,"5min":6.9509999999999996,"15min":6.9509999999999996},"last":0.377},{"interface":"front","average":{"1min":1.827,"5min":1.014,"15min":0.67400000000000004},"min":{"1min":0.22,"5min":0.17799999999999999,"15min":0.152},"max":{"1min":5.6029999999999998,"5min":10.241,"15min":10.241},"last":0.33000000000000002}]},{"osd":3,"last update":"Thu Apr 2 23:40:06 2020","interfaces":[{"interface":"back","average":{"1min":2.5379999999999998,"5min":0.99199999999999999,"15min":0.63900000000000001},"min":{"1min":0.20399999999999999,"5min":0.186,"15min":0.186},"max":{"1min":14.016,"5min":14.016,"15min":14.016},"last":0.34799999999999998},{"interface":"front","average":{"1min":2.581,"5min":1.127,"15min":0.75},"min":{"1min":0.26200000000000001,"5min":0.20699999999999999,"15min":0.20000000000000001},"max":{"1min":14.06,"5min":14.06,"15min":14.06},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Apr 2 23:40:06 2020","interfaces":[{"interface":"back","average":{"1min":2.4820000000000002,"5min":1.123,"15min":0.78700000000000003},"min":{"1min":0.27100000000000002,"5min":0.224,"15min":0.224},"max":{"1min":8.3170000000000002,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.375,"5min":0.95299999999999996,"15min":0.71399999999999997},"min":{"1min":0.26600000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":6.3200000000000003,"5min":6.3200000000000003,"15min":6.3200000000000003},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Apr 2 23:40:06 2020","interfaces":[{"interface":"back","average":{"1min":2.1469999999999998,"5min":1.1579999999999999,"15min":0.85599999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.26000000000000001},"max":{"1min":6.766,"5min":6.766,"15min":6.766},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.202,"5min":0.754,"15min":0.64200000000000002},"min":{"1min":0.313,"5min":0.255,"15min":0.255},"max":{"1min":6.4349999999999996,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Apr 2 23:40:06 2020","interfaces":[{"interface":"back","average":{"1min":2.1240000000000001,"5min":1.1779999999999999,"15min":0.94599999999999995},"min":{"1min":0.29499999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":7.0119999999999996,"5min":7.0119999999999996,"15min":24.530999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":2.4790000000000001,"5min":1.3979999999999999,"15min":1.0209999999999999},"min":{"1min":0.38600000000000001,"5min":0.317,"15min":0.26200000000000001},"max":{"1min":6.7210000000000001,"5min":8.7899999999999991,"15min":24.390000000000001},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Apr 2 23:40:06 2020","interfaces":[{"interface":"back","average":{"1min":2.7250000000000001,"5min":1.323,"15min":1.018},"min":{"1min":0.42099999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":6.5140000000000002,"5min":7.2539999999999996,"15min":24.459},"last":0.60299999999999998},{"interface":"front","average":{"1min":1.704,"5min":0.94999999999999996,"15min":0.78500000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":7.5049999999999999,"5min":7.5049999999999999,"15min":24.559000000000001},"last":0.62}]}]},{"osd":1,"up_from":15,"seq":64424509631,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":1514,"kb_used_meta":1047061,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":109351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1550595,"internal_metadata":1072191229},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:39:54 2020","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.60399999999999998,"15min":0.502},"min":{"1min":0.185,"5min":0.152,"15min":0.152},"max":{"1min":4.0119999999999996,"5min":4.0119999999999996,"15min":8.6370000000000005},"last":0.249},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.85399999999999998,"15min":0.63200000000000001},"min":{"1min":0.245,"5min":0.19900000000000001,"15min":0.17599999999999999},"max":{"1min":5.0369999999999999,"5min":7.2240000000000002,"15min":8.5950000000000006},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Apr 2 23:39:54 2020","interfaces":[{"interface":"back","average":{"1min":1.5349999999999999,"5min":1.0489999999999999,"15min":0.69899999999999995},"min":{"1min":0.20399999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":10.493,"5min":10.493,"15min":10.493},"last":0.313},{"interface":"front","average":{"1min":1.232,"5min":0.77800000000000002,"15min":0.67600000000000005},"min":{"1min":0.251,"5min":0.20200000000000001,"15min":0.192},"max":{"1min":10.525,"5min":10.525,"15min":12.585000000000001},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Apr 2 23:39:54 2020","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":0.89700000000000002,"15min":0.69099999999999995},"min":{"1min":0.27300000000000002,"5min":0.218,"15min":0.218},"max":{"1min":8.016,"5min":8.016,"15min":8.6690000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":1.3939999999999999,"5min":0.99299999999999999,"15min":0.70499999999999996},"min":{"1min":0.27900000000000003,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":8.0589999999999993,"5min":8.0589999999999993,"15min":8.4570000000000007},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Apr 2 23:39:54 2020","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.103,"15min":0.85899999999999999},"min":{"1min":0.40300000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":7.923,"5min":8.9600000000000009,"15min":8.9600000000000009},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.755,"15min":0.70599999999999996},"min":{"1min":0.37,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":7.9550000000000001,"5min":7.9550000000000001,"15min":9.0879999999999992},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Apr 2 23:39:54 2020","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.1739999999999999,"15min":0.88700000000000001},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.253},"max":{"1min":3.8650000000000002,"5min":8.5519999999999996,"15min":8.5519999999999996},"last":0.436},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.1919999999999999,"15min":0.92600000000000005},"min":{"1min":0.31,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":5.0039999999999996,"5min":8.9979999999999993,"15min":8.9979999999999993},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Apr 2 23:39:54 2020","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.4139999999999999,"15min":1.0169999999999999},"min":{"1min":0.34499999999999997,"5min":0.32400000000000001,"15min":0.26800000000000002},"max":{"1min":5.1040000000000001,"5min":10.012,"15min":10.012},"last":0.46899999999999997},{"interface":"front","average":{"1min":1.7729999999999999,"5min":1.621,"15min":1.1539999999999999},"min":{"1min":0.35199999999999998,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":5.1230000000000002,"5min":10.760999999999999,"15min":10.760999999999999},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Apr 2 23:39:54 2020","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.98199999999999998,"15min":0.84199999999999997},"min":{"1min":0.40300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":6.1189999999999998,"5min":6.1189999999999998,"15min":12.641999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1259999999999999,"15min":0.84899999999999998},"min":{"1min":0.42399999999999999,"5min":0.373,"15min":0.30299999999999999},"max":{"1min":3.786,"5min":7.306,"15min":8.8460000000000001},"last":0.503}]}]},{"osd":2,"up_from":15,"seq":64424509629,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1052556,"kb_used_data":3972,"kb_used_omap":1237,"kb_used_meta":1047338,"kb_avail":93319284,"statfs":{"total":96636764160,"available":95558946816,"internally_reserved":1073741824,"allocated":4067328,"data_stored":4628875,"data_compressed":327394,"data_compressed_allocated":737280,"data_compressed_original":1474560,"omap_allocated":1267315,"internal_metadata":1072474509},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:40:07 2020","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":0.72099999999999997,"15min":0.60699999999999998},"min":{"1min":0.214,"5min":0.161,"15min":0.153},"max":{"1min":6.3920000000000003,"5min":6.3920000000000003,"15min":6.8869999999999996},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.61499999999999999,"15min":0.59799999999999998},"min":{"1min":0.22,"5min":0.17399999999999999,"15min":0.17199999999999999},"max":{"1min":1.7130000000000001,"5min":4.907,"15min":4.907},"last":0.189}]},{"osd":1,"last update":"Thu Apr 2 23:40:07 2020","interfaces":[{"interface":"back","average":{"1min":4.2380000000000004,"5min":1.3149999999999999,"15min":0.81100000000000005},"min":{"1min":0.28699999999999998,"5min":0.182,"15min":0.16},"max":{"1min":37.390000000000001,"5min":37.390000000000001,"15min":37.390000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":4.367,"5min":1.5509999999999999,"15min":0.91300000000000003},"min":{"1min":0.29199999999999998,"5min":0.23200000000000001,"15min":0.223},"max":{"1min":38.082999999999998,"5min":38.082999999999998,"15min":38.082999999999998},"last":0.26400000000000001}]},{"osd":3,"last update":"Thu Apr 2 23:40:07 2020","interfaces":[{"interface":"back","average":{"1min":4.9950000000000001,"5min":1.6559999999999999,"15min":0.97099999999999997},"min":{"1min":0.23999999999999999,"5min":0.191,"15min":0.184},"max":{"1min":40.009,"5min":40.009,"15min":40.009},"last":0.309},{"interface":"front","average":{"1min":5.266,"5min":1.726,"15min":1.016},"min":{"1min":0.30599999999999999,"5min":0.20399999999999999,"15min":0.20100000000000001},"max":{"1min":40.039000000000001,"5min":40.039000000000001,"15min":40.039000000000001},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Apr 2 23:40:07 2020","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.83399999999999996,"15min":0.751},"min":{"1min":0.33900000000000002,"5min":0.27100000000000002,"15min":0.26700000000000002},"max":{"1min":4.6310000000000002,"5min":9.0619999999999994,"15min":9.0619999999999994},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.79100000000000004,"15min":0.76700000000000002},"min":{"1min":0.30399999999999999,"5min":0.27100000000000002,"15min":0.25900000000000001},"max":{"1min":1.677,"5min":5.5970000000000004,"15min":5.5970000000000004},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Apr 2 23:40:07 2020","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.997,"15min":0.81999999999999995},"min":{"1min":0.28699999999999998,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":4.5339999999999998,"5min":8.3539999999999992,"15min":8.3539999999999992},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.92500000000000004,"15min":0.79400000000000004},"min":{"1min":0.32200000000000001,"5min":0.29199999999999998,"15min":0.27500000000000002},"max":{"1min":4.6929999999999996,"5min":8.9949999999999992,"15min":8.9949999999999992},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Apr 2 23:40:07 2020","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.8149999999999999,"15min":1.244},"min":{"1min":0.44500000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":4.9550000000000001,"5min":68.593000000000004,"15min":68.593000000000004},"last":0.53800000000000003},{"interface":"front","average":{"1min":1.986,"5min":2.125,"15min":1.3440000000000001},"min":{"1min":0.42899999999999999,"5min":0.307,"15min":0.28999999999999998},"max":{"1min":9.3030000000000008,"5min":68.489000000000004,"15min":68.489000000000004},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Apr 2 23:40:07 2020","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.21,"15min":0.93999999999999995},"min":{"1min":0.40799999999999997,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":10.177,"5min":10.177,"15min":10.177},"last":0.625},{"interface":"front","average":{"1min":1.641,"5min":1.1950000000000001,"15min":0.90200000000000002},"min":{"1min":0.36799999999999999,"5min":0.32300000000000001,"15min":0.311},"max":{"1min":9.9770000000000003,"5min":9.9770000000000003,"15min":9.9770000000000003},"last":0.55600000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509631,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":1502,"kb_used_meta":1047073,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":109351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1538120,"internal_metadata":1072203704},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:39:59 2020","interfaces":[{"interface":"back","average":{"1min":1.948,"5min":1.0109999999999999,"15min":0.69899999999999995},"min":{"1min":0.21099999999999999,"5min":0.16600000000000001,"15min":0.154},"max":{"1min":13.66,"5min":13.66,"15min":13.66},"last":0.29799999999999999},{"interface":"front","average":{"1min":2.0350000000000001,"5min":0.92000000000000004,"15min":0.58399999999999996},"min":{"1min":0.20799999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":13.696,"5min":13.696,"15min":13.696},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Apr 2 23:39:59 2020","interfaces":[{"interface":"back","average":{"1min":3.3100000000000001,"5min":1.534,"15min":0.91500000000000004},"min":{"1min":0.24099999999999999,"5min":0.19800000000000001,"15min":0.17999999999999999},"max":{"1min":16.09,"5min":16.09,"15min":16.09},"last":0.245},{"interface":"front","average":{"1min":3.2839999999999998,"5min":1.3500000000000001,"15min":0.81299999999999994},"min":{"1min":0.27000000000000002,"5min":0.22900000000000001,"15min":0.182},"max":{"1min":19.577000000000002,"5min":19.577000000000002,"15min":19.577000000000002},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Apr 2 23:39:59 2020","interfaces":[{"interface":"back","average":{"1min":2.0030000000000001,"5min":1.1539999999999999,"15min":0.81999999999999995},"min":{"1min":0.218,"5min":0.216,"15min":0.18099999999999999},"max":{"1min":13.583,"5min":13.583,"15min":13.583},"last":0.28399999999999997},{"interface":"front","average":{"1min":1.4770000000000001,"5min":0.98799999999999999,"15min":0.69099999999999995},"min":{"1min":0.251,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":13.795,"5min":13.795,"15min":13.795},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Apr 2 23:39:59 2020","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.133,"15min":0.86399999999999999},"min":{"1min":0.29399999999999998,"5min":0.246,"15min":0.246},"max":{"1min":7.3369999999999997,"5min":7.3369999999999997,"15min":7.3369999999999997},"last":0.499},{"interface":"front","average":{"1min":2.3959999999999999,"5min":1.28,"15min":0.91200000000000003},"min":{"1min":0.29799999999999999,"5min":0.25900000000000001,"15min":0.25700000000000001},"max":{"1min":15.545999999999999,"5min":15.545999999999999,"15min":15.545999999999999},"last":0.377}]},{"osd":5,"last update":"Thu Apr 2 23:39:59 2020","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.204,"15min":0.88500000000000001},"min":{"1min":0.38,"5min":0.29399999999999998,"15min":0.27900000000000003},"max":{"1min":13.837999999999999,"5min":13.837999999999999,"15min":13.837999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":1.226,"5min":1.1020000000000001,"15min":0.85599999999999998},"min":{"1min":0.34499999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":7.4320000000000004,"5min":8.8650000000000002,"15min":8.8650000000000002},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Apr 2 23:39:59 2020","interfaces":[{"interface":"back","average":{"1min":2.8210000000000002,"5min":1.607,"15min":1.0840000000000001},"min":{"1min":0.38400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":15.587999999999999,"5min":15.587999999999999,"15min":15.587999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":1.841,"5min":1.542,"15min":1.026},"min":{"1min":0.33600000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":13.997999999999999,"5min":13.997999999999999,"15min":13.997999999999999},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Apr 2 23:39:59 2020","interfaces":[{"interface":"back","average":{"1min":2.258,"5min":1.2010000000000001,"15min":0.92200000000000004},"min":{"1min":0.39800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":13.638,"5min":13.638,"15min":13.638},"last":0.56899999999999995},{"interface":"front","average":{"1min":1.6890000000000001,"5min":1.1220000000000001,"15min":0.91600000000000004},"min":{"1min":0.36899999999999999,"5min":0.312,"15min":0.312},"max":{"1min":13.766999999999999,"5min":13.766999999999999,"15min":13.766999999999999},"last":0.52200000000000002}]}]}]}} 2020-04-02T23:40:15.524 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2020-04-02T23:24:46.979073+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=46, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:40:15.525 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2020-04-02T23:24:46.979073+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=46, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:40:15.525 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-04-02T23:24:40.944127+0000 time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=24, tm_sec=40, tm_wday=3, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=4, tm_mday=2, tm_hour=23, tm_min=39, tm_sec=23, tm_wday=3, tm_yday=93, tm_isdst=0) 2020-04-02T23:40:15.525 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2020-04-02T23:40:35.526 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:40:35.540 INFO:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-02T23:40:35.693 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.691+0000 7f13c663f700 1 Processor -- start 2020-04-02T23:40:35.693 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.691+0000 7f13c663f700 1 -- start start 2020-04-02T23:40:35.696 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.692+0000 7f13c663f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f13c01398d0 0x7f13c0139d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:40:35.696 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.692+0000 7f13c663f700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c00a31b0 con 0x7f13c00a6d40 2020-04-02T23:40:35.696 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.692+0000 7f13c663f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c00a49f0 con 0x7f13c00ab410 2020-04-02T23:40:35.698 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.692+0000 7f13c663f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c005ff40 con 0x7f13c01398d0 2020-04-02T23:40:35.698 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.692+0000 7f13bf7fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f13c00a6d40 0x7f13c01391c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60270/0 (socket says 172.21.15.42:60270) 2020-04-02T23:40:35.698 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.692+0000 7f13bf7fe700 1 -- 172.21.15.42:0/1405763039 learned_addr learned my addr 172.21.15.42:0/1405763039 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:40:35.699 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.692+0000 7f13c4bdc700 1 --2- 172.21.15.42:0/1405763039 >> v2:172.21.15.84:3300/0 conn(0x7f13c01398d0 0x7f13c0139d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:40:35.699 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.692+0000 7f13beffd700 1 -- 172.21.15.42:0/1405763039 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486012331 0 0) 0x7f13c00a31b0 con 0x7f13c00a6d40 2020-04-02T23:40:35.699 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.692+0000 7f13beffd700 1 -- 172.21.15.42:0/1405763039 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13a0003230 con 0x7f13c00a6d40 2020-04-02T23:40:35.699 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.692+0000 7f13beffd700 1 -- 172.21.15.42:0/1405763039 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195783584 0 0) 0x7f13c00a49f0 con 0x7f13c00ab410 2020-04-02T23:40:35.699 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.692+0000 7f13beffd700 1 -- 172.21.15.42:0/1405763039 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13c00a31b0 con 0x7f13c00ab410 2020-04-02T23:40:35.699 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.692+0000 7f13c4bdc700 1 -- 172.21.15.42:0/1405763039 >> v1:172.21.15.84:6789/0 conn(0x7f13c00ab410 legacy=0x7f13c00a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:40:35.699 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.692+0000 7f13c4bdc700 1 -- 172.21.15.42:0/1405763039 >> v1:172.21.15.42:6789/0 conn(0x7f13c00a6d40 legacy=0x7f13c01391c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:40:35.700 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.692+0000 7f13c4bdc700 1 -- 172.21.15.42:0/1405763039 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c00a3420 con 0x7f13c01398d0 2020-04-02T23:40:35.700 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.692+0000 7f13c4bdc700 1 --2- 172.21.15.42:0/1405763039 >> v2:172.21.15.84:3300/0 conn(0x7f13c01398d0 0x7f13c0139d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f13b80032b0 tx=0x7f13b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:35.700 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.693+0000 7f13c4bdc700 1 --2- 172.21.15.42:0/1405763039 >> v2:172.21.15.84:3300/0 conn(0x7f13c01398d0 0x7f13c0139d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f13b80032b0 tx=0x7f13b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:35.700 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.693+0000 7f13c4bdc700 1 --2- 172.21.15.42:0/1405763039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13c01398d0 0x7f13c0139d20 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f13b80032b0 tx=0x7f13b8007dc0).ready entity=mon.1 client_cookie=43b0b704febdc27a server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:40:35.700 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.693+0000 7f13c4bdc700 1 --2- 172.21.15.42:0/1405763039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13c01398d0 0x7f13c0139d20 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f13b80032b0 tx=0x7f13b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:35.700 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.693+0000 7f13beffd700 1 -- 172.21.15.42:0/1405763039 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13b8011d70 con 0x7f13c01398d0 2020-04-02T23:40:35.700 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.693+0000 7f13c4bdc700 1 --2- 172.21.15.42:0/1405763039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13c01398d0 0x7f13c0139d20 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f13b80032b0 tx=0x7f13b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:35.701 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.693+0000 7f13beffd700 1 -- 172.21.15.42:0/1405763039 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b800a160 con 0x7f13c01398d0 2020-04-02T23:40:35.701 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.693+0000 7f13c4bdc700 1 --2- 172.21.15.42:0/1405763039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13c01398d0 0x7f13c0139d20 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f13b80032b0 tx=0x7f13b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:35.701 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.693+0000 7f13beffd700 1 -- 172.21.15.42:0/1405763039 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13b800a500 con 0x7f13c01398d0 2020-04-02T23:40:35.701 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.693+0000 7f13c663f700 1 -- 172.21.15.42:0/1405763039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13c01398d0 msgr2=0x7f13c0139d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:40:35.701 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.693+0000 7f13c663f700 1 --2- 172.21.15.42:0/1405763039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13c01398d0 0x7f13c0139d20 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f13b80032b0 tx=0x7f13b8007dc0).stop 2020-04-02T23:40:35.701 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.693+0000 7f13c663f700 1 -- 172.21.15.42:0/1405763039 shutdown_connections 2020-04-02T23:40:35.701 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.693+0000 7f13c663f700 1 --2- 172.21.15.42:0/1405763039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13c01398d0 0x7f13c0139d20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:40:35.702 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.693+0000 7f13c663f700 1 -- 172.21.15.42:0/1405763039 >> 172.21.15.42:0/1405763039 conn(0x7f13c005b720 msgr2=0x7f13c00aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:40:35.702 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.693+0000 7f13c663f700 1 -- 172.21.15.42:0/1405763039 shutdown_connections 2020-04-02T23:40:35.702 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.693+0000 7f13c663f700 1 -- 172.21.15.42:0/1405763039 wait complete. 2020-04-02T23:40:35.702 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.694+0000 7f13c663f700 1 Processor -- start 2020-04-02T23:40:35.702 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.694+0000 7f13c663f700 1 -- start start 2020-04-02T23:40:35.712 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.695+0000 7f13c663f700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f13c00ab410 0x7f13c0061a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:40:35.712 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.695+0000 7f13c663f700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f13c01398d0 0x7f13c0146710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:40:35.712 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.695+0000 7f13c663f700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c009ca00 con 0x7f13c00a6d40 2020-04-02T23:40:35.712 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.695+0000 7f13c663f700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c009cca0 con 0x7f13c00ab410 2020-04-02T23:40:35.712 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.695+0000 7f13c663f700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c009cf40 con 0x7f13c01398d0 2020-04-02T23:40:35.716 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.695+0000 7f13bffff700 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f13c00a6d40 0x7f13c0133690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.42:54652/0 (socket says 172.21.15.42:54652) 2020-04-02T23:40:35.717 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.695+0000 7f13bffff700 1 -- 172.21.15.42:0/1555265229 learned_addr learned my addr 172.21.15.42:0/1555265229 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:40:35.719 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.695+0000 7f13bf7fe700 1 --2- 172.21.15.42:0/1555265229 >> v2:172.21.15.84:3300/0 conn(0x7f13c00ab410 0x7f13c0061a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:40:35.721 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.695+0000 7f13c4bdc700 1 --2- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f13c01398d0 0x7f13c0146710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:40:35.721 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.695+0000 7f13bd7fa700 1 -- 172.21.15.42:0/1555265229 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518382619 0 0) 0x7f13c009ca00 con 0x7f13c00a6d40 2020-04-02T23:40:35.721 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.695+0000 7f13bd7fa700 1 -- 172.21.15.42:0/1555265229 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13a4002fe0 con 0x7f13c00a6d40 2020-04-02T23:40:35.721 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.695+0000 7f13c4bdc700 1 -- 172.21.15.42:0/1555265229 >> v2:172.21.15.84:3300/0 conn(0x7f13c00ab410 msgr2=0x7f13c0061a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:40:35.721 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.695+0000 7f13c4bdc700 1 --2- 172.21.15.42:0/1555265229 >> v2:172.21.15.84:3300/0 conn(0x7f13c00ab410 0x7f13c0061a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:40:35.722 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.696+0000 7f13c4bdc700 1 -- 172.21.15.42:0/1555265229 >> v1:172.21.15.84:6789/0 conn(0x7f13c00a6d40 legacy=0x7f13c0133690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:40:35.722 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.696+0000 7f13c4bdc700 1 -- 172.21.15.42:0/1555265229 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c009a520 con 0x7f13c01398d0 2020-04-02T23:40:35.722 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.696+0000 7f13bf7fe700 1 --2- 172.21.15.42:0/1555265229 >> v2:172.21.15.84:3300/0 conn(0x7f13c00ab410 0x7f13c0061a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-04-02T23:40:35.722 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.696+0000 7f13c4bdc700 1 --2- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f13c01398d0 0x7f13c0146710 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f13b80032b0 tx=0x7f13b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:35.722 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.696+0000 7f13c4bdc700 1 --2- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f13c01398d0 0x7f13c0146710 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f13b80032b0 tx=0x7f13b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:35.722 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.696+0000 7f13c4bdc700 1 --2- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f13c01398d0 0x7f13c0146710 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f13b80032b0 tx=0x7f13b8007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:40:35.723 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.696+0000 7f13c4bdc700 1 --2- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f13c01398d0 0x7f13c0146710 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f13b80032b0 tx=0x7f13b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:35.723 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.696+0000 7f13bd7fa700 1 -- 172.21.15.42:0/1555265229 <== mon.2 v2:172.21.15.84:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13b800fbf0 con 0x7f13c01398d0 2020-04-02T23:40:35.723 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.696+0000 7f13c4bdc700 1 --2- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f13c01398d0 0x7f13c0146710 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f13b80032b0 tx=0x7f13b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:35.723 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.696+0000 7f13c4bdc700 1 --2- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f13c01398d0 0x7f13c0146710 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f13b80032b0 tx=0x7f13b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:35.723 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.696+0000 7f13bd7fa700 1 -- 172.21.15.42:0/1555265229 <== mon.2 v2:172.21.15.84:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b8005a40 con 0x7f13c01398d0 2020-04-02T23:40:35.724 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.696+0000 7f13c663f700 1 -- 172.21.15.42:0/1555265229 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c009c660 con 0x7f13c01398d0 2020-04-02T23:40:35.724 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.696+0000 7f13bd7fa700 1 -- 172.21.15.42:0/1555265229 <== mon.2 v2:172.21.15.84:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13b8005e20 con 0x7f13c01398d0 2020-04-02T23:40:35.724 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.696+0000 7f13c663f700 1 -- 172.21.15.42:0/1555265229 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c0133f60 con 0x7f13c01398d0 2020-04-02T23:40:35.724 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.697+0000 7f13c4bdc700 1 --2- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f13c01398d0 0x7f13c0146710 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f13b80032b0 tx=0x7f13b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:35.724 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.697+0000 7f13c663f700 1 -- 172.21.15.42:0/1555265229 --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c005d2e0 con 0x7f13c01398d0 2020-04-02T23:40:35.724 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.697+0000 7f13bd7fa700 1 -- 172.21.15.42:0/1555265229 <== mon.2 v2:172.21.15.84:3301/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7f13b800a6b0 con 0x7f13c01398d0 2020-04-02T23:40:35.725 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.697+0000 7f13c4bdc700 1 --2- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f13c01398d0 0x7f13c0146710 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f13b80032b0 tx=0x7f13b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:35.725 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.698+0000 7f13bd7fa700 1 --2- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f13a404d8f0 0x7f13a404fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:40:35.725 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.698+0000 7f13bd7fa700 1 -- 172.21.15.42:0/1555265229 <== mon.2 v2:172.21.15.84:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f13b8063790 con 0x7f13c01398d0 2020-04-02T23:40:35.725 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.698+0000 7f13bffff700 1 --2- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f13a404d8f0 0x7f13a404fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:40:35.725 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.698+0000 7f13bffff700 1 --2- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f13a404d8f0 0x7f13a404fdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f13b0001160 tx=0x7f13b0002820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:35.725 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.698+0000 7f13bffff700 1 --2- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f13a404d8f0 0x7f13a404fdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f13b0001160 tx=0x7f13b0002820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:35.726 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.698+0000 7f13bffff700 1 --2- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f13a404d8f0 0x7f13a404fdb0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7f13b0001160 tx=0x7f13b0002820).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:40:35.726 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.704+0000 7f13c4bdc700 1 --2- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f13c01398d0 0x7f13c0146710 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f13b80032b0 tx=0x7f13b8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:35.726 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.704+0000 7f13bd7fa700 1 -- 172.21.15.42:0/1555265229 <== mon.2 v2:172.21.15.84:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7f13b803ef30 con 0x7f13c01398d0 2020-04-02T23:40:35.847 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.845+0000 7f13c663f700 1 -- 172.21.15.42:0/1555265229 --> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13c0146510 con 0x7f13a404d8f0 2020-04-02T23:40:35.854 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.849+0000 7f13bffff700 1 --2- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f13a404d8f0 0x7f13a404fdb0 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7f13b0001160 tx=0x7f13b0002820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:35.854 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.849+0000 7f13bd7fa700 1 -- 172.21.15.42:0/1555265229 <== mgr.4100 v2:172.21.15.84:6800/23437 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+105757 (secure 0 0 0) 0x7f13c0146510 con 0x7f13a404d8f0 2020-04-02T23:40:35.854 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.850+0000 7f13c663f700 1 -- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f13a404d8f0 msgr2=0x7f13a404fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:40:35.854 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.850+0000 7f13c663f700 1 --2- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f13a404d8f0 0x7f13a404fdb0 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7f13b0001160 tx=0x7f13b0002820).stop 2020-04-02T23:40:35.855 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.850+0000 7f13c663f700 1 -- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f13c01398d0 msgr2=0x7f13c0146710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:40:35.855 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.850+0000 7f13c663f700 1 --2- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f13c01398d0 0x7f13c0146710 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f13b80032b0 tx=0x7f13b8007dc0).stop 2020-04-02T23:40:35.855 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.851+0000 7f13c663f700 1 -- 172.21.15.42:0/1555265229 shutdown_connections 2020-04-02T23:40:35.855 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.851+0000 7f13c663f700 1 --2- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7f13a404d8f0 0x7f13a404fdb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:40:35.855 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.851+0000 7f13c663f700 1 --2- 172.21.15.42:0/1555265229 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7f13c01398d0 0x7f13c0146710 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:40:35.855 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.851+0000 7f13c663f700 1 --2- 172.21.15.42:0/1555265229 >> v2:172.21.15.84:3300/0 conn(0x7f13c00ab410 0x7f13c0061a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:40:35.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.851+0000 7f13c663f700 1 -- 172.21.15.42:0/1555265229 >> 172.21.15.42:0/1555265229 conn(0x7f13c005b720 msgr2=0x7f13c00aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:40:35.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.851+0000 7f13c663f700 1 -- 172.21.15.42:0/1555265229 shutdown_connections 2020-04-02T23:40:35.856 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:35.851+0000 7f13c663f700 1 -- 172.21.15.42:0/1555265229 wait complete. 2020-04-02T23:40:35.856 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2020-04-02T23:40:35.856 INFO:teuthology.orchestra.run.smithi042.stdout: 2020-04-02T23:40:35.863 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":506,"stamp":"2020-04-02T23:40:35.298786+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8715028,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":29,"num_read_kb":65,"num_write":448180,"num_write_kb":14885691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31207,"num_omap_keys":52,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82332,"ondisk_log_size":82332,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8404112,"kb_used_data":15440,"kb_used_omap":7386,"kb_used_meta":8381221,"kb_avail":746570608,"statfs":{"total":773094113280,"available":764488302592,"internally_reserved":8589934592,"allocated":15810560,"data_stored":18304864,"data_compressed":1653144,"data_compressed_allocated":3842048,"data_compressed_original":7684096,"omap_allocated":7563560,"internal_metadata":8582371032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001920"},"pg_stats":[{"pgid":"4.2","version":"26'17358","reported_seq":"17372","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:40:06.946585+0000","last_change":"2020-04-02T23:40:06.946688+0000","last_active":"2020-04-02T23:40:06.946585+0000","last_peered":"2020-04-02T23:40:06.946585+0000","last_clean":"2020-04-02T23:40:06.946585+0000","last_became_active":"2020-04-02T23:24:47.993002+0000","last_became_peered":"2020-04-02T23:24:47.993002+0000","last_unstale":"2020-04-02T23:40:06.946585+0000","last_undegraded":"2020-04-02T23:40:06.946585+0000","last_fullsized":"2020-04-02T23:40:06.946585+0000","mapping_epoch":24,"log_start":"26'7349","ondisk_log_start":"26'7349","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'17358","last_scrub_stamp":"2020-04-02T23:40:06.946579+0000","last_deep_scrub":"26'17358","last_deep_scrub_stamp":"2020-04-02T23:40:06.946579+0000","last_clean_scrub_stamp":"2020-04-02T23:40:06.946579+0000","log_size":10009,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58870,"num_write_kb":1925310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:27.185192+0000","last_change":"2020-04-02T23:39:27.185287+0000","last_active":"2020-04-02T23:39:27.185192+0000","last_peered":"2020-04-02T23:39:27.185192+0000","last_clean":"2020-04-02T23:39:27.185192+0000","last_became_active":"2020-04-02T23:24:42.210455+0000","last_became_peered":"2020-04-02T23:24:42.210455+0000","last_unstale":"2020-04-02T23:39:27.185192+0000","last_undegraded":"2020-04-02T23:39:27.185192+0000","last_fullsized":"2020-04-02T23:39:27.185192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:39:27.185184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:39:27.185184+0000","last_clean_scrub_stamp":"2020-04-02T23:39:27.185184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'32","reported_seq":"47","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:51.276349+0000","last_change":"2020-04-02T23:39:44.413193+0000","last_active":"2020-04-02T23:39:51.276349+0000","last_peered":"2020-04-02T23:39:51.276349+0000","last_clean":"2020-04-02T23:39:51.276349+0000","last_became_active":"2020-04-02T23:24:44.977559+0000","last_became_peered":"2020-04-02T23:24:44.977559+0000","last_unstale":"2020-04-02T23:39:51.276349+0000","last_undegraded":"2020-04-02T23:39:51.276349+0000","last_fullsized":"2020-04-02T23:39:51.276349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'30","last_scrub_stamp":"2020-04-02T23:39:44.413104+0000","last_deep_scrub":"26'30","last_deep_scrub_stamp":"2020-04-02T23:39:44.413104+0000","last_clean_scrub_stamp":"2020-04-02T23:39:44.413104+0000","log_size":32,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"26'14611","reported_seq":"14625","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:40:11.893761+0000","last_change":"2020-04-02T23:40:11.893866+0000","last_active":"2020-04-02T23:40:11.893761+0000","last_peered":"2020-04-02T23:40:11.893761+0000","last_clean":"2020-04-02T23:40:11.893761+0000","last_became_active":"2020-04-02T23:24:48.353610+0000","last_became_peered":"2020-04-02T23:24:48.353610+0000","last_unstale":"2020-04-02T23:40:11.893761+0000","last_undegraded":"2020-04-02T23:40:11.893761+0000","last_fullsized":"2020-04-02T23:40:11.893761+0000","mapping_epoch":24,"log_start":"26'4513","ondisk_log_start":"26'4513","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'14611","last_scrub_stamp":"2020-04-02T23:40:11.893755+0000","last_deep_scrub":"26'14611","last_deep_scrub_stamp":"2020-04-02T23:40:11.893755+0000","last_clean_scrub_stamp":"2020-04-02T23:40:11.893755+0000","log_size":10098,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48592,"num_write_kb":1720160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:40:02.931004+0000","last_change":"2020-04-02T23:40:02.931084+0000","last_active":"2020-04-02T23:40:02.931004+0000","last_peered":"2020-04-02T23:40:02.931004+0000","last_clean":"2020-04-02T23:40:02.931004+0000","last_became_active":"2020-04-02T23:24:42.210546+0000","last_became_peered":"2020-04-02T23:24:42.210546+0000","last_unstale":"2020-04-02T23:40:02.931004+0000","last_undegraded":"2020-04-02T23:40:02.931004+0000","last_fullsized":"2020-04-02T23:40:02.931004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:40:02.931000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:40:02.931000+0000","last_clean_scrub_stamp":"2020-04-02T23:40:02.931000+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"26'1005","reported_seq":"1020","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:33.609262+0000","last_change":"2020-04-02T23:39:30.575219+0000","last_active":"2020-04-02T23:39:33.609262+0000","last_peered":"2020-04-02T23:39:33.609262+0000","last_clean":"2020-04-02T23:39:33.609262+0000","last_became_active":"2020-04-02T23:24:44.976952+0000","last_became_peered":"2020-04-02T23:24:44.976952+0000","last_unstale":"2020-04-02T23:39:33.609262+0000","last_undegraded":"2020-04-02T23:39:33.609262+0000","last_fullsized":"2020-04-02T23:39:33.609262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1003","last_scrub_stamp":"2020-04-02T23:39:30.575123+0000","last_deep_scrub":"26'1003","last_deep_scrub_stamp":"2020-04-02T23:39:30.575123+0000","last_clean_scrub_stamp":"2020-04-02T23:39:30.575123+0000","log_size":1005,"ondisk_log_size":1005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4471886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":999,"num_write_kb":4717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12050,"num_omap_keys":26,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"26'15959","reported_seq":"15973","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:40:14.918415+0000","last_change":"2020-04-02T23:40:14.918497+0000","last_active":"2020-04-02T23:40:14.918415+0000","last_peered":"2020-04-02T23:40:14.918415+0000","last_clean":"2020-04-02T23:40:14.918415+0000","last_became_active":"2020-04-02T23:24:48.353668+0000","last_became_peered":"2020-04-02T23:24:48.353668+0000","last_unstale":"2020-04-02T23:40:14.918415+0000","last_undegraded":"2020-04-02T23:40:14.918415+0000","last_fullsized":"2020-04-02T23:40:14.918415+0000","mapping_epoch":24,"log_start":"26'5873","ondisk_log_start":"26'5873","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'15959","last_scrub_stamp":"2020-04-02T23:40:14.918410+0000","last_deep_scrub":"26'15959","last_deep_scrub_stamp":"2020-04-02T23:40:14.918410+0000","last_clean_scrub_stamp":"2020-04-02T23:40:14.918410+0000","log_size":10086,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53843,"num_write_kb":1823426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:42.677241+0000","last_change":"2020-04-02T23:39:42.677324+0000","last_active":"2020-04-02T23:39:42.677241+0000","last_peered":"2020-04-02T23:39:42.677241+0000","last_clean":"2020-04-02T23:39:42.677241+0000","last_became_active":"2020-04-02T23:24:41.966868+0000","last_became_peered":"2020-04-02T23:24:41.966868+0000","last_unstale":"2020-04-02T23:39:42.677241+0000","last_undegraded":"2020-04-02T23:39:42.677241+0000","last_fullsized":"2020-04-02T23:39:42.677241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:39:42.677235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:39:42.677235+0000","last_clean_scrub_stamp":"2020-04-02T23:39:42.677235+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"26'20","reported_seq":"34","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:33.608921+0000","last_change":"2020-04-02T23:39:28.228046+0000","last_active":"2020-04-02T23:39:33.608921+0000","last_peered":"2020-04-02T23:39:33.608921+0000","last_clean":"2020-04-02T23:39:33.608921+0000","last_became_active":"2020-04-02T23:24:44.977934+0000","last_became_peered":"2020-04-02T23:24:44.977934+0000","last_unstale":"2020-04-02T23:39:33.608921+0000","last_undegraded":"2020-04-02T23:39:33.608921+0000","last_fullsized":"2020-04-02T23:39:33.608921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'17","last_scrub_stamp":"2020-04-02T23:39:28.227959+0000","last_deep_scrub":"26'17","last_deep_scrub_stamp":"2020-04-02T23:39:28.227959+0000","last_clean_scrub_stamp":"2020-04-02T23:39:28.227959+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11126,"num_omap_keys":24,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"26'16046","reported_seq":"16060","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:40:15.852899+0000","last_change":"2020-04-02T23:40:15.852977+0000","last_active":"2020-04-02T23:40:15.852899+0000","last_peered":"2020-04-02T23:40:15.852899+0000","last_clean":"2020-04-02T23:40:15.852899+0000","last_became_active":"2020-04-02T23:24:48.353432+0000","last_became_peered":"2020-04-02T23:24:48.353432+0000","last_unstale":"2020-04-02T23:40:15.852899+0000","last_undegraded":"2020-04-02T23:40:15.852899+0000","last_fullsized":"2020-04-02T23:40:15.852899+0000","mapping_epoch":24,"log_start":"26'6041","ondisk_log_start":"26'6041","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16046","last_scrub_stamp":"2020-04-02T23:40:15.852895+0000","last_deep_scrub":"26'16046","last_deep_scrub_stamp":"2020-04-02T23:40:15.852895+0000","last_clean_scrub_stamp":"2020-04-02T23:40:15.852895+0000","log_size":10005,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54896,"num_write_kb":1823228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:40:03.957362+0000","last_change":"2020-04-02T23:40:03.957431+0000","last_active":"2020-04-02T23:40:03.957362+0000","last_peered":"2020-04-02T23:40:03.957362+0000","last_clean":"2020-04-02T23:40:03.957362+0000","last_became_active":"2020-04-02T23:24:42.200326+0000","last_became_peered":"2020-04-02T23:24:42.200326+0000","last_unstale":"2020-04-02T23:40:03.957362+0000","last_undegraded":"2020-04-02T23:40:03.957362+0000","last_fullsized":"2020-04-02T23:40:03.957362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:40:03.957357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:40:03.957357+0000","last_clean_scrub_stamp":"2020-04-02T23:40:03.957357+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'4","reported_seq":"24","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:40:09.625910+0000","last_change":"2020-04-02T23:40:09.625961+0000","last_active":"2020-04-02T23:40:09.625910+0000","last_peered":"2020-04-02T23:40:09.625910+0000","last_clean":"2020-04-02T23:40:09.625910+0000","last_became_active":"2020-04-02T23:24:37.114896+0000","last_became_peered":"2020-04-02T23:24:37.114896+0000","last_unstale":"2020-04-02T23:40:09.625910+0000","last_undegraded":"2020-04-02T23:40:09.625910+0000","last_fullsized":"2020-04-02T23:40:09.625910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2020-04-02T23:40:09.625906+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2020-04-02T23:40:09.625906+0000","last_clean_scrub_stamp":"2020-04-02T23:40:09.625906+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8031,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"26'4","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:31.951249+0000","last_change":"2020-04-02T23:39:31.951249+0000","last_active":"2020-04-02T23:39:31.951249+0000","last_peered":"2020-04-02T23:39:31.951249+0000","last_clean":"2020-04-02T23:39:31.951249+0000","last_became_active":"2020-04-02T23:24:44.977355+0000","last_became_peered":"2020-04-02T23:24:44.977355+0000","last_unstale":"2020-04-02T23:39:31.951249+0000","last_undegraded":"2020-04-02T23:39:31.951249+0000","last_fullsized":"2020-04-02T23:39:31.951249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2020-04-02T23:39:31.951151+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2020-04-02T23:39:31.951151+0000","last_clean_scrub_stamp":"2020-04-02T23:39:31.951151+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"26'16586","reported_seq":"16600","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:55.835195+0000","last_change":"2020-04-02T23:39:41.836654+0000","last_active":"2020-04-02T23:39:55.835195+0000","last_peered":"2020-04-02T23:39:55.835195+0000","last_clean":"2020-04-02T23:39:55.835195+0000","last_became_active":"2020-04-02T23:24:48.179989+0000","last_became_peered":"2020-04-02T23:24:48.179989+0000","last_unstale":"2020-04-02T23:39:55.835195+0000","last_undegraded":"2020-04-02T23:39:55.835195+0000","last_fullsized":"2020-04-02T23:39:55.835195+0000","mapping_epoch":24,"log_start":"26'6520","ondisk_log_start":"26'6520","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16248","last_scrub_stamp":"2020-04-02T23:39:41.836588+0000","last_deep_scrub":"26'16248","last_deep_scrub_stamp":"2020-04-02T23:39:41.836588+0000","last_clean_scrub_stamp":"2020-04-02T23:39:41.836588+0000","log_size":10066,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56206,"num_write_kb":1812324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:59.961979+0000","last_change":"2020-04-02T23:39:59.962067+0000","last_active":"2020-04-02T23:39:59.961979+0000","last_peered":"2020-04-02T23:39:59.961979+0000","last_clean":"2020-04-02T23:39:59.961979+0000","last_became_active":"2020-04-02T23:24:41.966804+0000","last_became_peered":"2020-04-02T23:24:41.966804+0000","last_unstale":"2020-04-02T23:39:59.961979+0000","last_undegraded":"2020-04-02T23:39:59.961979+0000","last_fullsized":"2020-04-02T23:39:59.961979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:39:59.961974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:39:59.961974+0000","last_clean_scrub_stamp":"2020-04-02T23:39:59.961974+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"26'38","reported_seq":"81","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:41.893728+0000","last_change":"2020-04-02T23:39:41.893825+0000","last_active":"2020-04-02T23:39:41.893728+0000","last_peered":"2020-04-02T23:39:41.893728+0000","last_clean":"2020-04-02T23:39:41.893728+0000","last_became_active":"2020-04-02T23:24:44.977243+0000","last_became_peered":"2020-04-02T23:24:44.977243+0000","last_unstale":"2020-04-02T23:39:41.893728+0000","last_undegraded":"2020-04-02T23:39:41.893728+0000","last_fullsized":"2020-04-02T23:39:41.893728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'38","last_scrub_stamp":"2020-04-02T23:39:41.893720+0000","last_deep_scrub":"26'38","last_deep_scrub_stamp":"2020-04-02T23:39:41.893720+0000","last_clean_scrub_stamp":"2020-04-02T23:39:41.893720+0000","log_size":38,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":47478,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":65,"num_write":40,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"26'16973","reported_seq":"16987","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:40:08.924241+0000","last_change":"2020-04-02T23:40:08.924343+0000","last_active":"2020-04-02T23:40:08.924241+0000","last_peered":"2020-04-02T23:40:08.924241+0000","last_clean":"2020-04-02T23:40:08.924241+0000","last_became_active":"2020-04-02T23:24:48.353592+0000","last_became_peered":"2020-04-02T23:24:48.353592+0000","last_unstale":"2020-04-02T23:40:08.924241+0000","last_undegraded":"2020-04-02T23:40:08.924241+0000","last_fullsized":"2020-04-02T23:40:08.924241+0000","mapping_epoch":24,"log_start":"26'6926","ondisk_log_start":"26'6926","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16973","last_scrub_stamp":"2020-04-02T23:40:08.924234+0000","last_deep_scrub":"26'16973","last_deep_scrub_stamp":"2020-04-02T23:40:08.924234+0000","last_clean_scrub_stamp":"2020-04-02T23:40:08.924234+0000","log_size":10047,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56545,"num_write_kb":1907521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:40:07.001042+0000","last_change":"2020-04-02T23:40:07.001127+0000","last_active":"2020-04-02T23:40:07.001042+0000","last_peered":"2020-04-02T23:40:07.001042+0000","last_clean":"2020-04-02T23:40:07.001042+0000","last_became_active":"2020-04-02T23:24:41.965120+0000","last_became_peered":"2020-04-02T23:24:41.965120+0000","last_unstale":"2020-04-02T23:40:07.001042+0000","last_undegraded":"2020-04-02T23:40:07.001042+0000","last_fullsized":"2020-04-02T23:40:07.001042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:40:07.001037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:40:07.001037+0000","last_clean_scrub_stamp":"2020-04-02T23:40:07.001037+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'613","reported_seq":"627","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:57.048494+0000","last_change":"2020-04-02T23:39:57.048581+0000","last_active":"2020-04-02T23:39:57.048494+0000","last_peered":"2020-04-02T23:39:57.048494+0000","last_clean":"2020-04-02T23:39:57.048494+0000","last_became_active":"2020-04-02T23:24:44.980010+0000","last_became_peered":"2020-04-02T23:24:44.980010+0000","last_unstale":"2020-04-02T23:39:57.048494+0000","last_undegraded":"2020-04-02T23:39:57.048494+0000","last_fullsized":"2020-04-02T23:39:57.048494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'613","last_scrub_stamp":"2020-04-02T23:39:57.048488+0000","last_deep_scrub":"26'613","last_deep_scrub_stamp":"2020-04-02T23:39:57.048488+0000","last_clean_scrub_stamp":"2020-04-02T23:39:57.048488+0000","log_size":613,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194938,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":605,"num_write_kb":4299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"26'16200","reported_seq":"16214","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:40:03.898233+0000","last_change":"2020-04-02T23:40:03.898331+0000","last_active":"2020-04-02T23:40:03.898233+0000","last_peered":"2020-04-02T23:40:03.898233+0000","last_clean":"2020-04-02T23:40:03.898233+0000","last_became_active":"2020-04-02T23:24:48.179994+0000","last_became_peered":"2020-04-02T23:24:48.179994+0000","last_unstale":"2020-04-02T23:40:03.898233+0000","last_undegraded":"2020-04-02T23:40:03.898233+0000","last_fullsized":"2020-04-02T23:40:03.898233+0000","mapping_epoch":24,"log_start":"26'6110","ondisk_log_start":"26'6110","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16200","last_scrub_stamp":"2020-04-02T23:40:03.898227+0000","last_deep_scrub":"26'16200","last_deep_scrub_stamp":"2020-04-02T23:40:03.898227+0000","last_clean_scrub_stamp":"2020-04-02T23:40:03.898227+0000","log_size":10090,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54828,"num_write_kb":1835362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'16","reported_seq":"30","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:57.879547+0000","last_change":"2020-04-02T23:39:57.879618+0000","last_active":"2020-04-02T23:39:57.879547+0000","last_peered":"2020-04-02T23:39:57.879547+0000","last_clean":"2020-04-02T23:39:57.879547+0000","last_became_active":"2020-04-02T23:24:44.978145+0000","last_became_peered":"2020-04-02T23:24:44.978145+0000","last_unstale":"2020-04-02T23:39:57.879547+0000","last_undegraded":"2020-04-02T23:39:57.879547+0000","last_fullsized":"2020-04-02T23:39:57.879547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16","last_scrub_stamp":"2020-04-02T23:39:57.879541+0000","last_deep_scrub":"26'16","last_deep_scrub_stamp":"2020-04-02T23:39:57.879541+0000","last_clean_scrub_stamp":"2020-04-02T23:39:57.879541+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"17","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:27.922218+0000","last_change":"2020-04-02T23:39:27.922278+0000","last_active":"2020-04-02T23:39:27.922218+0000","last_peered":"2020-04-02T23:39:27.922218+0000","last_clean":"2020-04-02T23:39:27.922218+0000","last_became_active":"2020-04-02T23:24:42.311136+0000","last_became_peered":"2020-04-02T23:24:42.311136+0000","last_unstale":"2020-04-02T23:39:27.922218+0000","last_undegraded":"2020-04-02T23:39:27.922218+0000","last_fullsized":"2020-04-02T23:39:27.922218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:39:27.922214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:39:27.922214+0000","last_clean_scrub_stamp":"2020-04-02T23:39:27.922214+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"26'18520","reported_seq":"18534","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:55.946486+0000","last_change":"2020-04-02T23:39:55.946558+0000","last_active":"2020-04-02T23:39:55.946486+0000","last_peered":"2020-04-02T23:39:55.946486+0000","last_clean":"2020-04-02T23:39:55.946486+0000","last_became_active":"2020-04-02T23:24:48.179883+0000","last_became_peered":"2020-04-02T23:24:48.179883+0000","last_unstale":"2020-04-02T23:39:55.946486+0000","last_undegraded":"2020-04-02T23:39:55.946486+0000","last_fullsized":"2020-04-02T23:39:55.946486+0000","mapping_epoch":24,"log_start":"26'8446","ondisk_log_start":"26'8446","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'18520","last_scrub_stamp":"2020-04-02T23:39:55.946482+0000","last_deep_scrub":"26'18520","last_deep_scrub_stamp":"2020-04-02T23:39:55.946482+0000","last_clean_scrub_stamp":"2020-04-02T23:39:55.946482+0000","log_size":10074,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62382,"num_write_kb":2029025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"18","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:40:13.889066+0000","last_change":"2020-04-02T23:40:13.889134+0000","last_active":"2020-04-02T23:40:13.889066+0000","last_peered":"2020-04-02T23:40:13.889066+0000","last_clean":"2020-04-02T23:40:13.889066+0000","last_became_active":"2020-04-02T23:24:42.310964+0000","last_became_peered":"2020-04-02T23:24:42.310964+0000","last_unstale":"2020-04-02T23:40:13.889066+0000","last_undegraded":"2020-04-02T23:40:13.889066+0000","last_fullsized":"2020-04-02T23:40:13.889066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-02T23:40:13.889061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-02T23:40:13.889061+0000","last_clean_scrub_stamp":"2020-04-02T23:40:13.889061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'125","reported_seq":"139","reported_epoch":"26","state":"active+clean","last_fresh":"2020-04-02T23:39:43.978952+0000","last_change":"2020-04-02T23:39:43.979031+0000","last_active":"2020-04-02T23:39:43.978952+0000","last_peered":"2020-04-02T23:39:43.978952+0000","last_clean":"2020-04-02T23:39:43.978952+0000","last_became_active":"2020-04-02T23:24:44.973795+0000","last_became_peered":"2020-04-02T23:24:44.973795+0000","last_unstale":"2020-04-02T23:39:43.978952+0000","last_undegraded":"2020-04-02T23:39:43.978952+0000","last_fullsized":"2020-04-02T23:39:43.978952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'125","last_scrub_stamp":"2020-04-02T23:39:43.978942+0000","last_deep_scrub":"26'125","last_deep_scrub_stamp":"2020-04-02T23:39:43.978942+0000","last_clean_scrub_stamp":"2020-04-02T23:39:43.978942+0000","log_size":125,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":446162,"num_write_kb":14876356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80475,"ondisk_log_size":80475,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":8715028,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":29,"num_read_kb":65,"num_write":2016,"num_write_kb":9326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23176,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13647872,"data_stored":17430056,"data_compressed":1653144,"data_compressed_allocated":3842048,"data_compressed_original":7684096,"omap_allocated":4474845,"internal_metadata":0},"log_size":1853,"ondisk_log_size":1853,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8031,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1550595,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509633,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":1529,"kb_used_meta":1047046,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":109351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1566281,"internal_metadata":1072175543},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:40:05 2020","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.1879999999999999,"15min":0.82899999999999996},"min":{"1min":0.27100000000000002,"5min":0.192,"15min":0.19},"max":{"1min":6.7939999999999996,"5min":8.2720000000000002,"15min":9.0990000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":1.9139999999999999,"5min":0.94399999999999995,"15min":0.65800000000000003},"min":{"1min":0.23899999999999999,"5min":0.223,"15min":0.19900000000000001},"max":{"1min":16.812000000000001,"5min":16.812000000000001,"15min":16.812000000000001},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Apr 2 23:40:05 2020","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":0.73499999999999999,"15min":0.57299999999999995},"min":{"1min":0.27800000000000002,"5min":0.214,"15min":0.21299999999999999},"max":{"1min":6.7089999999999996,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":0.28399999999999997},{"interface":"front","average":{"1min":1.47,"5min":1.252,"15min":0.90100000000000002},"min":{"1min":0.32900000000000001,"5min":0.23699999999999999,"15min":0.223},"max":{"1min":6.8230000000000004,"5min":8.3049999999999997,"15min":8.8030000000000008},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Apr 2 23:40:05 2020","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.298,"15min":0.96399999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":9.1010000000000009,"5min":9.1010000000000009,"15min":9.1010000000000009},"last":0.52000000000000002},{"interface":"front","average":{"1min":1.2050000000000001,"5min":0.73199999999999998,"15min":0.66600000000000004},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":5.5060000000000002,"5min":5.5060000000000002,"15min":5.6020000000000003},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Apr 2 23:40:05 2020","interfaces":[{"interface":"back","average":{"1min":1.708,"5min":0.84799999999999998,"15min":0.70199999999999996},"min":{"1min":0.24199999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":12.053000000000001,"5min":12.053000000000001,"15min":12.053000000000001},"last":0.433},{"interface":"front","average":{"1min":2.4849999999999999,"5min":1.621,"15min":1.097},"min":{"1min":0.42199999999999999,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":12.137,"5min":12.137,"15min":12.137},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Apr 2 23:40:05 2020","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.755,"15min":0.64900000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.22800000000000001},"max":{"1min":6.6950000000000003,"5min":6.6950000000000003,"15min":6.6950000000000003},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.71199999999999997,"15min":0.61699999999999999},"min":{"1min":0.29899999999999999,"5min":0.25600000000000001,"15min":0.22},"max":{"1min":4.3659999999999997,"5min":4.7160000000000002,"15min":5.3310000000000004},"last":0.376}]},{"osd":5,"last update":"Thu Apr 2 23:40:05 2020","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.3740000000000001,"15min":0.93999999999999995},"min":{"1min":0.31,"5min":0.255,"15min":0.24199999999999999},"max":{"1min":6.8490000000000002,"5min":9.5389999999999997,"15min":9.5389999999999997},"last":0.32600000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":0.999,"15min":0.77900000000000003},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.26700000000000002},"max":{"1min":6.6680000000000001,"5min":6.6680000000000001,"15min":6.6680000000000001},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Apr 2 23:40:05 2020","interfaces":[{"interface":"back","average":{"1min":1.6719999999999999,"5min":1.1240000000000001,"15min":0.81599999999999995},"min":{"1min":0.32600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":6.7309999999999999,"5min":7.7359999999999998,"15min":7.7359999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.306,"5min":0.996,"15min":0.76600000000000001},"min":{"1min":0.28899999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":6.3310000000000004,"5min":6.3310000000000004,"15min":6.6399999999999997},"last":0.48999999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542338,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":109917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:40:01 2020","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.873,"15min":0.59999999999999998},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":6.9640000000000004,"5min":6.9640000000000004,"15min":6.9640000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.84499999999999997,"15min":0.61799999999999999},"min":{"1min":0.22,"5min":0.20799999999999999,"15min":0.19600000000000001},"max":{"1min":5.2880000000000003,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Apr 2 23:40:01 2020","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":0.83299999999999996,"15min":0.62},"min":{"1min":0.217,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":8.0960000000000001,"5min":8.0960000000000001,"15min":8.0960000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":1.8740000000000001,"5min":1.073,"15min":0.75600000000000001},"min":{"1min":0.26700000000000002,"5min":0.23499999999999999,"15min":0.217},"max":{"1min":8.1319999999999997,"5min":8.1319999999999997,"15min":8.1319999999999997},"last":0.433}]},{"osd":2,"last update":"Thu Apr 2 23:40:01 2020","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.78000000000000003,"15min":0.65700000000000003},"min":{"1min":0.248,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":4.3579999999999997,"5min":5.3769999999999998,"15min":11.308999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.85299999999999998,"15min":0.69199999999999995},"min":{"1min":0.307,"5min":0.25,"15min":0.25},"max":{"1min":2.0409999999999999,"5min":7.5590000000000002,"15min":7.5590000000000002},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Apr 2 23:40:01 2020","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.88700000000000001,"15min":0.72799999999999998},"min":{"1min":0.307,"5min":0.25700000000000001,"15min":0.249},"max":{"1min":4.4390000000000001,"5min":7.2160000000000002,"15min":7.2160000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.1950000000000001,"5min":0.91300000000000003,"15min":0.749},"min":{"1min":0.33400000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":6.8899999999999997,"5min":8.6630000000000003,"15min":8.6630000000000003},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Apr 2 23:40:01 2020","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.57199999999999995,"15min":0.64900000000000002},"min":{"1min":0.24299999999999999,"5min":0.22800000000000001,"15min":0.224},"max":{"1min":0.75,"5min":4.8639999999999999,"15min":5.8860000000000001},"last":0.254},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.71099999999999997,"15min":0.58899999999999997},"min":{"1min":0.253,"5min":0.224,"15min":0.224},"max":{"1min":1.3169999999999999,"5min":4.0919999999999996,"15min":5.1210000000000004},"last":0.372}]},{"osd":6,"last update":"Thu Apr 2 23:40:01 2020","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":1.012,"15min":0.72999999999999998},"min":{"1min":0.26700000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":3.5840000000000001,"5min":18.419,"15min":18.419},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":1.1000000000000001,"15min":0.874},"min":{"1min":0.29399999999999998,"5min":0.28000000000000003,"15min":0.23300000000000001},"max":{"1min":4.3250000000000002,"5min":22.329000000000001,"15min":22.329000000000001},"last":0.32800000000000001}]},{"osd":7,"last update":"Thu Apr 2 23:40:01 2020","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.98499999999999999,"15min":0.74099999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27400000000000002},"max":{"1min":5.0410000000000004,"5min":6.6200000000000001,"15min":6.6200000000000001},"last":0.314},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.69299999999999995,"15min":0.64400000000000002},"min":{"1min":0.314,"5min":0.254,"15min":0.254},"max":{"1min":1.4910000000000001,"5min":5.7960000000000003,"15min":5.7960000000000003},"last":0.40500000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542338,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1051856,"kb_used_data":3272,"kb_used_omap":212,"kb_used_meta":1048363,"kb_avail":93319984,"statfs":{"total":96636764160,"available":95559663616,"internally_reserved":1073741824,"allocated":3350528,"data_stored":4352493,"data_compressed":500856,"data_compressed_allocated":1187840,"data_compressed_original":2375680,"omap_allocated":217393,"internal_metadata":1073524431},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:40:08 2020","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":1.208,"15min":0.75900000000000001},"min":{"1min":0.22800000000000001,"5min":0.186,"15min":0.157},"max":{"1min":3.3279999999999998,"5min":7.0700000000000003,"15min":7.0700000000000003},"last":0.19900000000000001},{"interface":"front","average":{"1min":1.786,"5min":1.0780000000000001,"15min":0.753},"min":{"1min":0.23799999999999999,"5min":0.20699999999999999,"15min":0.191},"max":{"1min":16.202000000000002,"5min":16.202000000000002,"15min":16.202000000000002},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Apr 2 23:40:08 2020","interfaces":[{"interface":"back","average":{"1min":1.8320000000000001,"5min":1.3300000000000001,"15min":0.877},"min":{"1min":0.223,"5min":0.20999999999999999,"15min":0.20000000000000001},"max":{"1min":12.231999999999999,"5min":12.231999999999999,"15min":12.231999999999999},"last":0.372},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.2310000000000001,"15min":0.78900000000000003},"min":{"1min":0.316,"5min":0.23200000000000001,"15min":0.21299999999999999},"max":{"1min":3.7749999999999999,"5min":6.9199999999999999,"15min":6.9199999999999999},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Apr 2 23:40:08 2020","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.23,"15min":0.84699999999999998},"min":{"1min":0.29699999999999999,"5min":0.23999999999999999,"15min":0.23000000000000001},"max":{"1min":12.321,"5min":12.321,"15min":12.321},"last":0.224},{"interface":"front","average":{"1min":1.659,"5min":1.4119999999999999,"15min":0.88800000000000001},"min":{"1min":0.26300000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":14.734999999999999,"5min":14.734999999999999,"15min":14.734999999999999},"last":0.35399999999999998}]},{"osd":3,"last update":"Thu Apr 2 23:40:08 2020","interfaces":[{"interface":"back","average":{"1min":2.7290000000000001,"5min":1.387,"15min":0.92400000000000004},"min":{"1min":0.30199999999999999,"5min":0.224,"15min":0.224},"max":{"1min":16.161000000000001,"5min":16.161000000000001,"15min":16.161000000000001},"last":0.317},{"interface":"front","average":{"1min":2.6549999999999998,"5min":1.4610000000000001,"15min":0.97399999999999998},"min":{"1min":0.28599999999999998,"5min":0.26500000000000001,"15min":0.26400000000000001},"max":{"1min":12.372,"5min":12.372,"15min":12.372},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Apr 2 23:40:08 2020","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.129,"15min":0.77800000000000002},"min":{"1min":0.24299999999999999,"5min":0.218,"15min":0.20699999999999999},"max":{"1min":16.239000000000001,"5min":16.239000000000001,"15min":16.239000000000001},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.871,"5min":1.323,"15min":0.89300000000000002},"min":{"1min":0.374,"5min":0.219,"15min":0.219},"max":{"1min":3.246,"5min":7.9379999999999997,"15min":9.9800000000000004},"last":0.29399999999999998}]},{"osd":5,"last update":"Thu Apr 2 23:40:08 2020","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":1.246,"15min":0.86699999999999999},"min":{"1min":0.26000000000000001,"5min":0.24299999999999999,"15min":0.23799999999999999},"max":{"1min":12.289999999999999,"5min":12.289999999999999,"15min":12.289999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.86899999999999999,"5min":1.349,"15min":0.90400000000000003},"min":{"1min":0.314,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.2949999999999999,"5min":13.016,"15min":13.016},"last":0.24299999999999999}]},{"osd":7,"last update":"Thu Apr 2 23:40:08 2020","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.3779999999999999,"15min":0.89300000000000002},"min":{"1min":0.27100000000000002,"5min":0.222,"15min":0.222},"max":{"1min":16.015999999999998,"5min":16.015999999999998,"15min":16.015999999999998},"last":0.496},{"interface":"front","average":{"1min":1.7589999999999999,"5min":1.488,"15min":0.95199999999999996},"min":{"1min":0.41999999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":12.346,"5min":12.346,"15min":12.346},"last":0.42699999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542337,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1051796,"kb_used_data":3212,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93320044,"statfs":{"total":96636764160,"available":95559725056,"internally_reserved":1073741824,"allocated":3289088,"data_stored":4304289,"data_compressed":499178,"data_compressed_allocated":1183744,"data_compressed_original":2367488,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:40:16 2020","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.52900000000000003,"15min":0.49099999999999999},"min":{"1min":0.19400000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":1.1830000000000001,"5min":5.6600000000000001,"15min":6.1040000000000001},"last":0.307},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.73899999999999999,"15min":0.57399999999999995},"min":{"1min":0.22500000000000001,"5min":0.20499999999999999,"15min":0.19800000000000001},"max":{"1min":1.1339999999999999,"5min":7.3920000000000003,"15min":7.3920000000000003},"last":0.499}]},{"osd":1,"last update":"Thu Apr 2 23:40:16 2020","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.78100000000000003,"15min":0.64200000000000002},"min":{"1min":0.33500000000000002,"5min":0.224,"15min":0.224},"max":{"1min":5.181,"5min":5.46,"15min":7.859},"last":0.36199999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.038,"15min":0.77100000000000002},"min":{"1min":0.313,"5min":0.20999999999999999,"15min":0.20499999999999999},"max":{"1min":8.5939999999999994,"5min":8.5939999999999994,"15min":8.5939999999999994},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Apr 2 23:40:16 2020","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.79700000000000004,"15min":0.66700000000000004},"min":{"1min":0.251,"5min":0.23599999999999999,"15min":0.214},"max":{"1min":7.1699999999999999,"5min":7.1699999999999999,"15min":7.1699999999999999},"last":0.433},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84399999999999997,"15min":0.70999999999999996},"min":{"1min":0.254,"5min":0.253,"15min":0.253},"max":{"1min":7.1890000000000001,"5min":7.1890000000000001,"15min":7.1890000000000001},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Apr 2 23:40:16 2020","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.83999999999999997,"15min":0.73199999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.22700000000000001},"max":{"1min":2.77,"5min":6.923,"15min":7.1189999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.86099999999999999,"15min":0.73599999999999999},"min":{"1min":0.32700000000000001,"5min":0.29099999999999998,"15min":0.25900000000000001},"max":{"1min":2.7429999999999999,"5min":5.734,"15min":7.0780000000000003},"last":0.379}]},{"osd":4,"last update":"Thu Apr 2 23:40:16 2020","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.753,"15min":0.61799999999999999},"min":{"1min":0.23300000000000001,"5min":0.224,"15min":0.223},"max":{"1min":0.995,"5min":6.5880000000000001,"15min":6.5880000000000001},"last":0.25},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.75900000000000001,"15min":0.62},"min":{"1min":0.247,"5min":0.247,"15min":0.192},"max":{"1min":1.425,"5min":5.0140000000000002,"15min":5.0140000000000002},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Apr 2 23:40:16 2020","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.98699999999999999,"15min":0.84599999999999997},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.247},"max":{"1min":1.236,"5min":7.6029999999999998,"15min":18.593},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.96799999999999997,"15min":0.87},"min":{"1min":0.28199999999999997,"5min":0.25700000000000001,"15min":0.246},"max":{"1min":4.2599999999999998,"5min":8.2870000000000008,"15min":18.402000000000001},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Apr 2 23:40:16 2020","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.94099999999999995,"15min":0.74299999999999999},"min":{"1min":0.29799999999999999,"5min":0.27300000000000002,"15min":0.245},"max":{"1min":1.323,"5min":9.0570000000000004,"15min":9.0570000000000004},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.84099999999999997,"15min":0.68899999999999995},"min":{"1min":0.30399999999999999,"5min":0.29599999999999999,"15min":0.253},"max":{"1min":0.92700000000000005,"5min":11.67,"15min":11.67},"last":0.47499999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509633,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1052504,"kb_used_data":3920,"kb_used_omap":1390,"kb_used_meta":1047185,"kb_avail":93319336,"statfs":{"total":96636764160,"available":95559000064,"internally_reserved":1073741824,"allocated":4014080,"data_stored":4581237,"data_compressed":325716,"data_compressed_allocated":733184,"data_compressed_original":1466368,"omap_allocated":1423856,"internal_metadata":1072317968},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 2 23:40:06 2020","interfaces":[{"interface":"back","average":{"1min":2.988,"5min":1.1000000000000001,"15min":0.71299999999999997},"min":{"1min":0.16200000000000001,"5min":0.159,"15min":0.156},"max":{"1min":13.994,"5min":13.994,"15min":13.994},"last":0.26900000000000002},{"interface":"front","average":{"1min":2.7160000000000002,"5min":1.0209999999999999,"15min":0.63900000000000001},"min":{"1min":0.187,"5min":0.17999999999999999,"15min":0.16400000000000001},"max":{"1min":15.039999999999999,"5min":15.039999999999999,"15min":15.039999999999999},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Apr 2 23:40:06 2020","interfaces":[{"interface":"back","average":{"1min":1.7669999999999999,"5min":0.92900000000000005,"15min":0.63400000000000001},"min":{"1min":0.22900000000000001,"5min":0.17799999999999999,"15min":0.17199999999999999},"max":{"1min":6.9509999999999996,"5min":6.9509999999999996,"15min":6.9509999999999996},"last":0.23400000000000001},{"interface":"front","average":{"1min":1.827,"5min":1.014,"15min":0.67400000000000004},"min":{"1min":0.22,"5min":0.17799999999999999,"15min":0.152},"max":{"1min":5.6029999999999998,"5min":10.241,"15min":10.241},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Apr 2 23:40:06 2020","interfaces":[{"interface":"back","average":{"1min":2.5379999999999998,"5min":0.99199999999999999,"15min":0.63900000000000001},"min":{"1min":0.20399999999999999,"5min":0.186,"15min":0.186},"max":{"1min":14.016,"5min":14.016,"15min":14.016},"last":0.434},{"interface":"front","average":{"1min":2.581,"5min":1.127,"15min":0.75},"min":{"1min":0.26200000000000001,"5min":0.20699999999999999,"15min":0.20000000000000001},"max":{"1min":14.06,"5min":14.06,"15min":14.06},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Apr 2 23:40:06 2020","interfaces":[{"interface":"back","average":{"1min":2.4820000000000002,"5min":1.123,"15min":0.78700000000000003},"min":{"1min":0.27100000000000002,"5min":0.224,"15min":0.224},"max":{"1min":8.3170000000000002,"5min":8.3170000000000002,"15min":8.3170000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.375,"5min":0.95299999999999996,"15min":0.71399999999999997},"min":{"1min":0.26600000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":6.3200000000000003,"5min":6.3200000000000003,"15min":6.3200000000000003},"last":0.33400000000000002}]},{"osd":5,"last update":"Thu Apr 2 23:40:06 2020","interfaces":[{"interface":"back","average":{"1min":2.1469999999999998,"5min":1.1579999999999999,"15min":0.85599999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.26000000000000001},"max":{"1min":6.766,"5min":6.766,"15min":6.766},"last":0.5},{"interface":"front","average":{"1min":1.202,"5min":0.754,"15min":0.64200000000000002},"min":{"1min":0.313,"5min":0.255,"15min":0.255},"max":{"1min":6.4349999999999996,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":0.34699999999999998}]},{"osd":6,"last update":"Thu Apr 2 23:40:06 2020","interfaces":[{"interface":"back","average":{"1min":2.1240000000000001,"5min":1.1779999999999999,"15min":0.94599999999999995},"min":{"1min":0.29499999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":7.0119999999999996,"5min":7.0119999999999996,"15min":24.530999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":2.4790000000000001,"5min":1.3979999999999999,"15min":1.0209999999999999},"min":{"1min":0.38600000000000001,"5min":0.317,"15min":0.26200000000000001},"max":{"1min":6.7210000000000001,"5min":8.7899999999999991,"15min":24.390000000000001},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Apr 2 23:40:06 2020","interfaces":[{"interface":"back","average":{"1min":2.7250000000000001,"5min":1.323,"15min":1.018},"min":{"1min":0.42099999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":6.5140000000000002,"5min":7.2539999999999996,"15min":24.459},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.704,"5min":0.94999999999999996,"15min":0.78500000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":7.5049999999999999,"5min":7.5049999999999999,"15min":24.559000000000001},"last":0.38100000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509635,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":1514,"kb_used_meta":1047061,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":109351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1550595,"internal_metadata":1072191229},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:39:54 2020","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.60399999999999998,"15min":0.502},"min":{"1min":0.185,"5min":0.152,"15min":0.152},"max":{"1min":4.0119999999999996,"5min":4.0119999999999996,"15min":8.6370000000000005},"last":0.33200000000000002},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.85399999999999998,"15min":0.63200000000000001},"min":{"1min":0.245,"5min":0.19900000000000001,"15min":0.17599999999999999},"max":{"1min":5.0369999999999999,"5min":7.2240000000000002,"15min":8.5950000000000006},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Apr 2 23:39:54 2020","interfaces":[{"interface":"back","average":{"1min":1.5349999999999999,"5min":1.0489999999999999,"15min":0.69899999999999995},"min":{"1min":0.20399999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":10.493,"5min":10.493,"15min":10.493},"last":0.20699999999999999},{"interface":"front","average":{"1min":1.232,"5min":0.77800000000000002,"15min":0.67600000000000005},"min":{"1min":0.251,"5min":0.20200000000000001,"15min":0.192},"max":{"1min":10.525,"5min":10.525,"15min":12.585000000000001},"last":0.23799999999999999}]},{"osd":3,"last update":"Thu Apr 2 23:39:54 2020","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":0.89700000000000002,"15min":0.69099999999999995},"min":{"1min":0.27300000000000002,"5min":0.218,"15min":0.218},"max":{"1min":8.016,"5min":8.016,"15min":8.6690000000000005},"last":0.41499999999999998},{"interface":"front","average":{"1min":1.3939999999999999,"5min":0.99299999999999999,"15min":0.70499999999999996},"min":{"1min":0.27900000000000003,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":8.0589999999999993,"5min":8.0589999999999993,"15min":8.4570000000000007},"last":0.37}]},{"osd":4,"last update":"Thu Apr 2 23:39:54 2020","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.103,"15min":0.85899999999999999},"min":{"1min":0.40300000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":7.923,"5min":8.9600000000000009,"15min":8.9600000000000009},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.755,"15min":0.70599999999999996},"min":{"1min":0.37,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":7.9550000000000001,"5min":7.9550000000000001,"15min":9.0879999999999992},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Apr 2 23:39:54 2020","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.1739999999999999,"15min":0.88700000000000001},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.253},"max":{"1min":3.8650000000000002,"5min":8.5519999999999996,"15min":8.5519999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.1919999999999999,"15min":0.92600000000000005},"min":{"1min":0.31,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":5.0039999999999996,"5min":8.9979999999999993,"15min":8.9979999999999993},"last":0.29799999999999999}]},{"osd":6,"last update":"Thu Apr 2 23:39:54 2020","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.4139999999999999,"15min":1.0169999999999999},"min":{"1min":0.34499999999999997,"5min":0.32400000000000001,"15min":0.26800000000000002},"max":{"1min":5.1040000000000001,"5min":10.012,"15min":10.012},"last":0.44700000000000001},{"interface":"front","average":{"1min":1.7729999999999999,"5min":1.621,"15min":1.1539999999999999},"min":{"1min":0.35199999999999998,"5min":0.30199999999999999,"15min":0.30099999999999999},"max":{"1min":5.1230000000000002,"5min":10.760999999999999,"15min":10.760999999999999},"last":0.35299999999999998}]},{"osd":7,"last update":"Thu Apr 2 23:39:54 2020","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.98199999999999998,"15min":0.84199999999999997},"min":{"1min":0.40300000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":6.1189999999999998,"5min":6.1189999999999998,"15min":12.641999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1259999999999999,"15min":0.84899999999999998},"min":{"1min":0.42399999999999999,"5min":0.373,"15min":0.30299999999999999},"max":{"1min":3.786,"5min":7.306,"15min":8.8460000000000001},"last":0.40200000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509633,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1052556,"kb_used_data":3972,"kb_used_omap":1237,"kb_used_meta":1047338,"kb_avail":93319284,"statfs":{"total":96636764160,"available":95558946816,"internally_reserved":1073741824,"allocated":4067328,"data_stored":4628875,"data_compressed":327394,"data_compressed_allocated":737280,"data_compressed_original":1474560,"omap_allocated":1267315,"internal_metadata":1072474509},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:40:07 2020","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":0.72099999999999997,"15min":0.60699999999999998},"min":{"1min":0.214,"5min":0.161,"15min":0.153},"max":{"1min":6.3920000000000003,"5min":6.3920000000000003,"15min":6.8869999999999996},"last":0.192},{"interface":"front","average":{"1min":0.434,"5min":0.61499999999999999,"15min":0.59799999999999998},"min":{"1min":0.22,"5min":0.17399999999999999,"15min":0.17199999999999999},"max":{"1min":1.7130000000000001,"5min":4.907,"15min":4.907},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Apr 2 23:40:07 2020","interfaces":[{"interface":"back","average":{"1min":4.2380000000000004,"5min":1.3149999999999999,"15min":0.81100000000000005},"min":{"1min":0.28699999999999998,"5min":0.182,"15min":0.16},"max":{"1min":37.390000000000001,"5min":37.390000000000001,"15min":37.390000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":4.367,"5min":1.5509999999999999,"15min":0.91300000000000003},"min":{"1min":0.29199999999999998,"5min":0.23200000000000001,"15min":0.223},"max":{"1min":38.082999999999998,"5min":38.082999999999998,"15min":38.082999999999998},"last":0.503}]},{"osd":3,"last update":"Thu Apr 2 23:40:07 2020","interfaces":[{"interface":"back","average":{"1min":4.9950000000000001,"5min":1.6559999999999999,"15min":0.97099999999999997},"min":{"1min":0.23999999999999999,"5min":0.191,"15min":0.184},"max":{"1min":40.009,"5min":40.009,"15min":40.009},"last":0.23999999999999999},{"interface":"front","average":{"1min":5.266,"5min":1.726,"15min":1.016},"min":{"1min":0.30599999999999999,"5min":0.20399999999999999,"15min":0.20100000000000001},"max":{"1min":40.039000000000001,"5min":40.039000000000001,"15min":40.039000000000001},"last":0.25900000000000001}]},{"osd":4,"last update":"Thu Apr 2 23:40:07 2020","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.83399999999999996,"15min":0.751},"min":{"1min":0.33900000000000002,"5min":0.27100000000000002,"15min":0.26700000000000002},"max":{"1min":4.6310000000000002,"5min":9.0619999999999994,"15min":9.0619999999999994},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.79100000000000004,"15min":0.76700000000000002},"min":{"1min":0.30399999999999999,"5min":0.27100000000000002,"15min":0.25900000000000001},"max":{"1min":1.677,"5min":5.5970000000000004,"15min":5.5970000000000004},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Apr 2 23:40:07 2020","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.997,"15min":0.81999999999999995},"min":{"1min":0.28699999999999998,"5min":0.26200000000000001,"15min":0.245},"max":{"1min":4.5339999999999998,"5min":8.3539999999999992,"15min":8.3539999999999992},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.92500000000000004,"15min":0.79400000000000004},"min":{"1min":0.32200000000000001,"5min":0.29199999999999998,"15min":0.27500000000000002},"max":{"1min":4.6929999999999996,"5min":8.9949999999999992,"15min":8.9949999999999992},"last":0.40699999999999997}]},{"osd":6,"last update":"Thu Apr 2 23:40:07 2020","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.8149999999999999,"15min":1.244},"min":{"1min":0.44500000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":4.9550000000000001,"5min":68.593000000000004,"15min":68.593000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":1.986,"5min":2.125,"15min":1.3440000000000001},"min":{"1min":0.42899999999999999,"5min":0.307,"15min":0.28999999999999998},"max":{"1min":9.3030000000000008,"5min":68.489000000000004,"15min":68.489000000000004},"last":0.43099999999999999}]},{"osd":7,"last update":"Thu Apr 2 23:40:07 2020","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.21,"15min":0.93999999999999995},"min":{"1min":0.40799999999999997,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":10.177,"5min":10.177,"15min":10.177},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.641,"5min":1.1950000000000001,"15min":0.90200000000000002},"min":{"1min":0.36799999999999999,"5min":0.32300000000000001,"15min":0.311},"max":{"1min":9.9770000000000003,"5min":9.9770000000000003,"15min":9.9770000000000003},"last":0.311}]}]},{"osd":3,"up_from":15,"seq":64424509635,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":1502,"kb_used_meta":1047073,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":109351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1538120,"internal_metadata":1072203704},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 2 23:39:59 2020","interfaces":[{"interface":"back","average":{"1min":1.948,"5min":1.0109999999999999,"15min":0.69899999999999995},"min":{"1min":0.21099999999999999,"5min":0.16600000000000001,"15min":0.154},"max":{"1min":13.66,"5min":13.66,"15min":13.66},"last":0.189},{"interface":"front","average":{"1min":2.0350000000000001,"5min":0.92000000000000004,"15min":0.58399999999999996},"min":{"1min":0.20799999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":13.696,"5min":13.696,"15min":13.696},"last":0.22900000000000001}]},{"osd":1,"last update":"Thu Apr 2 23:39:59 2020","interfaces":[{"interface":"back","average":{"1min":3.3100000000000001,"5min":1.534,"15min":0.91500000000000004},"min":{"1min":0.24099999999999999,"5min":0.19800000000000001,"15min":0.17999999999999999},"max":{"1min":16.09,"5min":16.09,"15min":16.09},"last":0.26900000000000002},{"interface":"front","average":{"1min":3.2839999999999998,"5min":1.3500000000000001,"15min":0.81299999999999994},"min":{"1min":0.27000000000000002,"5min":0.22900000000000001,"15min":0.182},"max":{"1min":19.577000000000002,"5min":19.577000000000002,"15min":19.577000000000002},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Apr 2 23:39:59 2020","interfaces":[{"interface":"back","average":{"1min":2.0030000000000001,"5min":1.1539999999999999,"15min":0.81999999999999995},"min":{"1min":0.218,"5min":0.216,"15min":0.18099999999999999},"max":{"1min":13.583,"5min":13.583,"15min":13.583},"last":0.33700000000000002},{"interface":"front","average":{"1min":1.4770000000000001,"5min":0.98799999999999999,"15min":0.69099999999999995},"min":{"1min":0.251,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":13.795,"5min":13.795,"15min":13.795},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Apr 2 23:39:59 2020","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.133,"15min":0.86399999999999999},"min":{"1min":0.29399999999999998,"5min":0.246,"15min":0.246},"max":{"1min":7.3369999999999997,"5min":7.3369999999999997,"15min":7.3369999999999997},"last":0.32200000000000001},{"interface":"front","average":{"1min":2.3959999999999999,"5min":1.28,"15min":0.91200000000000003},"min":{"1min":0.29799999999999999,"5min":0.25900000000000001,"15min":0.25700000000000001},"max":{"1min":15.545999999999999,"5min":15.545999999999999,"15min":15.545999999999999},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Apr 2 23:39:59 2020","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.204,"15min":0.88500000000000001},"min":{"1min":0.38,"5min":0.29399999999999998,"15min":0.27900000000000003},"max":{"1min":13.837999999999999,"5min":13.837999999999999,"15min":13.837999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":1.226,"5min":1.1020000000000001,"15min":0.85599999999999998},"min":{"1min":0.34499999999999997,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":7.4320000000000004,"5min":8.8650000000000002,"15min":8.8650000000000002},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Apr 2 23:39:59 2020","interfaces":[{"interface":"back","average":{"1min":2.8210000000000002,"5min":1.607,"15min":1.0840000000000001},"min":{"1min":0.38400000000000001,"5min":0.316,"15min":0.316},"max":{"1min":15.587999999999999,"5min":15.587999999999999,"15min":15.587999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.841,"5min":1.542,"15min":1.026},"min":{"1min":0.33600000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":13.997999999999999,"5min":13.997999999999999,"15min":13.997999999999999},"last":0.439}]},{"osd":7,"last update":"Thu Apr 2 23:39:59 2020","interfaces":[{"interface":"back","average":{"1min":2.258,"5min":1.2010000000000001,"15min":0.92200000000000004},"min":{"1min":0.39800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":13.638,"5min":13.638,"15min":13.638},"last":0.38900000000000001},{"interface":"front","average":{"1min":1.6890000000000001,"5min":1.1220000000000001,"15min":0.91600000000000004},"min":{"1min":0.36899999999999999,"5min":0.312,"15min":0.312},"max":{"1min":13.766999999999999,"5min":13.766999999999999,"15min":13.766999999999999},"last":0.53300000000000003}]}]}]}} 2020-04-02T23:40:35.869 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:40:35.884 INFO:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2020-04-02T23:40:36.040 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.035+0000 7fee42d0c700 1 Processor -- start 2020-04-02T23:40:36.041 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.035+0000 7fee42d0c700 1 -- start start 2020-04-02T23:40:36.041 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.036+0000 7fee42d0c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fee3c148da0 0x7fee3c0a3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:40:36.041 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.036+0000 7fee42d0c700 1 --2- >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fee3c07fa80 0x7fee3c07ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-04-02T23:40:36.041 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.036+0000 7fee42d0c700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3c0a55c0 con 0x7fee3c0ab230 2020-04-02T23:40:36.041 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.036+0000 7fee42d0c700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee3c0a68c0 con 0x7fee3c148da0 2020-04-02T23:40:36.041 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.036+0000 7fee42d0c700 1 -- --> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c0a6b60 con 0x7fee3c07fa80 2020-04-02T23:40:36.041 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.036+0000 7fee40aa8700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fee3c148da0 0x7fee3c0a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:40:36.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.036+0000 7fee40aa8700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fee3c148da0 0x7fee3c0a3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40860/0 (socket says 172.21.15.42:40860) 2020-04-02T23:40:36.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.036+0000 7fee40aa8700 1 -- 172.21.15.42:0/494547569 learned_addr learned my addr 172.21.15.42:0/494547569 (peer_addr_for_me v2:172.21.15.42:0/0) 2020-04-02T23:40:36.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.036+0000 7fee41aaa700 1 --2- 172.21.15.42:0/494547569 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fee3c07fa80 0x7fee3c07ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:40:36.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.036+0000 7fee40aa8700 1 -- 172.21.15.42:0/494547569 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fee3c07fa80 msgr2=0x7fee3c07ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-04-02T23:40:36.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.036+0000 7fee40aa8700 1 --2- 172.21.15.42:0/494547569 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fee3c07fa80 0x7fee3c07ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:40:36.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.037+0000 7fee40aa8700 1 -- 172.21.15.42:0/494547569 >> v1:172.21.15.42:6789/0 conn(0x7fee3c0ab230 legacy=0x7fee3c148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:40:36.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.036+0000 7fee2ffff700 1 -- 172.21.15.42:0/494547569 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037373010 0 0) 0x7fee3c0a55c0 con 0x7fee3c0ab230 2020-04-02T23:40:36.042 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.037+0000 7fee40aa8700 1 -- 172.21.15.42:0/494547569 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c0a6380 con 0x7fee3c148da0 2020-04-02T23:40:36.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.037+0000 7fee40aa8700 1 --2- 172.21.15.42:0/494547569 >> v2:172.21.15.42:3300/0 conn(0x7fee3c148da0 0x7fee3c0a3440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fee38002f30 tx=0x7fee38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:36.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.037+0000 7fee40aa8700 1 --2- 172.21.15.42:0/494547569 >> v2:172.21.15.42:3300/0 conn(0x7fee3c148da0 0x7fee3c0a3440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fee38002f30 tx=0x7fee38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:36.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.037+0000 7fee40aa8700 1 --2- 172.21.15.42:0/494547569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee3c148da0 0x7fee3c0a3440 secure :-1 s=READY pgs=248 cs=0 l=1 rx=0x7fee38002f30 tx=0x7fee38007a40).ready entity=mon.0 client_cookie=6ce18c9064224b33 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:40:36.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.037+0000 7fee40aa8700 1 --2- 172.21.15.42:0/494547569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee3c148da0 0x7fee3c0a3440 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7fee38002f30 tx=0x7fee38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:36.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.037+0000 7fee2ffff700 1 -- 172.21.15.42:0/494547569 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee38011670 con 0x7fee3c148da0 2020-04-02T23:40:36.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.037+0000 7fee40aa8700 1 --2- 172.21.15.42:0/494547569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee3c148da0 0x7fee3c0a3440 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7fee38002f30 tx=0x7fee38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:36.043 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.037+0000 7fee40aa8700 1 --2- 172.21.15.42:0/494547569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee3c148da0 0x7fee3c0a3440 secure :-1 s=THROTTLE_DONE pgs=248 cs=0 l=1 rx=0x7fee38002f30 tx=0x7fee38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:36.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.037+0000 7fee2ffff700 1 -- 172.21.15.42:0/494547569 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee380117d0 con 0x7fee3c148da0 2020-04-02T23:40:36.045 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.037+0000 7fee2ffff700 1 -- 172.21.15.42:0/494547569 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee38011bb0 con 0x7fee3c148da0 2020-04-02T23:40:36.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.037+0000 7fee42d0c700 1 -- 172.21.15.42:0/494547569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee3c148da0 msgr2=0x7fee3c0a3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:40:36.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.037+0000 7fee42d0c700 1 --2- 172.21.15.42:0/494547569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee3c148da0 0x7fee3c0a3440 secure :-1 s=READY pgs=248 cs=0 l=1 rx=0x7fee38002f30 tx=0x7fee38007a40).stop 2020-04-02T23:40:36.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.037+0000 7fee42d0c700 1 -- 172.21.15.42:0/494547569 shutdown_connections 2020-04-02T23:40:36.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.037+0000 7fee42d0c700 1 --2- 172.21.15.42:0/494547569 >> [v2:172.21.15.84:3301/0,v1:172.21.15.84:6790/0] conn(0x7fee3c07fa80 0x7fee3c07ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-04-02T23:40:36.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.037+0000 7fee42d0c700 1 --2- 172.21.15.42:0/494547569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee3c148da0 0x7fee3c0a3440 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:40:36.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.037+0000 7fee42d0c700 1 -- 172.21.15.42:0/494547569 >> 172.21.15.42:0/494547569 conn(0x7fee3c09dc40 msgr2=0x7fee3c0aa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:40:36.046 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.037+0000 7fee42d0c700 1 -- 172.21.15.42:0/494547569 shutdown_connections 2020-04-02T23:40:36.047 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.037+0000 7fee42d0c700 1 -- 172.21.15.42:0/494547569 wait complete. 2020-04-02T23:40:36.047 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.038+0000 7fee42d0c700 1 Processor -- start 2020-04-02T23:40:36.047 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.039+0000 7fee42d0c700 1 -- start start 2020-04-02T23:40:36.057 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.039+0000 7fee42d0c700 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fee3c07fa80 0x7fee3c07ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:40:36.057 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.039+0000 7fee42d0c700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3c063e10 con 0x7fee3c0ab230 2020-04-02T23:40:36.058 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.039+0000 7fee42d0c700 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3c0640b0 con 0x7fee3c148da0 2020-04-02T23:40:36.058 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.039+0000 7fee42d0c700 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee3c064350 con 0x7fee3c07fa80 2020-04-02T23:40:36.058 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.039+0000 7fee40aa8700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fee3c0ab230 0x7fee3c134d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:60290/0 (socket says 172.21.15.42:60290) 2020-04-02T23:40:36.058 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.039+0000 7fee40aa8700 1 -- 172.21.15.42:0/2954214828 learned_addr learned my addr 172.21.15.42:0/2954214828 (peer_addr_for_me v1:172.21.15.42:0/0) 2020-04-02T23:40:36.060 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.039+0000 7fee412a9700 1 --2- 172.21.15.42:0/2954214828 >> v2:172.21.15.84:3300/0 conn(0x7fee3c07fa80 0x7fee3c07ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:40:36.060 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.040+0000 7fee2dffb700 1 -- 172.21.15.42:0/2954214828 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28174912 0 0) 0x7fee3c063e10 con 0x7fee3c0ab230 2020-04-02T23:40:36.060 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.040+0000 7fee2dffb700 1 -- 172.21.15.42:0/2954214828 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee1c003230 con 0x7fee3c0ab230 2020-04-02T23:40:36.060 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.040+0000 7fee412a9700 1 -- 172.21.15.42:0/2954214828 >> v1:172.21.15.84:6789/0 conn(0x7fee3c148da0 legacy=0x7fee3c13be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:40:36.061 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.040+0000 7fee2dffb700 1 -- 172.21.15.42:0/2954214828 <== mon.1 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553567299 0 0) 0x7fee3c0640b0 con 0x7fee3c148da0 2020-04-02T23:40:36.061 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.040+0000 7fee412a9700 1 -- 172.21.15.42:0/2954214828 >> v1:172.21.15.42:6789/0 conn(0x7fee3c0ab230 legacy=0x7fee3c134d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:40:36.061 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.040+0000 7fee412a9700 1 -- 172.21.15.42:0/2954214828 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c066e20 con 0x7fee3c07fa80 2020-04-02T23:40:36.061 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.040+0000 7fee412a9700 1 --2- 172.21.15.42:0/2954214828 >> v2:172.21.15.84:3300/0 conn(0x7fee3c07fa80 0x7fee3c07ee60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee30000b80 tx=0x7fee3c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:36.061 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.040+0000 7fee412a9700 1 --2- 172.21.15.42:0/2954214828 >> v2:172.21.15.84:3300/0 conn(0x7fee3c07fa80 0x7fee3c07ee60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee30000b80 tx=0x7fee3c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:36.061 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.040+0000 7fee412a9700 1 --2- 172.21.15.42:0/2954214828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c07fa80 0x7fee3c07ee60 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7fee30000b80 tx=0x7fee3c0680a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:40:36.061 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.040+0000 7fee412a9700 1 --2- 172.21.15.42:0/2954214828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c07fa80 0x7fee3c07ee60 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fee30000b80 tx=0x7fee3c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:36.062 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.040+0000 7fee2dffb700 1 -- 172.21.15.42:0/2954214828 <== mon.1 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee30006ab0 con 0x7fee3c07fa80 2020-04-02T23:40:36.062 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.040+0000 7fee412a9700 1 --2- 172.21.15.42:0/2954214828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c07fa80 0x7fee3c07ee60 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fee30000b80 tx=0x7fee3c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:36.062 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.040+0000 7fee412a9700 1 --2- 172.21.15.42:0/2954214828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c07fa80 0x7fee3c07ee60 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fee30000b80 tx=0x7fee3c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:36.062 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.040+0000 7fee2dffb700 1 -- 172.21.15.42:0/2954214828 <== mon.1 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee30006c10 con 0x7fee3c07fa80 2020-04-02T23:40:36.076 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.040+0000 7fee42d0c700 1 -- 172.21.15.42:0/2954214828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee3c05c1e0 con 0x7fee3c07fa80 2020-04-02T23:40:36.077 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.040+0000 7fee2dffb700 1 -- 172.21.15.42:0/2954214828 <== mon.1 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee30006e40 con 0x7fee3c07fa80 2020-04-02T23:40:36.077 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.040+0000 7fee42d0c700 1 -- 172.21.15.42:0/2954214828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee3c0a0c00 con 0x7fee3c07fa80 2020-04-02T23:40:36.077 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.041+0000 7fee412a9700 1 --2- 172.21.15.42:0/2954214828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c07fa80 0x7fee3c07ee60 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fee30000b80 tx=0x7fee3c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:36.077 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.041+0000 7fee42d0c700 1 -- 172.21.15.42:0/2954214828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee3c056c50 con 0x7fee3c07fa80 2020-04-02T23:40:36.077 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.041+0000 7fee2dffb700 1 -- 172.21.15.42:0/2954214828 <== mon.1 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 59525+0+0 (secure 0 0 0) 0x7fee3000b290 con 0x7fee3c07fa80 2020-04-02T23:40:36.078 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.041+0000 7fee412a9700 1 --2- 172.21.15.42:0/2954214828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c07fa80 0x7fee3c07ee60 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fee30000b80 tx=0x7fee3c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:36.078 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.042+0000 7fee2dffb700 1 --2- 172.21.15.42:0/2954214828 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fee1c04d880 0x7fee1c04fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-04-02T23:40:36.078 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.042+0000 7fee2dffb700 1 -- 172.21.15.42:0/2954214828 <== mon.1 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fee30060dc0 con 0x7fee3c07fa80 2020-04-02T23:40:36.078 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.042+0000 7fee40aa8700 1 --2- 172.21.15.42:0/2954214828 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fee1c04d880 0x7fee1c04fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-04-02T23:40:36.078 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.042+0000 7fee40aa8700 1 --2- 172.21.15.42:0/2954214828 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fee1c04d880 0x7fee1c04fd40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fee3c062f20 tx=0x7fee38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:36.078 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.042+0000 7fee40aa8700 1 --2- 172.21.15.42:0/2954214828 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fee1c04d880 0x7fee1c04fd40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fee3c062f20 tx=0x7fee38007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:36.079 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.042+0000 7fee40aa8700 1 --2- 172.21.15.42:0/2954214828 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fee1c04d880 0x7fee1c04fd40 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7fee3c062f20 tx=0x7fee38007a40).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-04-02T23:40:36.079 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.045+0000 7fee412a9700 1 --2- 172.21.15.42:0/2954214828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c07fa80 0x7fee3c07ee60 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fee30000b80 tx=0x7fee3c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:36.079 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.045+0000 7fee2dffb700 1 -- 172.21.15.42:0/2954214828 <== mon.1 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+126338 (secure 0 0 0) 0x7fee3003c520 con 0x7fee3c07fa80 2020-04-02T23:40:36.202 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.198+0000 7fee42d0c700 1 -- 172.21.15.42:0/2954214828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"} v 0) v1 -- 0x7fee3c05a600 con 0x7fee3c07fa80 2020-04-02T23:40:36.204 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.202+0000 7fee412a9700 1 --2- 172.21.15.42:0/2954214828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c07fa80 0x7fee3c07ee60 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fee30000b80 tx=0x7fee3c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:36.204 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.202+0000 7fee2dffb700 1 -- 172.21.15.42:0/2954214828 <== mon.1 v2:172.21.15.84:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fee3003c520 con 0x7fee3c07fa80 2020-04-02T23:40:36.204 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.202+0000 7fee412a9700 1 --2- 172.21.15.42:0/2954214828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c07fa80 0x7fee3c07ee60 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7fee30000b80 tx=0x7fee3c0680a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-04-02T23:40:36.204 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.202+0000 7fee2dffb700 1 -- 172.21.15.42:0/2954214828 <== mon.1 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}]=0 v2) v1 ==== 123+0+0 (secure 0 0 0) 0x7fee3003fb40 con 0x7fee3c07fa80 2020-04-02T23:40:36.207 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.204+0000 7fee42d0c700 1 -- 172.21.15.42:0/2954214828 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fee1c04d880 msgr2=0x7fee1c04fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:40:36.207 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.204+0000 7fee42d0c700 1 --2- 172.21.15.42:0/2954214828 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fee1c04d880 0x7fee1c04fd40 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7fee3c062f20 tx=0x7fee38007a40).stop 2020-04-02T23:40:36.207 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.204+0000 7fee42d0c700 1 -- 172.21.15.42:0/2954214828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c07fa80 msgr2=0x7fee3c07ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-04-02T23:40:36.207 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.204+0000 7fee42d0c700 1 --2- 172.21.15.42:0/2954214828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c07fa80 0x7fee3c07ee60 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7fee30000b80 tx=0x7fee3c0680a0).stop 2020-04-02T23:40:36.208 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.204+0000 7fee42d0c700 1 -- 172.21.15.42:0/2954214828 shutdown_connections 2020-04-02T23:40:36.208 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.204+0000 7fee42d0c700 1 --2- 172.21.15.42:0/2954214828 >> [v2:172.21.15.84:6800/23437,v1:172.21.15.84:6801/23437] conn(0x7fee1c04d880 0x7fee1c04fd40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:40:36.208 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.204+0000 7fee42d0c700 1 --2- 172.21.15.42:0/2954214828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee3c07fa80 0x7fee3c07ee60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0 tx=0).stop 2020-04-02T23:40:36.208 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.204+0000 7fee42d0c700 1 -- 172.21.15.42:0/2954214828 >> 172.21.15.42:0/2954214828 conn(0x7fee3c09dc40 msgr2=0x7fee3c05b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-04-02T23:40:36.208 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.205+0000 7fee42d0c700 1 -- 172.21.15.42:0/2954214828 shutdown_connections 2020-04-02T23:40:36.208 INFO:teuthology.orchestra.run.smithi042.stderr:2020-04-02T23:40:36.205+0000 7fee42d0c700 1 -- 172.21.15.42:0/2954214828 wait complete. 2020-04-02T23:40:36.217 INFO:teuthology.misc:Shutting down mds daemons... 2020-04-02T23:40:36.217 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-04-02T23:40:36.218 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:40:36.226 INFO:tasks.ceph.mds.a:Stopped 2020-04-02T23:40:36.227 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-04-02T23:40:36.227 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:40:36.240 INFO:tasks.ceph.mds.b:Stopped 2020-04-02T23:40:36.241 INFO:teuthology.misc:Shutting down osd daemons... 2020-04-02T23:40:36.241 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2020-04-02T23:40:36.241 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:40:36.324 INFO:tasks.ceph.osd.1:Stopped 2020-04-02T23:40:36.325 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2020-04-02T23:40:36.325 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:40:36.366 INFO:tasks.ceph.osd.0:Stopped 2020-04-02T23:40:36.367 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2020-04-02T23:40:36.367 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:40:36.425 INFO:tasks.ceph.osd.3:Stopped 2020-04-02T23:40:36.425 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2020-04-02T23:40:36.425 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:40:36.463 INFO:tasks.ceph.osd.2:Stopped 2020-04-02T23:40:36.464 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2020-04-02T23:40:36.464 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:40:36.509 INFO:tasks.ceph.osd.5:Stopped 2020-04-02T23:40:36.509 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2020-04-02T23:40:36.509 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:40:36.547 INFO:tasks.ceph.osd.4:Stopped 2020-04-02T23:40:36.547 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2020-04-02T23:40:36.547 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:40:36.637 INFO:tasks.ceph.osd.7:Stopped 2020-04-02T23:40:36.637 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2020-04-02T23:40:36.638 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:40:36.720 INFO:tasks.ceph.osd.6:Stopped 2020-04-02T23:40:36.720 INFO:teuthology.misc:Shutting down mgr daemons... 2020-04-02T23:40:36.721 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2020-04-02T23:40:36.721 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:40:36.736 INFO:tasks.ceph.mgr.y:Stopped 2020-04-02T23:40:36.736 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2020-04-02T23:40:36.736 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:40:36.754 INFO:tasks.ceph.mgr.x:Stopped 2020-04-02T23:40:36.754 INFO:teuthology.misc:Shutting down mon daemons... 2020-04-02T23:40:36.754 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-04-02T23:40:36.754 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:40:36.785 INFO:tasks.ceph.mon.a:Stopped 2020-04-02T23:40:36.786 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-04-02T23:40:36.786 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:40:36.804 INFO:tasks.ceph.mon.c:Stopped 2020-04-02T23:40:36.804 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2020-04-02T23:40:36.804 INFO:teuthology.orchestra.run:waiting for 300 2020-04-02T23:40:36.854 INFO:tasks.ceph.mon.b:Stopped 2020-04-02T23:40:36.854 INFO:tasks.ceph:Checking cluster log for badness... 2020-04-02T23:40:36.854 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:40:36.868 INFO:teuthology.orchestra.run.smithi042:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2020-04-02T23:40:36.971 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi084.front.sepia.ceph.com 2020-04-02T23:40:36.971 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:40:37.033 INFO:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2020-04-02T23:40:38.457 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi084.front.sepia.ceph.com 2020-04-02T23:40:38.458 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:40:38.472 INFO:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2020-04-02T23:40:38.718 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi084.front.sepia.ceph.com 2020-04-02T23:40:38.718 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:40:38.732 INFO:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2020-04-02T23:40:38.977 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi084.front.sepia.ceph.com 2020-04-02T23:40:38.977 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:40:38.990 INFO:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2020-04-02T23:40:39.214 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi042.front.sepia.ceph.com 2020-04-02T23:40:39.215 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:40:39.229 INFO:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2020-04-02T23:40:39.842 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi042.front.sepia.ceph.com 2020-04-02T23:40:39.842 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:40:39.864 INFO:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2020-04-02T23:40:40.022 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi042.front.sepia.ceph.com 2020-04-02T23:40:40.023 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:40:40.036 INFO:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2020-04-02T23:40:40.199 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi042.front.sepia.ceph.com 2020-04-02T23:40:40.200 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:40:40.213 INFO:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2020-04-02T23:40:40.363 INFO:tasks.ceph:Archiving mon data... 2020-04-02T23:40:40.374 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919136/data/mon.b.tgz 2020-04-02T23:40:40.375 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:40:40.393 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-02T23:40:40.459 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.YrxSz6aeXi 2020-04-02T23:40:40.460 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:40:40.517 INFO:teuthology.orchestra.run.smithi084:> sudo tar cz -f /tmp/tmp.YrxSz6aeXi -C /var/lib/ceph/mon/ceph-b -- . 2020-04-02T23:40:40.921 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:40:40.935 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.YrxSz6aeXi 2020-04-02T23:40:41.108 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.YrxSz6aeXi is 1MB 2020-04-02T23:40:41.218 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:40:41.231 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.YrxSz6aeXi 2020-04-02T23:40:41.292 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919136/data/mon.c.tgz 2020-04-02T23:40:41.292 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:40:41.345 INFO:teuthology.orchestra.run.smithi084:> mktemp 2020-04-02T23:40:41.398 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.8IE0toiGXy 2020-04-02T23:40:41.399 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:40:41.452 INFO:teuthology.orchestra.run.smithi084:> sudo tar cz -f /tmp/tmp.8IE0toiGXy -C /var/lib/ceph/mon/ceph-c -- . 2020-04-02T23:40:41.773 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:40:41.786 INFO:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.8IE0toiGXy 2020-04-02T23:40:41.909 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.8IE0toiGXy is 1MB 2020-04-02T23:40:42.020 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:40:42.033 INFO:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.8IE0toiGXy 2020-04-02T23:40:42.086 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919136/data/mon.a.tgz 2020-04-02T23:40:42.087 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:40:42.101 INFO:teuthology.orchestra.run.smithi042:> mktemp 2020-04-02T23:40:42.164 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.FOqbYkgfvW 2020-04-02T23:40:42.164 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:40:42.218 INFO:teuthology.orchestra.run.smithi042:> sudo tar cz -f /tmp/tmp.FOqbYkgfvW -C /var/lib/ceph/mon/ceph-a -- . 2020-04-02T23:40:42.542 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:40:42.556 INFO:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.FOqbYkgfvW 2020-04-02T23:40:42.718 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.FOqbYkgfvW is 995KB 2020-04-02T23:40:42.839 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:40:42.853 INFO:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.FOqbYkgfvW 2020-04-02T23:40:42.906 INFO:tasks.ceph:Cleaning ceph cluster... 2020-04-02T23:40:42.907 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:40:42.960 INFO:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-04-02T23:40:43.002 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:40:43.015 INFO:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-04-02T23:40:43.137 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2020-04-02T23:40:43.138 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:40:43.151 INFO:teuthology.orchestra.run.smithi084:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-04-02T23:40:43.193 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:40:43.208 INFO:teuthology.orchestra.run.smithi042:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-04-02T23:40:43.219 INFO:teuthology.orchestra.run.smithi084.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-04-02T23:40:43.280 INFO:teuthology.orchestra.run.smithi042.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-04-02T23:40:43.286 INFO:tasks.ceph:Archiving crash dumps... 2020-04-02T23:40:43.288 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/crash to /home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919136/remote/smithi084/crash 2020-04-02T23:40:43.289 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:40:43.303 INFO:teuthology.orchestra.run.smithi084:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-04-02T23:40:43.373 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/crash to /home/teuthworker/archive/gregf-2020-04-02_17:05:44-fs-wip-greg-testing-42-distro-basic-smithi/4919136/remote/smithi042/crash 2020-04-02T23:40:43.374 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:40:43.388 INFO:teuthology.orchestra.run.smithi042:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-04-02T23:40:43.460 INFO:tasks.ceph:Shutting down logrotate 2020-04-02T23:46:22.058 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:46:22.077 INFO:teuthology.orchestra.run.smithi042:> sudo rm /etc/logrotate.d/ceph-test.conf 2020-04-02T23:46:22.190 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:46:22.250 INFO:teuthology.orchestra.run.smithi084:> sudo rm /etc/logrotate.d/ceph-test.conf 2020-04-02T23:46:22.326 INFO:tasks.ceph:Compressing logs... 2020-04-02T23:46:22.326 INFO:teuthology.orchestra.run.smithi042:> true 2020-04-02T23:46:22.343 INFO:teuthology.orchestra.run.smithi042:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-04-02T23:46:22.386 INFO:teuthology.orchestra.run.smithi084:> true 2020-04-02T23:46:22.399 INFO:teuthology.orchestra.run.smithi084:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-04-02T23:51:15.692 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-04-02T23:51:15.718 DEBUG:teuthology.task.console_log:Killing console logger for smithi042 2020-04-02T23:51:15.719 DEBUG:teuthology.task.console_log:Killing console logger for smithi084 2020-04-02T23:51:15.719 DEBUG:teuthology.task.console_log:Killing console logger for smithi042 2020-04-02T23:51:15.719 DEBUG:teuthology.task.console_log:Killing console logger for smithi084 2020-04-02T23:51:15.720 DEBUG:teuthology.exit:Finished running handlers